Controlling Geometry Visibility and Compile Times: Difference between revisions

From Valve Developer Community
Jump to navigation Jump to search
(corrected (?) description of PVS significance)
m (Changed redirect target from Visibility optimization to VIS optimization)
Tag: Redirect target changed
 
(4 intermediate revisions by 3 users not shown)
Line 1: Line 1:
{{merge|Optimization (Geometry)}}
#redirect [[VIS optimization]]
 
When a map is compiled with [[Vvis|vvis.exe]], it is partitioned into a number of [[Visleafs]]. For each Visleaf, VVIS calculates and records a ''Potentially Visible Set'' ([[PVS]]) which is a list of all other Visleafs that could be visible from that Visleaf. {{todo| Confirm: > The [[Rendering Engine]] then Renders everything in each Visleaf in the (Player's) current PVS ''before'' applying [[Viewcone]] and [[LOS|Line of Sight]] filtering.<}} The total amount of data from all the Visleafs within the current [[PVS]] directly impacts Rendering performance. This document explains some of the tools Level designers have to help control Visleafs and improve performance, including areaportals, hint brushes, occluders, and detail brushes. Some of the same tools that are used to control the [[PVS]] can also dramatically decrease the time it takes for [[Vvis|vvis]] to compile the level.#
 
{{note|PVS is also use by [[NPC_Sensing]], so manipulating visleafs may also impact on AI.}}
 
== Leaves ==
A compiled map is split into sections, called a <i>leaf</i> or <i>visleaf</i>. Each leaf is a volume that contains a section of geometry that is drawn together. When '''any''' part of a leaf is visible from the current leaf, all of the geometry in the leaf is considered for rendering by the engine. You can view the current leaf in the engine by typing <code>mat_leafvis 1</code> at the developer console. A red wireframe box will be drawn showing the current leaf. As you move around in the level, the box will redraw each time a new leaf is entered. Another way of visualizing leaves is to use the <code>glview</code> command-line tool.
 
For more information about leaves see [[visleafs]] (and/or [http://www.student.ru.nl/rvanhoorn/optimization.php?chapter=visleafs Ralph van Hoorn's excellent explanation of visleafs])
 
== Hints ==
[[Hint brush]]es are non-solid brushes that manually create leaf divisions. Since the entire contents of a leaf are drawn when any part of it is visible, hint brushes can be used to give the compile tools 'hints' about how the areas should be split up into leaves.
 
A hint brush is a single brush with the material <code>tools\toolshint</code> on one or more of its faces. The other faces should have <code>tools\toolsskip </code> applied to them. The brush side(s) with <code>toolshint</code> will be used as a cutting plane for the hint brush. A leaf boundary will be created along that plane when the map is compiled. Multiple hint brushes can be used in a single map, and can even intersect.
 
Proper usage of hint brushes on large, open levels can dramatically reduce the time it takes for [[Vvis|vvis]] to compile the level. Large numbers of leaves with lots of detail in them take a long time for the tools to compile. Use hint brushes to divide up the large sections of the level that have no detail from the areas that have lots of detail. A common example is an outdoor map with a canyon that opens to the sky. Placing a horizontal hint brush across the top of the canyon will create a large empty leaf in the sky, and separate it from the leaf with all of the detail (the canyon).
 
See <code>sourcesdk_content\hl2\mapsrc\sdk_hints.vmf</code> for examples of hint brush usage.
 
See [http://ninjagrinch.home.comcast.net/pyramidhint.htm NinjaGrinch's Pyramid Hint Brushes] article for some advanced hinting techniques and discussion.
 
== Areaportals ==
 
An [[areaportal]] is a brush entity, <code>[[func_areaportal]]</code>, that can be used to 'seal' separate leaves and control visibility. Areaportals are like doorways that can only be fully open or closed. When an areaportal is closed, it blocks the visibility of the geometry behind it. When it is open, the geometry is visible again. Areaportals can be dynamically opened and closed while the engine is running, and are typically set to open and close via outputs from sets of <code>[[trigger_multiple]]</code> brushes. The <code>[[func_areaportalwindow]]</code> entity is a type of areaportal that can be open or closed based on a distance from the player instead of simply being triggered to open or close like standard <code>[[func_areaportal]]</code> brushes.
 
Open areaportals (whether they're always open, or triggered to open) have a behavior of culling geometry that is visible through the areaportal. Similar to looking through an open window of a house, only the [[visleaves]] that are directly visible through the areaportal will be rendered by the engine. In this way, the geometry in the next area is roughly 'culled' to the size of the window, decreasing the amount of geometry rendered, and increasing performance. Due to these performance benefits, areaportals are often used in an ''always-open'' state, especially in multiplayer games.
 
Although areaportals can give substantial performance benefits when used correctly, care must be taken with not to place too many areaportals where many of them would all be visible simultaneously. There is processing overhead required for each areaportal.
 
:''See [[areaportal]] for more detail.''
 
==Visclusters==
 
[[Orange Box]] brush entity '''[[func_viscluster]]''' merges all visleaves inside it into one large leaf, reducing compile times and BSP filesize dramatically. It's exceptionally useful when your map contains open expanses of water or sky, or large, open areas with long sightlines.
 
However, creating large leaves in this way can also be detrimental to performance. The same rules for visibility apply to them: if one part of the clustered leaf can be seen from the current leaf, the whole area is considered for rendering. With bigger leaves, there are bigger performance losses to visibility map bugs. Unless your leaf is in a completely empty area (like a stretch of sky above an ocean), use areaportals in all approaches to it.
 
== Occluders ==
Occluders are similar to areaportals in that they are brush entities that control visibility of the geometry behind them. The main differences are that a) occluders only hide model geometry, not brush geometry, and b) occluders do not need to seal areas, they can be free standing. Similar to areaportals, occluders can be dynamically activated while the engine is running.
 
Occluders are created by making a brush entity <code>[[func_occluder]]</code>. The occluder should have <code>tools\toolsoccluder</code> material on the sides of the brush that need to block visibility, and <code>tools\toolsnodraw</code> on those sides of the brush which that will not block visibility. Brush sides that have the <code>toolsoccluder</code> material on unnecessarily will degrade the performance of the occluder.
 
A note of caution -- similar to areaportals, overuse of occluders can decrease performance. Each occluder that is placed should be checked to make sure that it actually hides enough geometry in the map. If the occluder blocks the visibility of more than a few expensive models, it should be effective in increasing performance. If not, the occluder itself may be more expensive that the geometry it hides. To determine whether the occluders are helping or hurting performance, you can <code>bindtoggle</code> a key to the console variable <code>[[r_occlusion]]</code>, which toggles the occlusion system on and off (for example, typing <code>"bindtoggle o r_occlusion"</code> at the developer console will do this). Then check the framerate (which can be done by typing <code>"[[cl_showfps]] 2"</code> at the console) while toggling the occlusion system on and off with the key you bound.
 
See <code>[[func_occluder]]</code> in the entity documentation for more details on this entity.
 
See <code>sourcesdk_content\hl2\mapsrc\sdk_occluder.vmf</code> for examples of a <code>[[func_occluder]]</code> is constructed.
 
== Geometry construction techniques ==
The methods used to construct brush geometry can also have an effect on performance. The main goal in creating efficient geometry in Hammer is to create as few polygons 'splits' as possible. One effective technique is to use the 2D grid for alignment whenever possible. Extra splits are created when geometry does not line up evenly, creating additional places where <code>vbsp</code> has to cut up the surfaces to render properly. If the brushes are aligned evenly to the grid, there will be a fewer number of cuts. Having fewer brushes rotated on angles will also decrease the number of splits necessary.
 
It is also worth noting that <code>vbsp</code> automatically splits geometry ever 1024 units of world coordinates. Extra splits can be avoided if brushes terminate evenly at a 1024 grid line. In Hammer, go to the '''Options''' dialog under the '''Tools''' menu. In the '''2D Views''' tab, choose '''Highlight every 1024 units'''. Enabling this will display red shaded grid lines in 1024 increments in the Hammer 2D views. You should not go "out of your way" to create geometry along these grid lines, but if you have a choice of building something at 1024 units instead of 1025, build it at 1024.
 
The next section discusses detail brushes, which are another valuable tool to eliminate unnecessary <code>vbsp</code> splits.
 
=== Detail brushes ===
 
Detail brushes are a class of brushes that are grouped to avoid unwanted face splits when small, detailed brush objects meet large surfaces. Detail brush geometry is made by creating a [[func_detail]] entity out of a set of brushes. The brushes that are included in the <code>func_detail</code> will not clip (or split) non-detail brushes. A common example is a cylinder brush (such as a pillar) touching a floor in a room. Normally the cylinder would split the floor face into many smaller faces where the two brushes meet. By making the cylinder detail geometry, no such splitting will occur. Any rotated piece of brush geometry is also a good candidate, and will cause fewer [[vbsp|VBSP]] splits if it is made into <code>func_detail</code>.
 
Detail brushes do not block visibility and cannot be used to seal the world or areaportals. Since they do not block visibility, detail brushes have a side benefit of simplifying the visibility set. Proper use of detail brushes can greatly decrease the time it takes for [[Vvis|VVIS]] to compile the level.
 
Brushes that are <code>func_detail</code> are an entity in the Hammer editor, but the entity information is discarded after the map is processed in VBSP. This occurs to reduce the memory requirements of the geometry. The entity information is no longer needed once VBSP has used it for reducing splits. In the engine, surfaces that were created with detail geometry are identical to all other solid brush geometry in the level.
 
Objects that are small, complex, and/or do not seal areas are good candidates for detail geometry. Examples include pillars, gates, small rocks, fences, debris, piers, etc. A good way to tell if you need to switch non-detail geometry to detail geometry is to use [[glview]]. In places where you see a high density of leaves in glview, you'll want to switch some of the geometry in those areas to <code>func_detail</code>.
 
See [[func_detail]] for more information.
 
See the example file <code>sourcesdk_content\hl2\mapsrc\sdk_func_detail.vmf</code> for an example of how detail geometry can be used to reduce face splits.
 
=== Model vs. brush geometry ===
In general, brushes comprise the biggest chunk of the level and are used for terrain and very large and coarse objects.  Brushes block visibility and are useful for such things as walls, terrain and hillsides (or anything else that occludes large portions of the screen).  Big objects like bridges should be made from brushes as the use of lightmaps allows them to look much better than a single very large model.
 
The downside to brushes, and the reason you do not want to use them all the time, is that they hit performance because they consume more memory than props, are always drawn and cut the BSP making it less efficient.  Brushes also cannot be put into hierarchies like props can.
 
Brushes should be used for the following:
 
* Terrain
* Hillsides/natural walls
* Walls
* Building cores (use props to decorate them with windows, etc.)
* Large structures such as bridges where lighting accuracy and visibility blocking are important
* Objects that will have limited uses in a level – performance hit is taken for every brush in the world.
 
Whenever possible, model mesh geometry (created in software such as Softimage|XSI) should be used instead of brush geometry created in Hammer. Model geometry, or '[[Prop Types |props]]', render faster due to the batching capabilities of the engine. They also have lower memory requirements and benefit from [[LOD Models | multiple levels of detail]] to decrease the amount of geometry rendered. Models are made up of arbitrary sets of triangles, so they have fewer shape restrictions than brush geometry. Level designers can use any of the large numbers of model props that are available in the game directory to populate their levels.
 
Model geometry does <i>not block visibility</i> and cannot be used to seal the world or areaportals. Additionally, although models have the ability to cast shadows, they do not use lightmaps for shadows cast upon them like brushes do. They use a simpler vertex-based lighting model for increased speed.
 
Objects that are small, complicated, and do not seal areas are good candidates for model prop geometry. Examples include furniture, light fixtures, junk, equipment, pipes, vehicles, gutters and other building details, etc.
 
Props should be used for the following:
 
* Smaller objects in the world (pop cans, furniture, computer equipment, doors etc.).
* Larger objects that require higher levels of detail – consider placing brushes inside the props to solve visibility/performance issues (brush should be a similar but smaller outline of static prop).
* Anything that needs to move or be physically simulated (i.e. picked up, thrown, bumped etc).
* Non-collidable organics like foliage (grass, plants etc.).
* Objects that will appear many times in the level.
 
[[Prop Types Overview]] explains the different varieties of model prop entities in the Source engine.
 
== Glview ==
To use <code>glview</code>, first build the map by typing <code>"%sourcesdk%\bin\vbsp -glview <map name>"</code> on the command-line (dos command screen). This will run vbsp to generate a <code>.gl</code> file for your map. Next, type <code>"%sourcesdk%\bin\glview -portals <map name>.gl"</code> on the command-line, which brings up the glview application that visualizes all leaves in the map. You can now fly around using the <code>W, S, A</code> and <code>D</code> keys and view the leaves in the map.
 
Alternatively, you may start <code>glview</code> from Hammer:
Go into [[expert compile mode]] and enter these settings to make glview show you how your map is divided into [[visleafs]]
 
executable 1: <code>$bsp_exe</code><br>
parameters: <code>-glview $path\$file</code><br>
executable 2: <code><steamdirectory>\sourcesdk\bin\glview.exe</code><br>
parameters: <code>-portals $path\$file.gl</code>
 
Just make a new configuration for glview, so you can just use this alternative if you want to use glview.
 
== Geometry fade distances ==
Model props have minimum and maximum fade distances that can be set in their entity properties. This allows the level designer to set distances or screen area when the prop will fade out to help increase performance. On machines running DirectX level 7 or lower, the props will fade earlier than the values set in the entity to further improve rendering speed. This can be controlled on a per-MOD basis by creating a <code>dxsupport.cfg</code> file for your mod and specifying the values for the console variables <code>cl_detaildist</code> and <code>cl_detailfade</code> for the various dx support levels.
 
See <code>[[prop_static]], [[prop_dynamic]], or [[prop_physics]]</code> in the entity documentation for more details on how to set fade parameters.
 
== Clip and fog distance ==
Use of distance clipping can decrease the number of visible objects and improve rendering speed. Level designers can control the distance at which objects are 'clipped' or not drawn. Visible fog can be enabled to help hide the edge of the clipping. Fog and Far Z clip distances are set by including a <code>[[env_fog_controller]]</code> entity in your map.
 
See <code>[[env_fog_controller]]</code> in the entity documentation for more details on how to set the fog and clip distances.
 
== Material choices and rendering performance ==
When working with materials, there are a couple performance bottlenecks to keep in mind: fillrate (which usually affects all DirectX levels), and reducing vertex processing (which only is a bottleneck on DirectX7). As a level designer, the only real choice that you've got to combat any of these performance bottlenecks is to either reduce the amount of a particular expensive material on screen, or to turn off some of the expensive features in the material (like bumpmapping, for example). Note that you can make different choices about which features to use at each separate DirectX support level.
 
One other important aspect of dealing with performance bottlenecks is that you're going to have to measure framerates to see how well you're doing. For Half-Life 2, we used 3 target machines (determined based on looking at our hardware survey stats) for measuring performance at various DirectX levels. These were:
 
{|
!DX (DirectX) Level || Minimum Platform
|-
| DX9 || ATI 9800, 1 GB, P4 3.0 GHz
|-
| DX8 || NVidia GeForce4 Ti4600, 512 MB, P4 2.0 GHz
|-
| DX7 || NVidia GeForce2 MX, 256MB, P4 1.2 GHz
|}
 
Here's how you specify different material parameters for different DX support levels: Each shader has a specific fallback shader it uses if the shader determines it can't run on the particular DX level on the card currently being run. Within the definition of your material, you add a field with the same name as the fallback shader and a sub-block of fields which are the values of those fields that you want to use if that fallback shader is being used. A list of the most commonly used shaders and their fallback shaders is shown below.
 
Here's an example:
 
"LightmappedGeneric"
{
"$basetexture" "Metal/metalwall063a"
"$surfaceprop" "metal"
"$envmap" "env_cubemap"
"LightmappedGeneric_DX9"
{
"$bumpmap" "metal/metalwall063a_normal"
"$normalmapalphaenvmapmask" 1
}
"LightmappedGeneric_DX8"
{
"$basetexture" "metal/citadel_metalwall063a"
"$basealphaenvmapmask" 1
}
"LightmappedGeneric_DX6"
{
"$fallbackmaterial" "metal/metalwall063b"
}
}
 
In this example, the <code>$envmap</code> field is used no matter what DirectX level the game is being run at. The <code>$basetexture</code> field <code>metal/metalwall063a</code> is used for every fallback shader except <code>LightmappedGeneric_dx8</code> (used for running under DX8), which uses <code>metal/citadel_metalwall063a</code> for its <code>$basetexture.</code> Also under DX8 only, we add a field specifying that the special base texture used by dx8 has an envmap mask in its alpha channel. When using the <code>LightmappedGeneric_DX9</code> shader (used by DX9), we add a bumpmap and specify that the envmap mask is in the alpha channel of the bumpmap. Note that it's also possible to cause the material system to use a completely different material with a totally different set of shaders by specifying a <code>$fallbackmaterial</code> in a fallback block, which is done in this example when falling back to the <code>LightmappedGeneric_DX6</code> shader (used by DX7 and DX6).
 
For a listing of all of the fallback shaders used in Half-Life 2, see the document [[Half-Life 2 Shader Fallbacks]].
 
=== Water ===
There are a couple of tricks to use to get performance back on levels that have water in them. Water is a pretty expensive shader, and you oftentimes can be fillrate bound when you use it. This can often be seen by typing <code>+showbudget</code> at the developer console: if the '''Swap Buffers''' bar is very high, you're likely running into a fill rate problem. To reduce this problem, make sure to cut the water brushes to eliminate parts that lie within other brushes or displacements.
 
Another performance problem is that any object that is partially inside and partially outside of the water is rendered twice: once for the refraction, and once for the part of the scene that lies on the same side of the water plane as the player. You can see which objects are being rendered into the refraction by typing <code>mat_showwatertextures 1</code> in the developer console. Also typing <code>mat_wireframe 1</code> in the console can help to highlight the problem areas. Try moving any <code>prop_static</code> so they don't touch the water, and cut your water brushes so as few as possible models actually cross the water plane.
 
== Dealing with fillrate issues ==
The materials which are most expensive from a fillrate perspective are the water and refract shaders, and any material which uses bumpmaps. The way you can tell you've got a fillrate problem if you see a big bar for swapbuffers when using <code>+showbudget</code>. We'll talk here about solutions for a couple of the most common offenders for fillrate: refraction, water, and bumpmapped shaders.
 
For refractive shaders, the only real thing you can do is to use the <code>$fallbackmaterial</code> to make the shader not be refractive at the DX level where it's causing you fillrate issues. For water shaders, the fillrate cost of these shaders goes up when using refraction and reflection. You can turn both off by specifying <code>$forcecheap 1</code> in the .VMT. You can also disable refraction by <i>not</i> specifying a <code>$refracttexture</code> in the .VMT, and you can disable reflection by not specifying a <code>$reflecttexture</code>. If you've got fillrate and CPU to burn, you can forcibly make the water do local reflections (regardless of video config settings) by specifying <code>$forceexpensive 1</code>, and you can forcibly make the water reflect entities by specifying <code>$reflectentities 1</code>.
 
For bumpmapping, usually the shader that's the fillrate offender is <code>LightmappedGeneric</code>. There are a couple things you can do to improve performance. Specifying <code>$nodiffusebumplighting 1</code> turns off diffuse bumpmapping, but specular bumpmapping still is active. Turning off specular bumpmapping will also improve performance, although there is a pretty big visual quality hit you take for turning it off. One feature we added to <code>LightmappedGeneric</code> to help turn off bumpmapping on those DX8 cards that just weren't up to snuff was by introducing a fallback called <code>LightmappedGeneric_NoBump_dx8</code>. This fallback is automatically used on DX8 machines which are specified as using <code>mat_reducefillrate 1</code> in the dxsupport.cfg file. In some materials used by the Citadel in Half-Life 2, we use this to allow us to specify the use of bumpmaps under dx9 and the normal dx8 path, but not under the low-fillrate DX8 path.
 
Low-end cards (DX7) also get both hosed from a fill-rate perspective and also from a vertex processing perspective by using unbumped specularity. As a result, by default, specularity is turned off on DX7 cards. To reactivate specularity for these materials under DX7, add <code>$multipass 1</code> to the .VMT. The <code>LightmappedGeneric_dx6, VertexLitGeneric_dx6, VertexLitGeneric_dx7</code>, and <code>UnlitGeneric_dx6</code> shaders will all respond to this material parameter.
 
== Lightmap resolution ==
The Source engine uses lightmap data to simulate light and shadow on solid brush geometry. Increased lightmap density provides sharper cast shadows, at the cost of higher memory requirements. The density and quality of lightmaps can be altered to improve performance on a per face basis.
 
Lightmap scale settings are set using the '''Texture Application''' tool. Lightmap scale is measured in luxels per world grid unit. Lower numbers equal higher resolution. The default scale is 16 luxels per grid unit.
 
Higher resolution lightmaps increase the time it takes for <code>vrad</code> to process the level. You can help reduce <code>vrad</code> compile times and decrease memory requirements by lowering lightmap resolution on faces that don’t need a lot of shadow detail. Good candidates for higher lightmap scale values are surfaces that are completely in shadow, fully lit (with no shadows falling on them), or away from where players can get near them.
 
See [[Hammer Face Edit Dialog#Lightmap_Scale |Texture Application]] tool in the Hammer documentation for more detail on how to set lightmap scale.
 
See <code>sourcesdk_content\hl2\mapsrc\sdk_lightmaps.vmf</code> for examples of different lightmap scale values.
 
== Sample maps referenced in this document ==
* <code>sourcesdk_content\hl2\mapsrc\sdk_func_detail.vmf</code>
* <code>sourcesdk_content\hl2\mapsrc\sdk_hints.vmf</code>
* <code>sourcesdk_content\hl2\mapsrc\sdk_occluders.vmf</code>
* <code>sourcesdk_content\hl2\mapsrc\sdk_prop_types.vmf</code>
* <code>sourcesdk_content\hl2\mapsrc\sdk_lightmaps.vmf</code>
 
[[Category:Level Design]]

Latest revision as of 12:10, 30 August 2023

Redirect to:

Retrieved from "https://developer.valvesoftware.com/w/index.php?title=Controlling_Geometry_Visibility_and_Compile_Times&oldid=344007"