Difference between revisions of "VertexNormal"

Revision as of 20:56, 3 November 2014

Game artists can manually alter the vertex normals to change the way an in-game mesh is lit, how it renders a reflection, how the fresnel falloff looks, etc. Basically any lighting effect that uses vertex normals can be tweaked by changing the model's vertex normals.

Some game engines do not import edited vertex normals. For example UDK has been updated to support custom vertex normals via FBX, but your game engine may not support it.

What Is a Vertex Normal?

See the MSDN article Face and Vertex Normal Vectors.

Model Seams

Game models are often cut apart into different segments, for example to allow a player to customize their character by swapping out different clothing models.

When a contiguous mesh is cut apart, the vertex normals along the edge usually change. Vertex normals are usually calculated automatically by the modeling software, to average out the local surface curvature. However this causes a shading seam along the cut, because the two models now have different vertex normals along their shared edge.

To help hide this artifact, the seams between the pieces are usually cut along natural seams, like the belt line, shoulders, neck, wrists. This doesn't hide all of the seams though.

Bent vertex normals can be used to hide these seams completely, by manually averaging the two models' edges together.

Foliage Shading

Foliage meshes in game are usually made using flat planes with a transparent texture containing a bunch of leaves (or grass blades). These textures are used instead of modeling each leaf or blade of grass discretely, because they would slow the framerate too much. Also the increased vertex count uses much more memory.

Flat planes generally do not shade very well when lit. To counteract this, the vertex normals can be bent to influence the shading, helping to hide the flatness of the geometry.

Create the backfacing polygons manually, before editing the vertex normals. If you let a game engine create backfaces automatically, the engine has to generate new polygons so it has to figure out where the new normals will point, resetting them all in the process. If you want to import edited vertex normals, you must explicitly create the backfaces yourself.

Foliage shading is improved by bending the vertex normals. The File:TreeMakerScript plus NormalThiefScript Max2010.zip (textures copyright SpeedTree). Image by Eric Chadwick.

A comparison of different flat geometry types, with and without bent normals. Top row uses "crossing planes", bottom row uses "tri planes". Left to right: wireframe, default normals, "global" normals using Normal Thief, and clump-based normals. Image by Eric Chadwick.

Foliage shading examples compared, with and without VertexColor. Image by Eric Chadwick.

• Vertex Normal tutorial by 'gutekfiutek'. This is a blog post in Polish that explains in pictures how vertex normals can be used for better foliage shading (translation by Google here). He used this technique to great effect in his Polished Landscapes Mod for Mount & Blade.

Note: This technique only works in a game engine that supports edited vertex normals. You have to test your asset pipeline to see.

Editing Normals in 3ds Max

Vertex normals can be manually bent in 3ds Max by using the Edit Normals modifier. See the 3ds Max 2011 online help.

Edited vertex normals are somewhat fragile in 3ds Max, they can be lost easily:

• If you take an Editable Mesh model, activate Attach, and try to attach an Editable Poly to it, the vertex normals of the Poly model will be reset. However using Attach in an Editable Poly model will work fine.
• If you Attach multiple meshes together, make sure each has at least one edited normal. Meshes without edited normals will have their vertex normals jumbled.
• If you Attach models that have been rotated, make sure to use Reset Xforms on them first. Attaching a rotated model to another will skew all its edited normals.
• If you use Detach to make a new object, the detached object's vertex normals will be reset.
• If you use Detach to create a new element in the same object, the detached element's vertex normals will be reset.

Vertex normals can also be modified by using Smoothing Groups, as long as the normals have not been edited by the Edit Normals modifier beforehand. See the tutorial [[../3DTutorials/Smoothing Groups in 3DSMax|Smoothing Groups in 3ds Max]] by Ben 'poopinmymouth' Mathis.

Slide Normal Thief MAXScript

SlideNormalThief by the studio Slide London is a 3ds Max MAXScript tool that projects vertex normals from one model to another, automating what would otherwise be a tedious manual process.

Interface for the SlideNormalThief MAXScript. Script by Slide London.

The script is based on a much-slower script called NormalThief.ms written by Mauricio B. Gehling.

The Reference Object is the model you wish to copy vertex normals from, and the Target Object is the model that will get its normals bent to match. The two models should be superimposed on one another, the normals on the Target will be bent to match the nearest normals on the Reference. This is similar to the way NormalMap projection works, the copying is based off location in 3D space. The vertex counts of the two models don't need to match, but both models need to have an Edit Normals modifier applied.

AverageNormal MAXScript

File:AverageNormal.mcr.zip by Mathieu 'zOffTy' Jacquin is a 3ds Max MAXScript tool that averages all the vertex normals for the selected faces, so they all point the same direction.

GetVertNormalsFromFace MAXScript

File:GetVertNormalsFromFace 0 2.ms.zip by Enrico 'SyncViewS' Gullotti is a 3ds Max MAXScript tool that aligns all the vertex normals for the selected faces so they point perpendicular to their polygons. In other words, the same direction as the face normal would be facing. This is similar to the mig Normal Tools option "Fillet Outside".

Once installed the script will be under the category Normal Tools, named Get Vert Normals from Faces. It works on Editable Poly objects only, and that must be the active modifier in the modifier stack. If an Edit Normals Modifier is not present, the script will add one right above Editable Poly. It should not mess with Smoothing Groups at all.

Go into Face sub-object level, make a face selection and run the script. Every time a normal is modified by the script, it is made Explicit to retain the modifications. At the end the script will switch back to the base Editable Poly modifier and re-enter Face sub-object level (even if other modifiers are present in the stack). If you want to revert back to the original default normals, add an Edit Normals Modifier and reset the normals.

See the Polycount forum thread Editing vertex normals in Max, got scripts?.

Exporting Edited Normals

Edited vertex normals can be exported from 3ds Max with some file formats:

Editing Normals in Maya

Vertex normals can be adjusted in Maya by using the Normals tools in the Polygons menu (Maya 2011 online help).

Vertex normals can also be baked from one model to another by using Transfer Attributes.

"Transfer Attributes" in Maya can be used to copy vertex normals from a dome to a tree. Select the dome, then the tree, then choose Mesh > Transfer Attributes, and enable only Vertex Normals. Image by 'callebo'.

mig Normal Tools

The mig Normal Tools is a collection of MEL scripts for editing vertex normals in Maya.

Interface for the mig Normals Tools MEL scripts. Scripts by Migugi.

FaceNRMtoVert

"passerby" wrote a melscript that does a similar function as the GetVertNormalsFromFace maxscript.

#!highlight csharp
global proc FaceNRMtoVert() {


    string $Fs[] = `filterExpand -sm 34`;
    select -cl;
    for ($F in $Fs) {
        select -r $F;
        string $normals[] = `polyInfo -faceNormals`;
        string $buffer[];
        tokenize $normals[0] $buffer;
        
        float $plane[3];
        $plane[0] = $buffer[2];
        $plane[1] = $buffer[3];
        $plane[2] = $buffer[4];  
        PolySelectConvert 3;
        polyNormalPerVertex -xyz $plane[0] $plane[1] $plane[2];
        }
}

For more info see the Polycount forum thread GetVertNormalsFromFace script for maya.

Editing Normals in Modo

Baking normals in modo, using the pipelineIO plugin. Image by Ariel Chai.

Normal Mapping

Vertex normals have a strong influence on tangent-space normal maps. Some game engines require a bit more geometry near areas that have a lot of change in angle (hard corners, etc.) otherwise the vertex normals fight with the normal map and create shading errors. Careful topology can minimize or avoid these errors altogether.