QuickStartLipSync

From Valve Developer Community
Jump to: navigation, search

Prelude

FacePoser is Valve Software's tool to lip-sync characters and control facial animations. The lipsyncing in FacePoser can be done automatically and quickly by the program, or manually and more time consuming by the user. The lipsyncing process is based on a set of standardized rules based on phonemes, which are how words are constructed by using individual sounds. The models in Half-Life 2 have mouth shapes for each of these sounds, so by combining these shapes, realistic lipsyncing can be created.

More information on phonemes can be found here.

Warning: In order to properly extract phonemes, you will need the Microsoft Speech SDK 5.1, which can be downloaded from the Microsoft website listed at the end. However, Vista users will be unable to use this and therefore not be able to use the automatic Phoneme extractor!

Start screen

This is the initial layout of FacePoser (minus the G-Man.) To start off, load a model from the File->Load model dialog. In this case, the G-Man was chosen.


Initialscreen (Medium).jpg


To have a character lipsync, an actual wav file is needed, along with what was said in the wav file. The dialogue of the wav file in this article is, "Rise and shine, Mr. Freeman. Rise and shine."

Phoneme Editor

Open up the "Phoneme Editor" tab. The window will show a blank slate; right click inside of that slate and select Load, then navigate to the wav file. After opening it, this will come up:


Phonemestart.jpg


Right click again and select Redo Extraction. A textbox for the speech in the wav file will pop up. Fill in the dialogue and push OK. Note that phonetically spelled words will result in better lipsynching; so "Mister" would have better results than the abbreviated word, "Mr." Words with more than three syllables should also be spelled phonetically.


Wordlist.jpg


Once the extraction is finished, the phonemes will be laid out on the wav file:


Phoenemeeditorend.jpg


(If the extraction fails or gives an unsatisfactory result, phrase the speech in a more phonetic fashion. Failing that, the phonemes can be manually placed by editing words.)

Extraction may also fail if the .wav file you loaded is not in your mod directory. Make sure the file resides in your mod directory.
For example if you installed Steam to C:\Program Files\Steam\ your mod directory would be C:\Program Files\Steam\SteamApps\SourceMods\<your mod name>\


Right click and choose, "Commit extraction." This saves the phonemes into the wav file for lip-syncing. Push Play, and the character will lipsync to the audio.

Resources