Quick Start - Sprite Sheet
This is the fastest and easiest way to use Lip Sync
Last updated
This is the fastest and easiest way to use Lip Sync
Last updated
This guide will help you set up your first lip sync animation using a sprite sheet.
Sprite sheet mode is ideal for stylized 3D models using projected textures. It's fast, simple, and works great for quick results.
A character with at least one visible face
A sprite sheet containing various mouth shapes (visemes).
An audio file (e.g., .wav, .mp3, .mp4, etc.)
Make sure your sprite sheet uses evenly spaced frames.
For your convenience, Lip Sync is shipped with a free Sprite Sheet, to use in your projects, free and/or commercial.
In the Lip Sync panel, select your Language Model
Click on Add Lip Sync
Ensure that Animation Type is set to Sprite Sheet
You have to define where the Mouth should appear on your character.
3D Model has to have its Rotation & Scale applied!
Go to Edit Mode
Select one or more Faces
Click on Set Mouth Area
You can create and use your own Sprite Sheet!
You just have to create a Sprite Sheet with evenly spaced frames, and configure Lip Sync accordingly.
Sprite Sheet Format
Square: Sprite Sheet forms a perfect square, like 512px x 512px
Rectangle: Sprite sheet has non-equal number of rows and columns
Vertical Line: Sprite Sheet has 1 column and x rows
Horizontal Line: Sprite Sheet has 1 row and x columns
Rows
How many "lines" there is in Sprite Sheet.
For Square you just have to define Rows and Columns will be automatically set at the same value .
Columns
How many "Columns" there is in Sprite Sheet.
Sprite Index
Index of frame
Index always start at the bottom-left corner. Index always start from 0. So if you have 10 frames, index goes from 0 to 9.
Scale Sprite
Use this to scale your Sprite until you only see one frame.
Basically this scales the image without scaling the mask around it.
Scale Main
Use this to scale the mouth.
Scales the image + the mask to control how big mouth should be.
You can customize frames to visemes mapping.
By default, Lip Sync is configured to work with default Sprite Sheet. You can change these values to match your own sprite sheet.
Just indicate which frame index corresponds to which viseme. Same index can be used on different visemes.
Always remember:
Index always start at the bottom-left corner of your Sprite Sheet.
Index always start from 0. So if you have 10 frames, index goes from 0 to 9.
Animation settings enable you to fine tune how Keyframes are inserting.
In between
Minimum Threshold between two keyframes.
If a keyframe should be inserted before, it will be ignored.
e.g: 417ms means that next keyframe will be at least at 417ms from the previous one.
Decreasing this value will ensure you to animate all phonemes but may result in jerky motion.
Increasing this value will give a smoother motion but sync will be less precise.
Silence
Time to have between two words to be considered as a "Silence".
Too short value will force you character to close their mouth very often. Too high value will force your character to keep mouth open between two words.
Timing is very important and need to respect this constraint:
Silence should always be greater than In between
Add a Video Sequencer Editor
Drag & Drop (or Add) your media file
Press Bake Audio and wait!
Baking will remove previously inserted keyframes on defined Shape Keys.
Lip Sync works with all Frame Rates (24 fps, 30 fps, 60 fps, etc..)
Now your character is talking! 🎬
Keep your sprite sheet resolution power-of-two (e.g., 1024x128)
Try to use an isolated dialogue
Use your own Sprite Sheet
Adjust Animation Settings
Use Shape Keys Instead
