Quick Start - Sprite Sheet

This is the fastest and easiest way to use Lip Sync

⚡ Quick Start: Spritesheet

This guide will help you set up your first lip sync animation using a sprite sheet.

Sprite sheet mode is ideal for stylized 3D models using projected textures. It's fast, simple, and works great for quick results.

---

🎨 What You Need

• A character with at least one visible face

• A sprite sheet containing various mouth shapes (visemes).

• An audio file (e.g., .wav, .mp3, .mp4, etc.)

Make sure your sprite sheet uses evenly spaced frames.

For your convenience, Lip Sync is shipped with a free Sprite Sheet, to use in your projects, free and/or commercial.

---

🪄 Step-by-Step Guide

1. Configure Language

• In the Lip Sync panel, select your Language Model

Lip Sync works with ~25 languages

Lip Sync will download your Language Model and store it in cache so you won't have to download it again.

Models are downloaded from https://alphacephei.com/vosk/models. Only small sized models are downloaded.

2. Add Lip Sync to your Model

• Click on Add Lip Sync

3. Set Up Animation type

Default settings are great for quick prototyping

• Ensure that Animation Type is set to Sprite Sheet

Place Mouth

Select Faces for where you want to insert your Mouth

You have to define where the Mouth should appear on your character.

3D Model has to have its Rotation & Scale applied!

• Go to Edit Mode

• Select one or more Faces

• Click on Set Mouth Area

Sprite Sheet Settings

If you only want to use the default sprite sheet, you can skip this part

You can create and use your own Sprite Sheet!

You just have to create a Sprite Sheet with evenly spaced frames, and configure Lip Sync accordingly.

Here is another squared Sprite Sheet (not shipped with the add-on)

Settings	Description	Info
Sprite Sheet Format	Square: Sprite Sheet forms a perfect square, like 512px x 512px Rectangle: Sprite sheet has non-equal number of rows and columns Vertical Line: Sprite Sheet has 1 column and x rows Horizontal Line: Sprite Sheet has 1 row and x columns
Rows	How many "lines" there is in Sprite Sheet.	For Square you just have to define Rows and Columns will be automatically set at the same value .
Columns	How many "Columns" there is in Sprite Sheet.
Sprite Index	Index of frame	Index always start at the bottom-left corner. Index always start from 0. So if you have 10 frames, index goes from 0 to 9.
Scale Sprite	Use this to scale your Sprite until you only see one frame.	Basically this scales the image without scaling the mask around it.
Scale Main	Use this to scale the mouth.	Scales the image + the mask to control how big mouth should be.

Lip Sync automates Sprite Sheet clipping by using these settings.

Always ensure that your Sprite Sheet settings and resolution are correct.

Visemes Settings

If you only want to use the default sprite sheet, you can skip this part

You can customize frames to visemes mapping.

By default, Lip Sync is configured to work with default Sprite Sheet. You can change these values to match your own sprite sheet.

Just indicate which frame index corresponds to which viseme. Same index can be used on different visemes.

Always remember:

• Index always start at the bottom-left corner of your Sprite Sheet.

• Index always start from 0. So if you have 10 frames, index goes from 0 to 9.

Viseme configuration in mandatory

Animation Settings

Animation settings enable you to fine tune how Keyframes are inserting.

Fine tune your animation

Settings	Description	Infos
In between	Minimum Threshold between two keyframes. If a keyframe should be inserted before, it will be ignored. e.g: 417ms means that next keyframe will be at least at 417ms from the previous one.	Decreasing this value will ensure you to animate all phonemes but may result in jerky motion. Increasing this value will give a smoother motion but sync will be less precise.
Silence	Time to have between two words to be considered as a "Silence".	Too short value will force you character to close their mouth very often. Too high value will force your character to keep mouth open between two words.

Timing is very important and need to respect this constraint:

• Silence should always be greater than In between

Add Audio Source

Adding a media file is mandatory to detect Audio

• Add a Video Sequencer Editor

• Drag & Drop (or Add) your media file

You should only have one enabled media File. Otherwise speech recognition may product unexpected results.

Baking

Press Bake Audio and wait!

Lip Sync insert all required Keyframes for you

Baking will remove previously inserted keyframes on defined Shape Keys.

Lip Sync will Bake the entirety of your project's Frame Range.

For Sprite Sheet, Keyframes use a Constant Interpolation

Lip Sync works with all Frame Rates (24 fps, 30 fps, 60 fps, etc..)

Now your character is talking! 🎬

---

🔧 Tips

• Keep your sprite sheet resolution power-of-two (e.g., 1024x128)

• Try to use an isolated dialogue

---

🎯 Next Steps

• Use your own Sprite Sheet

• Adjust Animation Settings

• Use Shape Keys Instead

---