Skip to content

Blender Rhubarb Lipsync is an addon for Blender integrating Rhubarb Lip Sync to automatically generate mouth-shape keyframes from a pose library.

Notifications You must be signed in to change notification settings

infinitespace-studios/blender-rhubarb-lipsync

 
 

Repository files navigation

Blender Rhubarb Lip Sync

Blender Rhubarb Lipsync is an addon for Blender integrating Rhubarb Lip Sync to automatically generate mouth-shape keyframes from a pose library.

Rhubarb Lip Sync is a command-line tool that automatically creates mouth animation from voice recordings. You can use it for characters in computer games, in animated cartoons, or in any other project that requires animating mouths based on existing recordings.

Example output

Example video

http://www.youtube.com/watch?v=azrpByrvw-o

and here's a tutorial video from Studio YogYog

Tutorial video

https://youtu.be/xfI94VIX6BA

Usage

Download a release from https://github.com/scaredyfish/blender-rhubarb-lipsync/releases

Use version 1.0.5 for Blender 2.79, version 2.0 onwards supports only Blender 2.80.

First, set the path to the Rhubarb Lipsync executable in user preferences (download from https://github.com/DanielSWolf/rhubarb-lip-sync)

You can also set the recognizer here. PocketSphinx is recommended for English language, phonetic may give better results for other languages.

Preferences

Create a pose library with the mouth shapes described in the Rhubarb Lip Sync documentation. You can name your poses whatever you like.

Pose library

Match your poses with the Rhubarb Lip Sync names. Select your sound file, and dialog file (optional), and the start frame where your sound begins.

Options panel

In pose mode, select the bones you want to keyframe, then click the Rhubarb Lip Sync button and wait for the process to complete. There is no progress indicator yet, but your keyframes will appear when the process is complete.

Troubleshooting

In the event of problems, you can use the system console (Window->Toggle System Console on Windows, or start Blender from a command line on Mac/Linux) to get more info on progress and error messages.

About

Blender Rhubarb Lipsync is an addon for Blender integrating Rhubarb Lip Sync to automatically generate mouth-shape keyframes from a pose library.

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 100.0%