CompuServe Thread

#Lip Sync Software

3 messages in this thread
#183844From: Duane PowellAug 7, 1995 10:29 AM
I'm animating a head in 3DS and need a easy way to lip sync with audio. Does anyone know of software to coordinate keyframes with a .wav files?
#183878From: MARTIN G FOSTERAug 7, 1995 4:16 PM
Duane, PMJI, Danny Mercurio wrote some software for this type of thing. Although it wasn't specificly for speech. Also, I don't think he ever released anything. I think he's looking for some funding to continue that project. You might contact him and ask, although he's at Siggraph right now and might not be on-line for a while. His CIS ID# is 74551,360 and he is a forum regular. Martin
#183889From: Martin ThorpeAug 7, 1995 6:39 PM
Duane, The way I do this is to map the .wav file sine waves to timecode. Then I make the mouth of whatever I'm animating into an element of the head object. There are only about 6 mouth shapes, basically aaa,eee,iiiii,oooo,uuuuu and closed positions. Just copy the head object and reshape the mouth element on each one to the six sounds. Then just map the mouth movements to the appropriate timecode keyframes by morphing to the desired shape.eg say at 00:00:00 the mouth is closed. eg object name MOUTHCL and at 00:00:05 the mouth is saying the eee of "me" so morph to MOUTHEE which has a wide eee shaped mouth This works surprisingly well and because when shaping the mouth element on different vowels you can include surrounding vertices as you scale and pucker the mouth you can get the whole skin around the mouth to move realistically…….Regards…..Martin