Technical Program

Paper Detail

Paper:	MMSP-P2.2
Session:	Multimedia Human-Machine Interface, Security and Systems
Time:	Wednesday, May 17, 10:00 - 12:00
Presentation:	Poster
Topic:	Multimedia Signal Processing: Multimedia human-machine interface and interaction
Title:	Parameterization of Mouth Images by LLE and PCA for Image-based Facial Animation
Authors:	Kang Liu, Axel Weissenfeld, Joern Ostermann, University of Hannover, Germany
Abstract:	This paper describes parameterization of mouth images for an image-based facial animation system. The analysis part of the facial animation system produces a face model, which is composed of a personalized mask as well as a large database of mouth images and their related phonetic and visual information. Then, a photo-realistic talking head is synthesized by rendering a personalized mask textured with a mouth image, which is selected from the database. The selection is driven by a unit selection algorithm, which finds the appropriate mouth images from the database such that they match the words spoken by the talking head. The selection of mouth images is based on parameters describing the mouth images. Therefore, the parameterization of mouth images is the key part for creating a photo-realistic facial animation. Hereby the visual parameterization of mouth images by LLE (Locally Linear Embedding) is investigated comprehensively and compared with PCA (Principal Component Analysis). Experimental results show that the parameterization of mouth images by LLE performs better for an image-based facial animation system than by PCA.