We present a system which consists of a lifelike agent animated in real-time using video and audio analysis from the user. This kind of system could be used for Instant Messaging where an avatar controlled like a puppet is displayed instead of the webcam flow. The overall system is made of video analysis based on Active Appearance Models and audio analysis based on Hidden Markov Model.
The parameters from these two modules are sent to a control system driving the animation engine. The video analysis extracts the head orientation and the audio analysis provides the phonetic string used to move the lips. This is a preview of subscription content, log in via an institution to check access.
Institutional subscriptions. Cootes, T. In: Burkhardt, H. ECCV LNCS, vol. Chapter Google Scholar. Le Gallou, S. Google Scholar. Breton, G. In: Web3D Symposium, Paderborn. Germany In: Proceedings of the 11th international conference on intelligent user interfaces, Sydney, Australia Cohen, M.
Models and Techniques in Computer Animation. Springer, Heidelberg Download references. You can also search for this author in PubMed Google Scholar. Reprints and permissions.
In: Pelachaud, C. IVA Lecture Notes in Computer Science , vol Springer, Berlin, Heidelberg. Publisher Name : Springer, Berlin, Heidelberg. Print ISBN : Online ISBN : Anyone you share the following link with will be able to read this content:. Sorry, a shareable link is not currently available for this article. Provided by the Springer Nature SharedIt content-sharing initiative. Policies and ethics.
