Speech driven facial animation using HMMs in Basque

  • Maider Lehr*
  • , Andoni Arruti
  • , Amalia Ortiz
  • , David Oyarzun
  • , Michael Obach
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Citations (Scopus)

Abstract

Nowadays, the presence of virtual characters is less and less surprising in daily life. However, there is a lack of resources and tools available in the area of visual speech technologies for minority languages. In this paper we present an application to animate in real time virtual characters from live speech in Basque. To get a realistic face animation, the lips must be synchronized with the audio. To accomplish this, we have compared different methods for obtaining the final visemes through HMM based speech recognition techniques. Finally, the implementation of a real prototype has proven the feasibility to obtain a quite natural animation in real time with a minimum amount of training data.

Original languageEnglish
Title of host publicationText, Speech and Dialogue - 9th International Conference, TSD 2006, Proceedings
PublisherSpringer Verlag
Pages415-422
Number of pages8
ISBN (Print)3540390901, 9783540390909
DOIs
Publication statusPublished - 2006
Externally publishedYes
Event9th International Conference on Text, Speech and Dialogue, TSD 2006 - Brno, Czech Republic
Duration: 11 Sept 200615 Sept 2006

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4188 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference9th International Conference on Text, Speech and Dialogue, TSD 2006
Country/TerritoryCzech Republic
CityBrno
Period11/09/0615/09/06

Fingerprint

Dive into the research topics of 'Speech driven facial animation using HMMs in Basque'. Together they form a unique fingerprint.

Cite this