Kim, Ig-Jae Ko, Hyeong-Seok 2024-01-21T00:32:49Z 2024-01-21T00:32:49Z 2021-09-05 2007-09 0167-7055 https://pubs.kist.re.kr/handle/201004/134141 This paper proposes a new technique for generating three-dimensional speech animation. The proposed technique takes advantage of both data-driven and machine learning approaches. It seeks to utilize the most relevant part of the captured utterances for the synthesis of input phoneme sequences. If highly relevant data are missing or lacking, then it utilizes less relevant (but more abundant) data and relies more heavily on machine learning for the lip-synch generation. This hybrid approach produces results that are more faithful to real data than conventional machine learning approaches, while being better able to handle incompleteness or redundancy in the database than conventional data-driven approaches. Experimental results, obtained by applying the proposed technique to the utterance of various words and phrases, show that (1) the proposed technique generates lip-synchs of different qualities depending on the availability of the data, and (2) the new technique produces more realistic results than conventional machine learning approaches. English WILEY 3D lip-synch generation with data-faithful machine learning Article 10.1111/j.1467-8659.2007.01051.x 1 COMPUTER GRAPHICS FORUM, v.26, no.3, pp.295 - 301 COMPUTER GRAPHICS FORUM 26 3 295 301 scie scopus 000249660500010 2-s2.0-35348984054 Computer Science, Software Engineering Computer Science Article; Proceedings Paper speech animation lip synch facial animation