No description available.

In this thesis, 3D animation of human facial expressions and lip motion and their synchronization with a Turkish Speech engine using JAVA programming language, JAVA3D API and Java Speech API, is analyzed. A three-dimensional animation model for simulating Turkish lip motion and facial expressions is developed. In addition to lip motion, synchronization with a Turkish speech engine is achieved. The output of the study is facial expressions and Turkish lip motion synchronized with Turkish speech, where the input is Turkish text in Java Speech Markup Language (JSML) format, also indicating expressions. Unlike many other languages, in Turkish, words are easily broken up into syllables. This property of Turkish Language lets us use a simple method to map letters to Turkish visual phonemes. In this method, totally 37 face models are used to represent the Turkish visual phonemes and these letters are mapped to 3D facial models considering the syllable structures. The animation is created using JAVA3D API. 3D facial models corresponding to different lip positions of the same person are morphed to each other to construct the animation. Moreover, simulations of human facial expressions of emotions are created within the animation. Expression weight parameter, which states the weight of the given expression, is introduced. The synchronization of lip motion with Turkish speech is achieved via CloudGarden&reg / &rsquo / s Java Speech API interface. As a final point a virtual Turkish speaker with facial expression of emotions is created for JAVA3D animation.

Orientador: Prof. Dr. Celso Setsuo Kurashima / Dissertação (mestrado) - Universidade Federal do ABC, Programa de Pós-Graduação em Engenharia da Informação, 2016. / Os computadores pessoais possuem um papel importante na vida das pessoas, para auxílio em suas tarefas cotidianas como trabalho, entretenimento, e comunicação. Na comunicação, os computadores pessoais podem ser utilizados para chamadas de teleconferência, recebendo e transmitindo imagens e áudio entre longas distâncias. Para adicionar imersão na experiência de teleconferência, e permitir a escolha do ponto de visão por parte do usuário, uma teleconferência tridimensional com ponto de visão livre pode ser realizada, se modelos faciais tridimensionais forem criados a partir de imagens. Essa dissertação apresenta a investigação de métodos de geração de Malha Poligonal a partir de informações 3D extraídas de imagens, para aplicação em sistemas de teleconferências imersivas com ponto de visão livre. Um método de geração de Malha Poligonal chamado Quad Grid foi proposto para permitir a modelagem facial 3D em tempo real. As malhas poligonais das faces foram analisadas em experimentos objetivos e subjetivos. Os experimentos mostraram que o método Quad Grid teve resultado satisfatório e é um método rápido para a reconstrução facial 3D com malha poligonal. O software prova de conceito dessa dissertação resultou em um sistema de teleconferência 3D com ponto de visão livre. / The personal computers have an important role in the people lives to help in their daily tasks such as work, entertainment, and communication. With regard to the communication, the personal computer may be used for conference calls, receiving and transmitting images and audio between long distances. To add immersion inside the teleconferencing experience and allow the choice of viewing point by the user, a three-dimensional teleconference with free view point can be performed if three-dimensional facial models are created from images. This paper presents the research methods of generating polygonal mesh from 3D information extracted from images, for use in immersive conference calls systems with free view point. A method of generating polygonal mesh called Quad Grid has been proposed to allow the 3D face modeling in real time. The polygonal mesh of the faces were analyzed in objective and subjective experiments. The experiments showed that the Quad Grid method was satisfactory and is a fast method for 3D facial reconstruction with polygonal mesh. The proof of concept software of this Master Thesis resulted in a 3D teleconferencing system with free view point.