Yes / Emerging applications in surveillance, the entertainment industry and other human computer interaction applications have motivated the development of real-time facial analysis research covering detection, tracking and recognition. In this paper, the authors present a review of recent facial analysis for real-time applications, by providing an up-to-date review of research efforts in human computing techniques in the visible domain. The main goal is to provide a comprehensive reference source for researchers, regardless of specific research areas, involved in real-time facial analysis. First, the authors undertake a thorough survey and comparison in face detection techniques. In this survey, they discuss some prominent face detection methods presented in the literature. The performance of the techniques is evaluated by using benchmark databases. Subsequently, the authors provide an overview of the state-of-the-art of facial expressions analysis and the importance of psychology inherent in facial expression analysis. During the last decades, facial expressions analysis has slowly evolved into automatic facial expressions analysis due to the popularity of digital media and the maturity of computer vision. Hence, the authors review some existing automatic facial expressions analysis techniques. Finally, the authors provide an exemplar for the development of a facial analysis real-time application and propose a model for facial analysis. This review shows that facial analysis for real-time application involves multi-disciplinary aspects and it is important to take all domains into account when building a reliable system.

Emotions are thought to play a crucial role in food behavior. Non-rational emotional decision making may be credited as the reason why consumers select what, how, and when they choose to interact with a food product. In this research, three experiments were completed for the overall goal of understanding the usefulness and validity of selected emotional measurement tools, specifically emotion questionnaire ballots and facial expression analysis, as compared to conventional sensory methods in developing a holistic view of product interest and engagement. Emotional response to 1% low-fat unflavored and chocolate-flavored milk was evaluated by using an emotion-based questionnaire as well as facial expression analysis software, to measure post-experience cognitive and in-the-moment intrinsic (implicit) emotional response, respectively. The software correlated facial movements of participants to associated basic emotions to estimate with what degree consumers were expressing these measured emotions upon presentation of each sample. Finally, the adapted facial expression method was compared to expected measurements from previous studies by measuring emotional facial response to four (sweet, salt, sour, and bitter) basic tastes. The cognitive emotion ballot and implicit facial analysis were able to differentiate between milk samples and offer a greater understanding of the consumer experience. Validity of the facial expression method was lacking for reasons including high individual taste variability, social context, intensities of stimuli, quality of video data capture, calibration settings, sample size number, analysis duration, and software sensitivity limitations. To better validate automatic facial expression methodology, further study is needed to investigate and minimize method limitations. / Master of Science in Life Sciences

O objetivo do presente estudo foi avaliar subjetivamente a estética do perfil facial de 30 pacientes adultos leucodermos, com fissura transforame incisivo unilateral, não sindrômicos, de ambos os gêneros, com idades entre 17 anos e 3 meses e 30 anos e 9 meses, e média de 23 anos e 3 meses, reabilitados no Hospital de Reabilitação de Anomalias Craniofaciais (HRAC–USP). Foram obtidas 60 fotografias faciais da amostra selecionada, 30 do perfil direito e 30 do perfil esquerdo. Essas fotografias foram avaliadas subjetivamente por 25 examinadores divididos em 5 categorias de acordo com sua área de atuação profissional: 5 ortodontistas e 5 cirurgiões plásticos atuantes na reabilitação de fissuras no HRAC, 5 ortodontistas e 5 cirurgiões plásticos inexperientes na área de fissuras e 5 leigos com formação superior. Por meio de notas que variavam de 1 a 9, os perfis faciais foram classificados em 3 categorias, esteticamente desagradável (notas de 1 a 3), esteticamente aceitável (notas de 4 a 6) e esteticamente agradável (notas de 7 a 9). Os resultados mostraram que os perfis faciais dos pacientes foram classificados em esteticamente aceitáveis, com variações entre as categorias de examinadores. Os profissionais do HRAC, por conhecerem as limitações que o processo de reabilitação impõe aos indivíduos com fissuras, foram os mais condescendentes no julgamento estético. / The aim of this study was to evaluate esthetically the facial profile of 30 adult Caucasian unilateral cleft lip and palate (CLP)patients, without syndromes, of both genders, with ages ranging from 17 years 3 months to 30 years 9 months (mean age = 23 years 3 months), rehabilitated at the Hospital for Rehabilitation of Craniofacial Anomalies (HRAC–USP). Sixty profile photographs of the selected sample were taken, 30 of the right profile and 30 of the profile. These photographs were subjectively evaluated by 25 examiners divided into 5 categories according to their professional activity: 5 orthodontists and 5 plastic surgeons dealing with CLP, 5 orthodontists and 5 plastic surgeons without experience in the CLP field and 5 laymen by means of scores that ranged from 1 to 9, the facial profiles were classified into 3 categories: esthetically unpleasant (scores 1 to 3) esthetically acceptable (scores 4 to 6) and esthetically pleasant (scores 7 to 9). The findings showed that the patient’s facial profiles were classified as esthetically acceptable, with variations among the categories of examiners. The examiners of the HRAC gave the best scores in the esthetic judgement due to their Knowledge of limitations related to the rehabilitation process.

A visibilidade da etapa fértil na mulher é uma questão polêmica e tem sido muito discutida nas últimas décadas. Alguns autores argumentam que no transcorrer da evolução a ovulação ficou oculta. Em paralelo, outros pesquisadores afirmam que a ovulação na mulher não se manifesta de forma tão visível como em alguns primatas que apresentam sinais muito notórios da ovulação, por exemplo, a tumefação vaginal. Mas diversas pesquisas têm fornecido evidência que mostram que o período fértil na mulher é perceptível de maneira sutil, sem que se tenha consciência do processo perceptual envolvido. Os achados destas pesquisas apontam para o fato de diversas características (como a face, a proporção cintura quadril, a simetria de tecidos brandos pareados e o cheiro) serem percebidas como mais atraentes na etapa fértil. O presente estudo teve por objetivo investigar se em alguma etapa (folicular tardia ou lútea) do ciclo menstrual a face da mulher se torna mais atraente para o sexo oposto devido a mudanças morfológicas induzidas pelos níveis hormonais. Foram apresentados, apenas para participantes masculinos, 36 slides com fotografias de faces frontais de mulheres em idade reprodutiva. Em cada slide foram mostradas simultaneamente duas fotos da mesma mulher, uma das fotos obtida na Fase Folicular Tardia (FFT) do ciclo e a outra obtida na Fase Lútea (FL). Os participantes escolheram a face mais atraente e posteriormente avaliaram o grau de atratividade mediante uma escala analógica visual (VAS), cujo extremo esquerdo e direito da escala foram rotulados respectivamente por: nem um pouco atraente e muito atraente. Os resultados mostraram que a atratividade facial feminina muda em função da etapa do ciclo menstrual. As faces das mulheres que não tomavam anticoncepcionais foram julgadas como mais atraentes na etapa fértil do que na etapa infértil do ciclo. E o julgamento de atratividade feito para as faces das mulheres que tomavam anticoncepcionais não diferiram significativamente entre a FFT e a FL. Os resultados obtidos nesta pesquisa e nos estudos realizados previamente proporcionam evidências que demonstram que o período fértil nos humanos não está oculto, pois ocorrem mudanças na face que são detectáveis, mesmo quando o processo de percepção não é ciente. / Visibility of fertile period in women is a controversial topic that has been broadly discussed during the last decades. Some authors argue that ovulation became hidden in the course of evolution. In contrast, some other researchers state that ovulation in woman is not manifested as visibly as in other primates, which present very evident signals of ovulation like, e.g., vaginal tumefaction. However, several studies have provided evidence showing that fertile period in women is perceptible in a subtle way, without being aware of the perceptual process involved. Findings of those works points to the fact that some characteristics such as face, waist hip ratio, paired soft tissues symmetry and smell are perceived as more attractive in the fertile stage. The present work aimed to find out whether in any stage (late follicular or luteal) of menstrual cycle woman face appears more attractive to opposite sex, due to morphological changes induced by hormonal levels. 36 slides with frontal face photographs of woman in reproductive age were shown to male participants. In each slide two pictures of the same woman, one obtained in the late follicular phase and the other obtained in the luteal phase were exposed. Participants chose the more attractive picture and then they assessed the attractiveness through a visual analogical scale (VAS), in whose left and right extremes the legends not attractive at all and very attractive were marked, respectively. Results showed that female facial attractiveness changes as a function of the menstrual cycle stage. Faces of women who did not take contraceptives did not differ significantly between FFT and FL. The results obtained in this research and previous studies provide evidence to demonstrate that the fertile period in humans is not hidden, because on the face occur changes that are detectable even when the process of perception is not aware of.

A visibilidade da etapa fértil na mulher é uma questão polêmica e tem sido muito discutida nas últimas décadas. Alguns autores argumentam que no transcorrer da evolução a ovulação ficou oculta. Em paralelo, outros pesquisadores afirmam que a ovulação na mulher não se manifesta de forma tão visível como em alguns primatas que apresentam sinais muito notórios da ovulação, por exemplo, a tumefação vaginal. Mas diversas pesquisas têm fornecido evidência que mostram que o período fértil na mulher é perceptível de maneira sutil, sem que se tenha consciência do processo perceptual envolvido. Os achados destas pesquisas apontam para o fato de diversas características (como a face, a proporção cintura quadril, a simetria de tecidos brandos pareados e o cheiro) serem percebidas como mais atraentes na etapa fértil. O presente estudo teve por objetivo investigar se em alguma etapa (folicular tardia ou lútea) do ciclo menstrual a face da mulher se torna mais atraente para o sexo oposto devido a mudanças morfológicas induzidas pelos níveis hormonais. Foram apresentados, apenas para participantes masculinos, 36 slides com fotografias de faces frontais de mulheres em idade reprodutiva. Em cada slide foram mostradas simultaneamente duas fotos da mesma mulher, uma das fotos obtida na Fase Folicular Tardia (FFT) do ciclo e a outra obtida na Fase Lútea (FL). Os participantes escolheram a face mais atraente e posteriormente avaliaram o grau de atratividade mediante uma escala analógica visual (VAS), cujo extremo esquerdo e direito da escala foram rotulados respectivamente por: nem um pouco atraente e muito atraente. Os resultados mostraram que a atratividade facial feminina muda em função da etapa do ciclo menstrual. As faces das mulheres que não tomavam anticoncepcionais foram julgadas como mais atraentes na etapa fértil do que na etapa infértil do ciclo. E o julgamento de atratividade feito para as faces das mulheres que tomavam anticoncepcionais não diferiram significativamente entre a FFT e a FL. Os resultados obtidos nesta pesquisa e nos estudos realizados previamente proporcionam evidências que demonstram que o período fértil nos humanos não está oculto, pois ocorrem mudanças na face que são detectáveis, mesmo quando o processo de percepção não é ciente. / Visibility of fertile period in women is a controversial topic that has been broadly discussed during the last decades. Some authors argue that ovulation became hidden in the course of evolution. In contrast, some other researchers state that ovulation in woman is not manifested as visibly as in other primates, which present very evident signals of ovulation like, e.g., vaginal tumefaction. However, several studies have provided evidence showing that fertile period in women is perceptible in a subtle way, without being aware of the perceptual process involved. Findings of those works points to the fact that some characteristics such as face, waist hip ratio, paired soft tissues symmetry and smell are perceived as more attractive in the fertile stage. The present work aimed to find out whether in any stage (late follicular or luteal) of menstrual cycle woman face appears more attractive to opposite sex, due to morphological changes induced by hormonal levels. 36 slides with frontal face photographs of woman in reproductive age were shown to male participants. In each slide two pictures of the same woman, one obtained in the late follicular phase and the other obtained in the luteal phase were exposed. Participants chose the more attractive picture and then they assessed the attractiveness through a visual analogical scale (VAS), in whose left and right extremes the legends not attractive at all and very attractive were marked, respectively. Results showed that female facial attractiveness changes as a function of the menstrual cycle stage. Faces of women who did not take contraceptives did not differ significantly between FFT and FL. The results obtained in this research and previous studies provide evidence to demonstrate that the fertile period in humans is not hidden, because on the face occur changes that are detectable even when the process of perception is not aware of.

A motricidade orofacial é a especialidade da Fonoaudiologia, que tem como objetivo a prevenção, diagnóstico e tratamento das alterações miofuncionais do sistema estomatognático. Atualmente, muitos pesquisadores desta área, nacional e internacionalmente, têm buscado metodologias mais objetivas de avaliação e conduta. Dentre tais aparatos está a eletromiografia de superfície (EMG). A EMG é a medida da atividade elétrica de um músculo. Os objetivos deste trabalho foram o de identificar, por meio da EMG, a atividade elétrica dos músculos faciais de adultos saudáveis durante movimentos faciais normalmente utilizados terapeuticamente na clínica fonoaudiológica, para identificar o papel de cada músculo durante os movimentos e para diferenciar a atividade elétrica destes músculos nestes mesmos movimentos, bem como avaliar a validade da EMG na clínica fonoaudiológica. Foram avaliadas 31 pessoas (18 mulheres) com média de idade de 29,48 anos e sem queixas fonoaudiológicas ou odontológicas. Os eletrodos de superfície bipolares foram aderidos aos músculos masseteres, bucinadores e supra-hióides bilateralmente e aos músculos orbicular da boca superior e inferior. Os eletrodos foram conectados a um eletromiógrafo EMG 1000 da Lynx Tecnologia Eletrônica de oito canais, e foi pedido que cada participante realizasse os seguintes movimentos: Protrusão Labial (PL), Protrusão Lingual (L), Inflar Bochechas (IB), Sorriso Aberto (SA), Sorriso Fechado (SF), Lateralização Labial Direita (LD) e Esquerda (LE) e Pressão de um lábio contra o outro (AL). Os dados eletromiográficos foram registrados em microvolts (RMS) e foi considerada a média dos movimentos para a realização da análise dos dados, que foram normalizados utilizando como base o registro da EMG no repouso e os resultados demonstram que os músculos orbiculares da boca inferior e superior apresentam maior atividade elétrica que os outros músculos na maior parte dos movimentos, com exceção dos movimentos de L e SF, Nos movimentos de LD e LE, os orbiculares da boca também estavam mais ativos, mas os músculos bucinadores demonstraram participação importante, especialmente o bucinador direito em LD A Protrusão Lingual não demonstrou diferenças significativas entre os músculos estudados. O SA teve maior participação do orbicular da boca Inferior que o superior, e demonstrou ser o movimento que mais movimenta os músculos da face como um todo e o músculo com maior atividade durante o SF foi o bucinador. Concluímos que o aparato da EMG é eficiente não só para a avaliação dos músculos mastigatórios, mas também dos da mímica, a não ser no movimento de Protrusão lingual, onde o EMG de superfície não foi eficiente. Os músculos orbiculares foram mais ativos durante os movimentos testados, portanto, são também os mais exercitados durante os exercícios de motricidade oral. O movimento que envolve a maior atividade dos músculos da face como um todo foi o Sorriso Aberto / Speech Therapy has been considered subjective during many years due to its manual and visual methods. Many researchers have been searching for more objective methodology of evaluation, based on electronics devises. One of them is the EMG- Surface Electromyography, which is the electric unit measure of a muscle. Literature presents many works in TMJ and Orthodontics areas, special attention to the chewing muscles- temporal and masseter- for been bigger muscles, presenting more evident results in EMG. Less attention is paid for mimic muscles. The objective of our work is to identify, by means of EMG, the electrical activity of facial muscles of healthy adults during facial movements normally used in speech therapy clinic, to identify the role of each muscle during movements and to differentiate the electrical activity of these muscles during this movements. 31 volunteers have been evaluated (18 women) with mean age of 29,84 years, no speech therapy or odontological complains. Bipolar surface electrodes have been adhered to masseter, buccinator and suprahyoid muscles bilaterally and to superior and inferior orbicular oris muscles. Electrodes were connected to a EMG 1000 from Lynx Tecnologia Eletrônica of 8 channels, and it was asked each participant to carry out the following movements: Labial Protrusion (PL), Lingual Protrusion (L), Cheek Inflating (CI), Opened Smile (OS), Closed Smile (CS), Labial Lateralization (LL) and pressure of one lip against the other (LP). EMG data was registered in microvolts (RMS) and the movement media was considered for data analyses, which were normalized using as bases the rest EMG and results show that orbicular oris are more electric activity than other muscles in PL, CI, OS, LL and LP. In LL movements, orbicularis oris also showed greater activity, but buccinator muscles showed effective participation in movement, especially in right LL. L didnt show any differences between evaluated muscles. Buccinator was the most active muscle during CS. We concluded that Orbicularis Ores were the most active muscles during the tasks, exception made to L and CS. In L no muscle was significantly higher and in CS Buccinators were the most active. Opened Smile is the movement where the muscles are more activated in a role. This results shows that EMG is of great use for mimic muscles evaluation, but should be used carefully in specific tongue assessment

<p>The present thesis investigated the relationship between rapid facial muscle reactions and emotionally relevant stimuli. In Study I, it was demonstrated that angry faces elicit increased <i>Corrugator supercilii</i> activity, whereas happy faces elicit increased <i>Zygomaticus major</i> activity, as early as within the first second after stimulus onset. In Study II, during the first second of exposure, pictures of snakes elicited more corrugator activity than pictures of flowers. However, this effect was apparent only for female participants. Study III showed that participants high as opposed to low in fear of snakes respond with increased corrugator activity, as well as increased autonomic activity, when exposed to pictures of snakes. In Study IV, participants high as opposed to low in speech anxiety responded with a larger difference in corrugator responding between angry and happy faces, and also with a larger difference in zygomatic responding between happy and angry faces, indicating that people high in speech anxiety have an exaggerated facial responsiveness to social stimuli. In summary, the present results show that the facial EMG technique is sensitive to detecting rapid emotional reactions to different emotionally relevant stimuli (human faces and snakes). Additionally, they demonstrate the existence of differences in rapid facial reactions among groups for which the emotional relevance of the stimuli can be considered to differ.</p>

The present thesis investigated the relationship between rapid facial muscle reactions and emotionally relevant stimuli. In Study I, it was demonstrated that angry faces elicit increased Corrugator supercilii activity, whereas happy faces elicit increased Zygomaticus major activity, as early as within the first second after stimulus onset. In Study II, during the first second of exposure, pictures of snakes elicited more corrugator activity than pictures of flowers. However, this effect was apparent only for female participants. Study III showed that participants high as opposed to low in fear of snakes respond with increased corrugator activity, as well as increased autonomic activity, when exposed to pictures of snakes. In Study IV, participants high as opposed to low in speech anxiety responded with a larger difference in corrugator responding between angry and happy faces, and also with a larger difference in zygomatic responding between happy and angry faces, indicating that people high in speech anxiety have an exaggerated facial responsiveness to social stimuli. In summary, the present results show that the facial EMG technique is sensitive to detecting rapid emotional reactions to different emotionally relevant stimuli (human faces and snakes). Additionally, they demonstrate the existence of differences in rapid facial reactions among groups for which the emotional relevance of the stimuli can be considered to differ.

The aim of this study is to present a novel three dimensional (3D) facial animation method for morphing emotions and facial expressions from one face model to another. For this purpose, smooth and realistic face models were animated with thin plate splines (TPS). Neutral face models were animated and compared with the actual expressive face models. Neutral and expressive face models were obtained from subjects via a 3D face scanner. The face models were preprocessed for pose and size normalization. Then muscle and wrinkle control points were located to the source face with neutral expression according to the human anatomy. Facial Action Coding System (FACS) was used to determine the control points and the face regions in the underlying model. The final positions of the control points after a facial expression were received from the expressive scan data of the source face. Afterwards control points were transferred to the target face using the facial landmarks and TPS as the morphing function. Finally, the neutral target face was animated with control points by TPS. In order to visualize the method, face scans with expressions composed of a selected subset of action units found in Bosphorus Database were used. Five lower-face and three-upper face action units are simulated during this study. For experimental results, the facial expressions were created on the 3D neutral face scan data of a human subject and the synthetic faces were compared to the subject&rsquo / s actual 3D scan data with the same facial expressions taken from the dataset.

In this thesis, 3D animation of human facial expressions and lip motion and their synchronization with a Turkish Speech engine using JAVA programming language, JAVA3D API and Java Speech API, is analyzed. A three-dimensional animation model for simulating Turkish lip motion and facial expressions is developed. In addition to lip motion, synchronization with a Turkish speech engine is achieved. The output of the study is facial expressions and Turkish lip motion synchronized with Turkish speech, where the input is Turkish text in Java Speech Markup Language (JSML) format, also indicating expressions. Unlike many other languages, in Turkish, words are easily broken up into syllables. This property of Turkish Language lets us use a simple method to map letters to Turkish visual phonemes. In this method, totally 37 face models are used to represent the Turkish visual phonemes and these letters are mapped to 3D facial models considering the syllable structures. The animation is created using JAVA3D API. 3D facial models corresponding to different lip positions of the same person are morphed to each other to construct the animation. Moreover, simulations of human facial expressions of emotions are created within the animation. Expression weight parameter, which states the weight of the given expression, is introduced. The synchronization of lip motion with Turkish speech is achieved via CloudGarden&reg / &rsquo / s Java Speech API interface. As a final point a virtual Turkish speaker with facial expression of emotions is created for JAVA3D animation.