Affect (emotion) recognition has many applications, such as human assistive robotics, human computer interaction and empathic agents, virtual tutoring, marketing, surveillance, and counseling. Previous research has focused primarily on unimodal or bimodal affect recognition (facial expressions and speech). This research developed multimodal emotion recognition by using data from facial expressions, head position, hand movement, body posture and speech. A novel hybrid event driven fusion technique was used to combine data from multiple input channels at the feature level and decision level. Position and temporal data from tracked feature points was used for training a support vector machine based classifier. New rule based features in addition to existing geometric, kinetic and 3D features were created. An emotional key word look-up using speech recognition technology was incorporated in the recognition process. The research developed a real time affect estimation system that accurately predicts multiple emotions, intensity of the emotions and maintains the context history of recognized emotions.
| Identifer | oai:union.ndltd.org:LSU/oai:etd.lsu.edu:etd-11012016-102229 |
| Date | 15 November 2016 |
| Creators | Patwardhan, Amol Sriniwas |
| Contributors | Cao, Quang, Kooima, Robert, Chen, Jianhua, Knapp, Gerald |
| Publisher | LSU |
| Source Sets | Louisiana State University |
| Language | English |
| Detected Language | English |
| Type | text |
| Format | application/pdf |
| Source | http://etd.lsu.edu/docs/available/etd-11012016-102229/ |
| Rights | restricted, I hereby certify that, if appropriate, I have obtained and attached herein a written permission statement from the owner(s) of each third party copyrighted matter to be included in my thesis, dissertation, or project report, allowing distribution as specified below. I certify that the version I submitted is the same as that approved by my advisory committee. I hereby grant to LSU or its agents the non-exclusive license to archive and make accessible, under the conditions specified below and in appropriate University policies, my thesis, dissertation, or project report in whole or in part in all forms of media, now or hereafter known. I retain all other ownership rights to the copyright of the thesis, dissertation or project report. I also retain the right to use in future works (such as articles or books) all or part of this thesis, dissertation, or project report. |
Page generated in 0.0024 seconds