Back to search

University of Waterloo

Continuous Affect Recognition with Different Features and Modeling Approaches in Evaluation-Potency-Activity Space

Abstract

dc:description.abstract

Emotions are an essential part of human social interactions. By integrating an automatic affect recognizer into an artificial system, the system can detect humans’ emotions and provide personal responses. We aim to build a prompting system that uses a virtual human with emotional interaction capabilities to help persons with a cognitive disability to complete daily activities independently. In this thesis, we work on automatic affect recognition and compare three different types of feature descriptors with support vector machine regression (SVR) and bidirectional long short-term memory (BLSTM) to predict users’ emotions in three-dimensional space. We demonstrate the feasibility of further building artificial systems that track users’ real-time emotions through BayesACT simulations, a probabilistic and decision-theoretic generalization of Affect Control Theory that learns users’ fundamental sentiments during interactions. We would like to understand given virtual humans with distinct emotion characteristics, how and to what extent the user’s emotions are affected. In the end, we integrate the affect recognition module into an iterated prisoner’s dilemma game, in which a user can play the game against a virtual human. We let a number of participants play the game and test if different facial expressions change the virtual human’s strategies during the game.

Degree

thesis:*
Grantor dc:publisher
University of Waterloo
Year dc:date.issued
2017

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Shang, Zhengkun
Advisor dc:contributor.advisor
  • Hoey, Jesse

Subjects

dc:subject × 5

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/10012/11989

Chain of custody

source
Harvested from
University of Waterloo
Base URL
dspacemainprd01.lib.uwaterloo.ca/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Shang, Zhengkun. Continuous Affect Recognition with Different Features and Modeling Approaches in Evaluation-Potency-Activity Space. University of Waterloo, 2017. http://hdl.handle.net/10012/11989