Continuous Affect Recognition with Different Features and Modeling Approaches in Evaluation-Potency-Activity Space

dc.contributor.authorShang, Zhengkun
dc.date.accessioned2017-06-08T19:12:25Z
dc.date.available2017-06-08T19:12:25Z
dc.date.issued2017-06-08
dc.date.submitted2017
dc.description.abstractEmotions are an essential part of human social interactions. By integrating an automatic affect recognizer into an artificial system, the system can detect humans’ emotions and provide personal responses. We aim to build a prompting system that uses a virtual human with emotional interaction capabilities to help persons with a cognitive disability to complete daily activities independently. In this thesis, we work on automatic affect recognition and compare three different types of feature descriptors with support vector machine regression (SVR) and bidirectional long short-term memory (BLSTM) to predict users’ emotions in three-dimensional space. We demonstrate the feasibility of further building artificial systems that track users’ real-time emotions through BayesACT simulations, a probabilistic and decision-theoretic generalization of Affect Control Theory that learns users’ fundamental sentiments during interactions. We would like to understand given virtual humans with distinct emotion characteristics, how and to what extent the user’s emotions are affected. In the end, we integrate the affect recognition module into an iterated prisoner’s dilemma game, in which a user can play the game against a virtual human. We let a number of participants play the game and test if different facial expressions change the virtual human’s strategies during the game.en
dc.identifier.urihttp://hdl.handle.net/10012/11989
dc.language.isoenen
dc.pendingfalse
dc.publisherUniversity of Waterlooen
dc.subjectAffective Computingen
dc.subjectHuman Computer Interactionen
dc.subjectEmotionen
dc.subjectAffect Control Theoryen
dc.subjectFacial Expression Recognitionen
dc.titleContinuous Affect Recognition with Different Features and Modeling Approaches in Evaluation-Potency-Activity Spaceen
dc.typeMaster Thesisen
uws-etd.degreeMaster of Mathematicsen
uws-etd.degree.departmentDavid R. Cheriton School of Computer Scienceen
uws-etd.degree.disciplineComputer Scienceen
uws-etd.degree.grantorUniversity of Waterlooen
uws.contributor.advisorHoey, Jesse
uws.contributor.affiliation1Faculty of Mathematicsen
uws.peerReviewStatusUnrevieweden
uws.published.cityWaterlooen
uws.published.countryCanadaen
uws.published.provinceOntarioen
uws.scholarLevelGraduateen
uws.typeOfResourceTexten

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Shang_Zhengkun.pdf
Size:
3.15 MB
Format:
Adobe Portable Document Format
Description:
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
6.17 KB
Format:
Item-specific license agreed upon to submission
Description: