Show simple item record

dc.contributor.authorChhibber, Nalin
dc.date.accessioned2019-12-20 20:35:37 (GMT)
dc.date.available2019-12-20 20:35:37 (GMT)
dc.date.issued2019-12-20
dc.date.submitted2019-12-17
dc.identifier.urihttp://hdl.handle.net/10012/15361
dc.description.abstractThe traditional process of building interactive machine learning systems can be viewed as a teacher-learner interaction scenario where the machine-learners are trained by one or more human-teachers. In this work, we explore if teachable AI agents can reliably learn from human-teachers through conversational interactions, how this teaching process affects a teacher's performance in the task, and their trust on the agent. We introduce a teachable agent named Kai, that learns to classify news articles while also guiding the teaching process through conversational interventions. In a three-part study, where several crowdworkers individually teach Kai, we investigate whether this Learning by Teaching approach creates reliable machine learners, improves Turkers' performance and leads to trustable AI agents that crowdworkers would use. We present and discuss the results of the underlying classifier built from conversational interactions with other text classification algorithms. We also provide an evaluation of how crowdworkers perform a text classification before and after interacting with a teachable agent. Finally, we investigate the notion of trust that crowdworkers exhibit for their teachable agents in terms of delegating the work involving monetary compensation. Together, our results demonstrate the benefits of Learning by Teaching approach, in terms of the performance of the AI agent, the crowdworkers, and the dynamics of trust built from the teacher-learner interaction.en
dc.language.isoenen
dc.publisherUniversity of Waterlooen
dc.subjectlearning by teachingen
dc.subjectinteractive machine learningen
dc.subjectmachine teachingen
dc.subjectteachable agentsen
dc.subjectconversational interactionen
dc.titleTowards the Learning, Perception, and Effectiveness of Teachable Conversational Agentsen
dc.typeMaster Thesisen
dc.pendingfalse
uws-etd.degree.departmentDavid R. Cheriton School of Computer Scienceen
uws-etd.degree.disciplineComputer Scienceen
uws-etd.degree.grantorUniversity of Waterlooen
uws-etd.degreeMaster of Mathematicsen
uws.contributor.advisorLaw, Edith
uws.contributor.affiliation1Faculty of Mathematicsen
uws.published.cityWaterlooen
uws.published.countryCanadaen
uws.published.provinceOntarioen
uws.typeOfResourceTexten
uws.peerReviewStatusUnrevieweden
uws.scholarLevelGraduateen


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record


UWSpace

University of Waterloo Library
200 University Avenue West
Waterloo, Ontario, Canada N2L 3G1
519 888 4883

All items in UWSpace are protected by copyright, with all rights reserved.

DSpace software

Service outages