Design and Evaluation of Temporal Summarization Systems
| dc.contributor.author | Guttikonda, Rakesh | |
| dc.date.accessioned | 2014-06-06T19:11:21Z | |
| dc.date.available | 2014-06-06T19:11:21Z | |
| dc.date.issued | 2014-06-06 | |
| dc.date.submitted | 2014 | |
| dc.description.abstract | Temporal Summarization (TS) is a new track introduced as part of the Text REtrieval Conference (TREC) in 2013. This track aims to develop systems which can return important updates related to an event over time. In TREC 2013, the TS track specifically used disaster related events such as earthquake, hurricane, bombing, etc. This thesis mainly focuses on building an effective TS system by using a combination of Information Retrieval techniques. The developed TS system returns updates related to disaster related events in a timely manner. By participating in TREC 2013 and with experiments conducted after TREC, we examine the effectiveness of techniques such as distributional similarity for term expansion, which can be employed in building TS systems. Also, this thesis describes the effectiveness of other techniques such as stemming, adaptive sentence selection over time and de-duplication in our system, by comparing it with other baseline systems. The second part of the thesis examines the current methodology used for evaluating TS systems. We propose a modified evaluation method which could reduce the manual effort of assessors, and also correlates well with the official track’s evaluation. We also propose a supervised learning based evaluation method, which correlates well with the official track’s evaluation of systems and could save the assessor’s time by as much as 80%. | en |
| dc.identifier.uri | http://hdl.handle.net/10012/8516 | |
| dc.language.iso | en | en |
| dc.pending | false | |
| dc.publisher | University of Waterloo | en |
| dc.subject | Information Retrieval | en |
| dc.subject | Temporal Summarization | en |
| dc.subject | IR Evaluation | en |
| dc.subject.program | Computer Science | en |
| dc.title | Design and Evaluation of Temporal Summarization Systems | en |
| dc.type | Master Thesis | en |
| uws-etd.degree | Master of Mathematics | en |
| uws-etd.degree.department | School of Computer Science | en |
| uws.peerReviewStatus | Unreviewed | en |
| uws.scholarLevel | Graduate | en |
| uws.typeOfResource | Text | en |