Now showing items 1-2 of 2
A Statistical Analysis of the Aggregation of Crowdsourced Labels
(University of Waterloo, 2015-10-29)
Crowdsourcing, due to its inexpensive and timely nature, has become a popular method of collecting data that is difficult for computers to generate. We focus on using this method of human computation to gather labels for ...
Evaluating Information Retrieval Systems With Multiple Non-Expert Assessors
(University of Waterloo, 2013-08-21)
Many current test collections require the use of expert judgments during construction. The true label of each document is given by an expert assessor. However, the cost and effort associated with expert training and judging ...