Contributions to Unsupervised and Semi-Supervised Learning
MetadataShow full item record
This thesis studies two problems in theoretical machine learning. The first part of the thesis investigates the statistical stability of clustering algorithms. In the second part, we study the relative advantage of having unlabeled data in classification problems. Clustering stability was proposed and used as a model selection method in clustering tasks. The main idea of the method is that from a given data set two independent samples are taken. Each sample individually is clustered with the same clustering algorithm, with the same setting of its parameters. If the two resulting clusterings turn out to be close in some metric, it is concluded that the clustering algorithm and the setting of its parameters match the data set, and that clusterings obtained are meaningful. We study asymptotic properties of this method for certain types of cost minimizing clustering algorithms and relate their asymptotic stability to the number of optimal solutions of the underlying optimization problem. In classification problems, it is often expensive to obtain labeled data, but on the other hand, unlabeled data are often plentiful and cheap. We study how the access to unlabeled data can decrease the amount of labeled data needed in the worst-case sense. We propose an extension of the probably approximately correct (PAC) model in which this question can be naturally studied. We show that for certain basic tasks the access to unlabeled data might, at best, halve the amount of labeled data needed.
Cite this work
David Pal (2009). Contributions to Unsupervised and Semi-Supervised Learning. UWSpace. http://hdl.handle.net/10012/4445
Showing items related by title, author, creator and subject.
Schmidt, James R (University of Waterloo, 2009-08-26)Recent studies show that when words are correlated with the colours they are printed in (e.g., MOVE is presented 75% of the time in blue), colour identification is faster when the word is presented in its expected colour ...
Ghodsi Boushehri, Ali (University of Waterloo, 2006)In this thesis, I look at three problems with important applications in data processing. Incorporating side information, provided by the user or derived from data, is a main theme of each of these problems. <br /><br ...
Lin, Ying-Hsin (University of Waterloo, 2015-04-28)Contingencies are constantly found in everyday situations and humans are extraordinarily adept at learning them, whether implicitly or explicitly. The learning of contingencies can benefit behaviour in many ways, some ...