Adapting Component Analysis
Loading...
Date
2012-05-18T17:30:35Z
Authors
Dorri, Fatemeh
Journal Title
Journal ISSN
Volume Title
Publisher
University of Waterloo
Abstract
A main problem in machine learning is to predict the response variables of a test set given the training data and its corresponding response variables. A predictive model can perform satisfactorily only if the training data is an appropriate representative of the test data. This
intuition is reflected in the assumption that the training data and the test data are drawn
from the same underlying distribution. However, the assumption may not be correct in
many applications for various reasons. For example, gathering training data from the test population might not be easily possible, due to its expense or rareness. Or, factors like time, place, weather, etc can cause the difference in the distributions.
I propose a method based on kernel distribution embedding and Hilbert Schmidt Independence Criteria (HSIC) to address this problem. The proposed method explores a new
representation of the data in a new feature space with two properties: (i) the distributions
of the training and the test data sets are as close as possible in the new feature space, (ii) the important structural information of the data is preserved. The algorithm can reduce the dimensionality of the data while it preserves the aforementioned properties and therefore it can be seen as a dimensionality reduction method as well. Our method has a closed-form solution and the experimental results on various data sets show that it works well in practice.
Description
Keywords
Domain adaptation, Kernel embedding, Hilbert-Schmidt Independence Criteria, Dimension reduction