Prediction Reweighting for Domain Adaptation

• Published in: IEEE transaction on neural networks and learning systems 2017-07, Vol.28 (7), p.1682-1695
• Main Authors: Li, Shuang, Song, Shiji, Huang, Gao
• Format: Article
• Language: English
• Subjects: Adaptation; Algorithm design and analysis; Classification; Data mining; Datasets; Degradation; Domain adaptation; domain separator; Exact solutions; Labels; Learning systems; manifold regularization; Manifolds; Object recognition; Particle separators; Prediction algorithms; prediction reweighting; Regularization; State of the art; Test procedures; Testing; Training; Visual tasks
• ISSN: 2162-237X; 2162-2388
• DOI: 10.1109/TNNLS.2016.2538282

There are plenty of classification methods that perform well when training and testing data are drawn from the same distribution. However, in real applications, this condition may be violated, which causes degradation of classification accuracy. Domain adaptation is an effective approach to address this problem. In this paper, we propose a general domain adaptation framework from the perspective of prediction reweighting, from which a novel approach is derived. Different from the major domain adaptation methods, our idea is to reweight predictions of the training classifier on testing data according to their signed distance to the domain separator, which is a classifier that distinguishes training data (from source domain) and testing data (from target domain). We then propagate the labels of target instances with larger weights to ones with smaller weights by introducing a manifold regularization method. It can be proved that our reweighting scheme effectively brings the source and target domains closer to each other in an appropriate sense, such that classification in target domain becomes easier. The proposed method can be implemented efficiently by a simple two-stage algorithm, and the target classifier has a closed-form solution. The effectiveness of our approach is verified by the experiments on artificial datasets and two standard benchmarks, a visual object recognition task and a cross-domain sentiment analysis of text. Experimental results demonstrate that our method is competitive with the state-of-the-art domain adaptation algorithms.