Adapting boosting for information retrieval measures

• Published in: Information retrieval (Boston) 2010-06, Vol.13 (3), p.254-270
• Main Authors: Wu, Qiang, Burges, Christopher J. C., Svore, Krysta M., Gao, Jianfeng
• Format: Article
• Language: English
• Subjects: Accuracy; Algorithms; Computer Science; Data Mining and Knowledge Discovery; Data Structures and Information Theory; Information retrieval; Information Storage and Retrieval; Learning to Rank for Information Retrieval; Markets; Mathematical models; Natural Language Processing (NLP); Optimization; Optimization algorithms; Pattern Recognition; Preferences; Ratings & rankings; Regression analysis; Relevance; Search engines; Searching; Studies; Trains; Trees
• ISSN: 1386-4564; 1573-7659
• DOI: 10.1007/s10791-009-9112-1

We present a new ranking algorithm that combines the strengths of two previous methods: boosted tree classification, and LambdaRank, which has been shown to be empirically optimal for a widely used information retrieval measure. Our algorithm is based on boosted regression trees, although the ideas apply to any weak learners, and it is significantly faster in both train and test phases than the state of the art, for comparable accuracy. We also show how to find the optimal linear combination for any two rankers, and we use this method to solve the line search problem exactly during boosting. In addition, we show that starting with a previously trained model, and boosting using its residuals, furnishes an effective technique for model adaptation, and we give significantly improved results for a particularly pressing problem in web search—training rankers for markets for which only small amounts of labeled data are available, given a ranker trained on much more data from a larger market.