Lexicon modeling for query understanding

Lexicons are important resources for semantic tagging. However, commonly used lexicons collected from entity databases suffer from multiple problems, such as ambiguity, limited coverage and lack of relative importance. In this work we present a lexicon modeling technique that automatically expands t...

Full description

Saved in:
Bibliographic Details
Main Authors: Jingjing Liu, Xiao Li, Acero, Alex, Ye-Yi Wang
Format: Conference Proceeding
Language:English
Subjects:
Frequency modulation
lexicon modeling
Motion pictures
Natural languages
query understanding
semantic tagging
Semantics
Tagging
Training
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Lexicons are important resources for semantic tagging. However, commonly used lexicons collected from entity databases suffer from multiple problems, such as ambiguity, limited coverage and lack of relative importance. In this work we present a lexicon modeling technique that automatically expands the lexicon and assigns weights to its elements. For lexicon expansion, we use a generative model to extract patterns from query logs using known lexicon seeds, and discover new lexicon elements using the learned patterns. For lexicon weighting, we propose two approaches based on generative and discriminative models to learn the relative importance of lexicon elements from user click statistics. Experiments on text queries in multiple domains show that our lexicon modeling technique can significantly improve semantic tagging performance.
ISSN:1520-6149
2379-190X
DOI:10.1109/ICASSP.2011.5947630