Measuring Similarity of Academic Articles with Semantic Profile and Joint Word Embedding

• Published in: Tsinghua science and technology 2017-12, Vol.22 (6), p.619-632
• Main Authors: Liu, Ming, Lang, Bo, Gu, Zepeng, Zeeshan, Ahmed
• Format: Article
• Language: English
• ISSN: 1007-0214; 1878-7606; 1007-0214
• DOI: 10.23919/TST.2017.8195345

Long-document semantic measurement has great significance in many applications such as semantic searchs, plagiarism detection, and automatic technical surveys. However, research efforts have mainly focused on the semantic similarity of short texts. Document-level semantic measurement remains an open issue due to problems such as the omission of background knowledge and topic transition. In this paper, we propose a novel semantic matching method for long documents in the academic domain. To accurately represent the general meaning of an academic article, we construct a semantic profile in which key semantic elements such as the research purpose, methodology, and domain are included and enriched. As such, we can obtain the overall semantic similarity of two papers by computing the distance between their profiles. The distances between the concepts of two different semantic profiles are measured by word vectors. To improve the semantic representation quality of word vectors, we propose a joint word-embedding model for incorporating a domain-specific semantic relation constraint into the traditional context constraint. Our experimental results demonstrate that, in the measurement of document semantic similarity, our approach achieves substantial improvement over state-of-the-art methods, and our joint word-embedding model produces significantly better word representations than traditional word-embedding models.