Topic discovery and evolution in scientific literature based on content and citations

Researchers across the globe have been increasingly interested in the manner in which important research topics evolve over time within the corpus of scientific literature. In a dataset of scientific articles, each document can be considered to comprise both the words of the document itself and its...

Full description

Saved in:
Bibliographic Details
Published in:Frontiers of information technology & electronic engineering 2017-10, Vol.18 (10), p.1511-1532
Main Authors: Zhou, Hou-kui, Yu, Hui-min, Hu, Roland
Format: Article
Language:English
Subjects:
Algorithms
Communications Engineering
Computer Hardware
Computer Science
Computer Systems Organization and Communication Networks
Datasets
Dirichlet problem
Documents
Electrical Engineering
Electronics and Microelectronics
Evolutionary algorithms
Instrumentation
Networks
Parameter estimation
Pattern analysis
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Researchers across the globe have been increasingly interested in the manner in which important research topics evolve over time within the corpus of scientific literature. In a dataset of scientific articles, each document can be considered to comprise both the words of the document itself and its citations of other documents. In this paper, we propose a citationcontent-latent Dirichlet allocation(LDA) topic discovery method that accounts for both document citation relations and the content of the document itself via a probabilistic generative model. The citation-content-LDA topic model exploits a two-level topic model that includes the citation information for ‘father’ topics and text information for sub-topics. The model parameters are estimated by a collapsed Gibbs sampling algorithm. We also propose a topic evolution algorithm that runs in two steps: topic segmentation and topic dependency relation calculation. We have tested the proposed citation-content-LDA model and topic evolution algorithm on two online datasets, IEEE Transactions on Pattern Analysis and Machine Intelligence(PAMI) and IEEE Computer Society(CS), to demonstrate that our algorithm effectively discovers important topics and reflects the topic evolution of important research themes. According to our evaluation metrics, citation-content-LDA outperforms both content-LDA and citation-LDA.
ISSN:2095-9184
2095-9230
DOI:10.1631/FITEE.1601125