ComStreamClust: a communicative multi-agent approach to text clustering in streaming data

Topic detection is the task of determining and tracking hot topics in social media. Twitter is arguably the most popular platform for people to share their ideas with others about different issues. One such prevalent issue is the COVID-19 pandemic. Detecting and tracking topics on these kinds of iss...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2021-04
Main Authors: Najafi, Ali, Araz Gholipour-Shilabin, Rahim Dehkharghani, Mohammadpur-Fard, Ali, Asgari-Chenaghlu, Meysam
Format: Article
Language:English
Subjects:
Clustering
Coronaviruses
COVID-19
Digital media
Tracking
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Topic detection is the task of determining and tracking hot topics in social media. Twitter is arguably the most popular platform for people to share their ideas with others about different issues. One such prevalent issue is the COVID-19 pandemic. Detecting and tracking topics on these kinds of issues would help governments and healthcare companies deal with this phenomenon. In this paper, we propose a novel, multi-agent, communicative clustering approach, so-called ComStreamClust for clustering sub-topics inside a broader topic, e.g., COVID-19. The proposed approach is parallelizable, and can simultaneously handle several data-point. The LaBSE sentence embedding is used to measure the semantic similarity between two tweets. ComStreamClust has been evaluated on two datasets: the COVID-19 and the FA CUP. The results obtained from ComStreamClust approve the effectiveness of the proposed approach when compared to existing methods.
ISSN:2331-8422
DOI:10.48550/arxiv.2010.05349