TAGNet: Triplet-Attention Graph Networks for Hashtag Recommendation

• Published in: IEEE transactions on circuits and systems for video technology 2022-03, Vol.32 (3), p.1148-1159
• Main Authors: Chen, Yu-Chi, Lai, Kuan-Ting, Liu, Dong, Chen, Ming-Syan
• Format: Article
• Language: English
• Subjects: attention mechanism; Blogs; Convolution; Correlation; Feature extraction; Fuses; graph convolutional networks; Hashtag recommendation; Modules; Recommender systems; Social networking (online); Visualization
• ISSN: 1051-8215; 1558-2205
• DOI: 10.1109/TCSVT.2021.3074599

Hashtag is an important advertising tool and a must-have feature for social media nowadays. In the past, many hashtag recommendation methods have been proposed from different perspectives of images, texts, and users. However, most previous works consider neither the mutual influence between multi-modalities, nor the visual similarity between images. In this paper, we devise a novel model, named Triplet-Attention Graph Network (TAGNet). The rationale behind our method is that visually similar images share some common hashtags. Therefore, we build an image graph, and apply a new Aggregated Graph Convolution (AGC) module to propagate information in a collective way. Furthermore, it is noted that text and user also have rich content information within posts, and we hence propose a Triplet Attention (TA) module to incorporate multi-modalities into node features. Experiments on the large-scale dataset collected from Instagram show that TAGNet achieved significant improvement in recall rate over the best state-of-the-art method.