Parallel Fusion of Graph and Text with Semantic Enhancement for Commonsense Question Answering

• Published in: Electronics (Basel) 2024-12, Vol.13 (23), p.4618
• Main Authors: Zong, Jiachuang, Li, Zhao, Chen, Tong, Zhang, Liguo, Zhan, Yiming
• Format: Article
• Language: English
• Subjects: Analysis; Cognition & reasoning; Context; Datasets; Graph neural networks; Graph representations; Graph theory; Graphical representations; Knowledge representation; Language; Neural networks; Questions; Reasoning; Semantics
• ISSN: 2079-9292; 2079-9292
• DOI: 10.3390/electronics13234618

Commonsense question answering (CSQA) is a challenging task in the field of knowledge graph question answering. It combines the context of the question with the relevant knowledge in the knowledge graph to reason and give an answer to the question. Existing CSQA models combine pretrained language models and graph neural networks to process question context and knowledge graph information, respectively, and obtain each other’s information during the reasoning process to improve the accuracy of reasoning. However, the existing models do not fully utilize the textual representation and graph representation after reasoning to reason about the answer, and they do not give enough semantic representation to the edges during the reasoning process of the knowledge graph. Therefore, we propose a novel parallel fusion framework for text and knowledge graphs, using the fused global graph information to enhance the semantic information of reasoning answers. In addition, we enhance the relationship embedding by enriching the initial semantics and adjusting the initial weight distribution, thereby improving the reasoning ability of the graph neural network. We conducted experiments on two public datasets, CommonsenseQA and OpenBookQA, and found that our model is competitive when compared with other baseline models. Additionally, we validated the generalizability of our model on the MedQA-USMLE dataset.