Multi-Turn Chatbot Based on Query-Context Attentions and Dual Wasserstein Generative Adversarial Networks

To generate proper responses to user queries, multi-turn chatbot models should selectively consider dialogue histories. However, previous chatbot models have simply concatenated or averaged vector representations of all previous utterances without considering contextual importance. To mitigate this...

Full description

Saved in:
Bibliographic Details
Published in:Applied sciences 2019-09, Vol.9 (18), p.3908
Main Authors: Kim, Jintae, Oh, Shinhyeok, Kwon, Oh-Woog, Kim, Harksoo
Format: Article
Language:English
Subjects:
Chatbots
dialogue context encoding
multi-turn chatbot
Neural networks
Variables
WGAN-based response generation
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:To generate proper responses to user queries, multi-turn chatbot models should selectively consider dialogue histories. However, previous chatbot models have simply concatenated or averaged vector representations of all previous utterances without considering contextual importance. To mitigate this problem, we propose a multi-turn chatbot model in which previous utterances participate in response generation using different weights. The proposed model calculates the contextual importance of previous utterances by using an attention mechanism. In addition, we propose a training method that uses two types of Wasserstein generative adversarial networks to improve the quality of responses. In experiments with the DailyDialog dataset, the proposed model outperformed the previous state-of-the-art models based on various performance measures.
ISSN:2076-3417
2076-3417
DOI:10.3390/app9183908