Towards the generation of dialogue acts in socio-affective ECAs: a corpus-based prosodic analysis

We present a corpus-based prosodie analysis with the aim of uncovering the relationship between dialogue acts, personality and prosody in view to providing guidelines for the ECA Greta's text-to-speech system. The corpus used is the SEMAINE corpus, featuring four different personalities, furthe...

Full description

Saved in:
Bibliographic Details
Published in:Language Resources and Evaluation 2016-12, Vol.50 (4), p.821-838
Main Authors: Bawden, Rachel, Clavel, Chloé, Landragin, Frédéric
Format: Article
Language:English
Subjects:
Computation and Language
Computational Linguistics
Computer Science
Computerized corpora
Conversational language
Corpus linguistics
Declarative sentences
Emotional expression
Gestures
Humanities and Social Sciences
Information processing
Language and Literature
Linguistics
Literary dialogue
Personality
Pragmatics
PROJECT NOTES
Prosodic features
Saliency
Social Sciences
Speech acts
Speech recognition
Speech synthesis
Taxonomy
Text-to-speech
Vocabularies & taxonomies
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We present a corpus-based prosodie analysis with the aim of uncovering the relationship between dialogue acts, personality and prosody in view to providing guidelines for the ECA Greta's text-to-speech system. The corpus used is the SEMAINE corpus, featuring four different personalities, further annotated for dialogue acts and prosodie features. In order to show the importance of the choice of dialogue act taxonomy, two different taxonomies were used, the first corresponding to Searle's taxonomy of speech acts and the second, inspired by Bunt's DIT++, including a division of directive acts into finer categories. Our results show that finer-grained distinctions are important when choosing a taxonomy. We also show with some preliminary results that the prosodie correlates of dialogue acts are not always as cited in the literature and prove more complex and variable. By studying the realisation of different directive acts, we also observe differences in the communicative strategies of the ECA depending on personality, in view to providing input to a speech system.
ISSN:1574-020X
1572-8412
1574-0218
DOI:10.1007/s10579-015-9312-9