Design and Implementation of Robot Audition System 'HARK' - Open Source Software for Listening to Three Simultaneous Speakers

This paper presents the design and implementation of the HARK robot audition software system consisting of sound source localization modules, sound source separation modules and automatic speech recognition modules of separated speech signals that works on any robot with any microphone configuration...

Full description

Saved in:
Bibliographic Details
Published in:Advanced robotics 2010-01, Vol.24 (5-6), p.739-761
Main Authors: Nakadai, Kazuhiro, Takahashi, Toru, Okuno, Hiroshi G., Nakajima, Hirofumi, Hasegawa, Yuji, Tsujino, Hiroshi
Format: Article
Language:English
Subjects:
AUTOMATIC SPEECH RECOGNITION
Computer programs
Modules
OPEN SOURCE SOFTWARE
Position (location)
ROBOT AUDITION
Robots
Separation
Software
SOUND SOURCE LOCALIZATION
SOUND SOURCE SEPARATION
Sound sources
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper presents the design and implementation of the HARK robot audition software system consisting of sound source localization modules, sound source separation modules and automatic speech recognition modules of separated speech signals that works on any robot with any microphone configuration. Since a robot with ears may be deployed to various auditory environments, the robot audition system should provide an easy way to adapt to them. HARK provides a set of modules to cope with various auditory environments by using an open-sourced middleware, FlowDesigner, and reduces the overheads of data transfer between modules. HARK has been open-sourced since April 2008. The resulting implementation of HARK with MUSIC-based sound source localization, GSS-based sound source separation and Missing Feature Theory-based automatic speech recognition on Honda ASIMO, SIG2 and Robovie R2 attains recognizing three simultaneous utterances with the delay of 1.9 s at the word correct rate of 80-90% for three speakers.
ISSN:0169-1864
1568-5535
DOI:10.1163/016918610X493561