Lipreading method using color extraction method and eigenspace technique

This paper describes a lipreading system using a color extraction method and several eigenspace techniques. To detect a precise mouth position, the system first finds the rough position of the mouth by the color extraction method and then determines the precise position using an eigentemplate techni...

Full description

Saved in:
Bibliographic Details
Published in:Systems and computers in Japan 2004-03, Vol.35 (3), p.12-23
Main Authors: Nakata, Yasuyuki, Ando, Moritoshi
Format: Article
Language:English
Subjects:
color extraction method
eigenspace method
lipreading
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper describes a lipreading system using a color extraction method and several eigenspace techniques. To detect a precise mouth position, the system first finds the rough position of the mouth by the color extraction method and then determines the precise position using an eigentemplate technique. To describe the mouth shape change, we developed an eigen waveform technique. The detected precise mouth position improves the accuracy of the eigen waveform, which results in a high recognition rate. We constructed an automatic lipreading system and an experiment revealed that this system recognizes 85% of 35 words and 69% of 100 words. © 2004 Wiley Periodicals, Inc. Syst Comp Jpn, 35(3): 12–23, 2004; Published online in Wiley InterScience (www.interscience.wiley.com). DOI 10.1002/scj.10508
ISSN:0882-1666
1520-684X
DOI:10.1002/scj.10508