Semiautomatic Ground Truth Generation for Text Detection and Recognition in Video Images

Although a large number of methods for video text detection and recognition have been proposed over the past years, it is hard to find the best state-of-the-art method because of nonavailability of standard datasets, ground truth, and common evaluation measures. Therefore, in this paper, we propose...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on circuits and systems for video technology 2014-08, Vol.24 (8), p.1277-1287
Main Authors: Trung Quy Phan, Shivakumara, Palaiahnakote, Bhowmick, Souvik, Shimiao Li, Chew Lim Tan, Pal, Umapada
Format: Article
Language:English
Subjects:
Accuracy
Applied sciences
Automation
Chinese Video text recognition
Distortion
Exact sciences and technology
Frames
Graphics
Ground truth
Ground truthing
Indexes
Information, signal and communications theory
Optical character recognition software
Orientation
Pattern recognition
Performance indices
Recognition
Signal processing
Telecommunications and information theory
Text recognition
Texts
Video text detection
Video text recognition
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Although a large number of methods for video text detection and recognition have been proposed over the past years, it is hard to find the best state-of-the-art method because of nonavailability of standard datasets, ground truth, and common evaluation measures. Therefore, in this paper, we propose a semiautomatic system for ground truth generation for video text detection and recognition, which includes English and Chinese text of different orientation. The system has a facility to allow the user to manually correct the ground truth if the automatic method produces incorrect results. We propose eleven attributes at the word level, namely: line index, word index, coordinate values of bounding box, area, content, script type, orientation information, type of text (caption/scene), condition of text (distortion/distortion free), start frame, and end frame to evaluate the performance of the method. We also introduce a new dataset that consists of 466 video frames collected from TRECVID 2005 and 2006 databases. The video frames in our dataset contain both horizontal texts (278 frames: 181 with English texts and 97 with Chinese texts) and nonhorizontal texts (188 frames: 140 English and 48 Chinese). Furthermore, the performance of the proposed system is compared with existing text detection methods by calculating measures manually and automatically to show usefulness of our semiautomatic system. The ground truth and the semiautomatic system will be released to the public.
ISSN:1051-8215
1558-2205
DOI:10.1109/TCSVT.2014.2305515