Real-time text tracking in natural scenes

The authors present a system that automatically detects, recognises and tracks text in natural scenes in real-time. The focus of the author's method is on large text found in outdoor environments, such as shop signs, street names, billboards and so on. Built on top of their previously developed...

Full description

Saved in:
Bibliographic Details
Published in:IET computer vision 2014-12, Vol.8 (6), p.670-681
Main Authors: Merino-Gracia, Carlos, Mirmehdi, Majid
Format: Article
Language:English
Subjects:
Automation
baseline changes
billboards
continuous unsupervised operation
end-to-end scene text reading system
erratic camera motion
Failure
failure recovery
fronto-parallel view
handheld system
homography transformation
image recognition
interactive text reading
Kalman filters
natural scenes
nonlinear filters
Orientation
orientation estimation
Outdoor
outdoor environments
Real time
real-time text tracking
scene text detection
shop signs
street names
text automatic detection
text automatic recognition
text detection
Texts
Tracking
Transformations
unscented Kalman filters
wearable system
Citations: Items that this one cites
Items that cite this one
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The authors present a system that automatically detects, recognises and tracks text in natural scenes in real-time. The focus of the author's method is on large text found in outdoor environments, such as shop signs, street names, billboards and so on. Built on top of their previously developed techniques for scene text detection and orientation estimation, the main contribution of this work is to present a complete end-to-end scene text reading system based on text tracking. They propose to use a set of unscented Kalman filters to maintain each text region's identity and to continuously track the homography transformation of the text into a fronto-parallel view, thereby being resilient to erratic camera motion and wide baseline changes in orientation. The system is designed for continuous, unsupervised operation in a handheld or wearable system over long periods of time. It is completely automatic and features quick failure recovery and interactive text reading. It is also highly parallelised to maximise usage of available processing power and achieve real-time operation. They demonstrate the performance of the system on sequences recorded in outdoor scenarios.
ISSN:1751-9632
1751-9640
1751-9640
DOI:10.1049/iet-cvi.2013.0217