Language model adaptation for video lectures transcription

Videolectures are currently being digitised all over the world for its enormous value as reference resource. Many of these lectures are accompanied with slides. The slides offer a great opportunity for improving ASR systems performance. We propose a simple yet powerful extension to the linear interp...

Full description

Saved in:
Bibliographic Details
Main Authors: Martinez-Villaronga, Adria, del Agua, Miguel A., Andres-Ferrer, Jesus, Juan, Alfons
Format: Conference Proceeding
Language:English
Subjects:
Adaptation models
Computational modeling
Hidden Markov models
Interpolation
language model adaptation
Mathematical model
Optical character recognition software
video lectures
Vocabulary
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Videolectures are currently being digitised all over the world for its enormous value as reference resource. Many of these lectures are accompanied with slides. The slides offer a great opportunity for improving ASR systems performance. We propose a simple yet powerful extension to the linear interpolation of language models for adapting language models with slide information. Two types of slides are considered, correct slides, and slides automatic extracted from the videos with OCR. Furthermore, we compare both time aligned and unaligned slides. Results report an improvement of up to 3.8 % absolute WER points when using correct slides. Surprisingly, when using automatic slides obtained with poor OCR quality, the ASR system still improves up to 2.2 absolute WER points.
ISSN:1520-6149
2379-190X
DOI:10.1109/ICASSP.2013.6639314