Continuous-Space Language Models for Statistical Machine Translation

This paper describes an open-source implementation of the so-called continuous space language model and its application to statistical machine translation. The underlying idea of this approach is to attack the data sparseness problem by performing the language model probability estimation in a conti...

Full description

Saved in:
Bibliographic Details
Published in:Prague bulletin of mathematical linguistics 2010-01, Vol.93 (Jan), p.137-146
Main Author: Schwenk, Holger
Format: Article
Language:English
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper describes an open-source implementation of the so-called continuous space language model and its application to statistical machine translation. The underlying idea of this approach is to attack the data sparseness problem by performing the language model probability estimation in a continuous space. The projection of the words and the probability estimation are both performed by a multi-layer neural network. This paper describes the theoretical background of the approach, efficient algorithms to handle the computational complexity, and gives implementation details and reports experimental results on a variety of tasks. Adapted from the source document
ISSN:0032-6585