Multilingual Factor Analysis

In this work we approach the task of learning multilingual word representations in an offline manner by fitting a generative latent variable model to a multilingual dictionary. We model equivalent words in different languages as different views of the same word generated by a common latent variable...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2019-10
Main Authors: Vargas, Francisco, Kamen Brestnichki, Papadopoulos-Korfiatis, Alex, Hammerla, Nils
Format: Article
Language:English
Subjects:
Factor analysis
Monte Carlo simulation
Multilingualism
Representations
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this work we approach the task of learning multilingual word representations in an offline manner by fitting a generative latent variable model to a multilingual dictionary. We model equivalent words in different languages as different views of the same word generated by a common latent variable representing their latent lexical meaning. We explore the task of alignment by querying the fitted model for multilingual embeddings achieving competitive results across a variety of tasks. The proposed model is robust to noise in the embedding space making it a suitable method for distributed representations learned from noisy corpora.
ISSN:2331-8422