← all repositories
facebookresearch/MUSE

Thirty languages, one vector space, zero parallel data optional

MUSE aligns monolingual word embeddings into a shared cross-lingual space, optionally without any parallel data or bilingual dictionary.

3.2k stars Python Language ModelsData Tooling
MUSE
Not currently ranked — collecting fresh signals.
star history

What it does

MUSE takes pre-trained monolingual word embeddings—primarily fastText vectors—and maps them into a single shared vector space so that similar words across languages occupy similar coordinates. It provides training pipelines for both supervised alignment (using bilingual dictionaries or identical character strings as anchors) and unsupervised alignment (using adversarial training followed by iterative Procrustes refinement). The library also bundles evaluation scripts and pre-built datasets to measure cross-lingual and monolingual embedding quality.

The interesting bit

The unsupervised path is the standout: it learns a mapping between two monolingual spaces without any parallel corpus or seed dictionary, relying instead on adversarial training and a CSLS-based synthetic dictionary for validation. This was the mechanism behind the Word Translation without Parallel Data paper, and it is packaged here alongside a more traditional supervised Procrustes solver.

Key highlights

  • Ships with supervised alignments for 30 languages in a single vector space, ready to download.
  • Includes 110 ground-truth bilingual dictionaries with train/test splits for evaluation.
  • Supports both CPU and GPU execution via PyTorch, with optional Faiss acceleration for nearest-neighbor search.
  • Loads fastText binary, PyTorch binary, or text embeddings, though text loading is noticeably slower.
  • Provides a Jupyter notebook (demo.ipynb) to visualize cross-lingual nearest neighbors.

Caveats

  • Still advertises Python 2 compatibility, which suggests the codebase has not been modernized recently.
  • The evaluation data download script requires bash 4, a minor but real environment constraint.

Verdict

Researchers building cross-lingual word-level tools or studying alignment methods will find the pre-trained vectors and dictionaries immediately useful. Teams needing contextual or sentence-level representations should look elsewhere, as MUSE is strictly about static word embeddings.

Frequently asked

What is facebookresearch/MUSE?
MUSE aligns monolingual word embeddings into a shared cross-lingual space, optionally without any parallel data or bilingual dictionary.
Is MUSE open source?
Yes — facebookresearch/MUSE is an open-source project tracked on heatdrop.
What language is MUSE written in?
facebookresearch/MUSE is primarily written in Python.
How popular is MUSE?
facebookresearch/MUSE has 3.2k stars on GitHub.
Where can I find MUSE?
facebookresearch/MUSE is on GitHub at https://github.com/facebookresearch/MUSE.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.