facebookresearch/XLM
A PyTorch library for cross-lingual language model pretraining (XLM) and multilingual BERT-style models.
Not currently ranked — collecting fresh signals.
star history
This repository provides Facebook Research’s original PyTorch implementation of cross-lingual language model pretraining. It includes code for monolingual and cross-lingual BERT pretraining, the XLM model for cross-lingual understanding, and applications to supervised/unsupervised machine translation and cross-lingual text classification (XNLI). It supports multi-GPU and multi-node training with various pretraining objectives including causal language modeling, masked language modeling, and translation language modeling.
Frequently asked
- What is facebookresearch/XLM?
- A PyTorch library for cross-lingual language model pretraining (XLM) and multilingual BERT-style models.
- Is XLM open source?
- Yes — facebookresearch/XLM is an open-source project tracked on heatdrop.
- What language is XLM written in?
- facebookresearch/XLM is primarily written in Python.
- How popular is XLM?
- facebookresearch/XLM has 2.9k stars on GitHub.
- Where can I find XLM?
- facebookresearch/XLM is on GitHub at https://github.com/facebookresearch/XLM.