← all repositories

dbiir/UER-py

Open-source PyTorch toolkit for pre-training and fine-tuning transformer-based language models with a model zoo.

3.1k stars Python Language ModelsML Frameworks
UER-py
Not currently ranked — collecting fresh signals.
star history

UER-py (Universal Encoder Representations) is an open-source toolkit for pre-training language models on general-domain corpora and fine-tuning on downstream NLP tasks. It provides modular implementations of major transformer architectures including BERT, GPT, GPT-2, RoBERTa, ALBERT, T5, BART, ELMO, and XLM-RoBERTa. The project includes a comprehensive model zoo with pre-trained models and supports tasks such as text classification and named entity recognition.

Frequently asked

What is dbiir/UER-py?
Open-source PyTorch toolkit for pre-training and fine-tuning transformer-based language models with a model zoo.
Is UER-py open source?
Yes — dbiir/UER-py is open source, released under the Apache-2.0 license.
What language is UER-py written in?
dbiir/UER-py is primarily written in Python.
How popular is UER-py?
dbiir/UER-py has 3.1k stars on GitHub.
Where can I find UER-py?
dbiir/UER-py is on GitHub at https://github.com/dbiir/UER-py.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.