lonePatient/albert_pytorch
A PyTorch implementation of ALBERT, a parameter-efficient variant of BERT for self-supervised language understanding.
Not currently ranked — collecting fresh signals.
star history
This repository provides a PyTorch implementation of ALBERT (A Lite BERT), a parameter-efficient transformer model designed for self-supervised learning of language representations. It includes pre-trained model downloads, tools to convert TensorFlow checkpoints to PyTorch format, and fine-tuning scripts for downstream NLP tasks. The implementation supports multiple model sizes (base, large, xlarge, xxlarge) and both v1 and v2 releases.
Frequently asked
- What is lonePatient/albert_pytorch?
- A PyTorch implementation of ALBERT, a parameter-efficient variant of BERT for self-supervised language understanding.
- Is albert_pytorch open source?
- Yes — lonePatient/albert_pytorch is open source, released under the Apache-2.0 license.
- What language is albert_pytorch written in?
- lonePatient/albert_pytorch is primarily written in Python.
- How popular is albert_pytorch?
- lonePatient/albert_pytorch has 714 stars on GitHub.
- Where can I find albert_pytorch?
- lonePatient/albert_pytorch is on GitHub at https://github.com/lonePatient/albert_pytorch.