minimaxir/aitextgen
A Python package for fine-tuning and generating text with GPT-2 and GPT Neo models using PyTorch and Hugging Face Transformers.
Not currently ranked — collecting fresh signals.
star history
The package provides tools for fine-tuning pretrained GPT-2 (124M-774M) and GPT Neo (125M-350M) models on custom datasets, or training from scratch. It leverages pytorch-lightning for distributed training across multiple GPUs with optimized memory usage and fast generation. The project also supports model upload/download from the HuggingFace model hub and includes caching, dataset merging, and cross-training capabilities.
Frequently asked
- What is minimaxir/aitextgen?
- A Python package for fine-tuning and generating text with GPT-2 and GPT Neo models using PyTorch and Hugging Face Transformers.
- Is aitextgen open source?
- Yes — minimaxir/aitextgen is open source, released under the MIT license.
- What language is aitextgen written in?
- minimaxir/aitextgen is primarily written in Python.
- How popular is aitextgen?
- minimaxir/aitextgen has 1.8k stars on GitHub.
- Where can I find aitextgen?
- minimaxir/aitextgen is on GitHub at https://github.com/minimaxir/aitextgen.