openai/finetune-transformer-lm
OpenAI's implementation of the GPT-1 language model from the paper 'Improving Language Understanding by Generative Pre-Training'.
Not currently ranked — collecting fresh signals.
star history
This repository contains the code and pre-trained model for the paper that introduced the generative pre-training approach for transformer language models. The implementation supports fine-tuning on downstream NLP tasks, with the ROCStories cloze test as the demonstrated benchmark. It provides both pre-trained weights and training code for fine-tuning on custom datasets.
Frequently asked
- What is openai/finetune-transformer-lm?
- OpenAI's implementation of the GPT-1 language model from the paper 'Improving Language Understanding by Generative Pre-Training'.
- Is finetune-transformer-lm open source?
- Yes — openai/finetune-transformer-lm is open source, released under the MIT license.
- What language is finetune-transformer-lm written in?
- openai/finetune-transformer-lm is primarily written in Python.
- How popular is finetune-transformer-lm?
- openai/finetune-transformer-lm has 2.3k stars on GitHub.
- Where can I find finetune-transformer-lm?
- openai/finetune-transformer-lm is on GitHub at https://github.com/openai/finetune-transformer-lm.