This repository contains the official code and pretrained model weights for GPT-2, OpenAI’s 1.5 billion parameter transformer language model. It provides inference code for conditional text generation, model architecture definitions, and utilities for loading and sampling from the model across multiple sizes (small through large).