The repository provides code for training Energy-Based Transformers (EBTs), a new approach to transformer architecture that enables System 2 Thinking over every prediction. The method scales across modalities, data, depth, and parameters, demonstrating better generalization than standard transformer models. It includes training loops, model implementations, and experiments on language and video tasks.