This repository provides code and methodology for training large-scale diffusion models from scratch on extremely limited budgets. Using approximately 37M real and synthetic images, they train sparse transformer diffusion models achieving FID of 12.7 on zero-shot COCO generation. The codebase includes training scripts, dataset preprocessing utilities, and pre-trained model checkpoints for reproduction.