This repository is an open implementation of OpenAI’s DALL-E model, designed for large-scale training across distributed TPU infrastructure. The system uses a variational autoencoder to compress images into discrete tokens, combined with an autoregressive transformer for text-to-image generation. It leverages Mesh-TensorFlow to enable training at scales comparable to or larger than the original 12-billion parameter DALL-E model.