A distributed training pipeline for diffusion-based generative models with pipeline parallelism support. It handles large-scale multi-GPU training with efficient latent and text embedding caching, checkpointing, and evaluation metrics. The framework is modular, allowing easy addition of new model architectures through subclassing, and currently supports a wide range of image and video generation models.