This repository is a curated collection of links and resources for distributed deep learning. It catalogs distributed ML frameworks such as MXNet, Horovod, Elephas, and DMTK, alongside research papers, books, and blog posts on scaling neural network training across multiple machines and GPUs. It serves as a reference guide for practitioners seeking tools and literature on parallel and distributed model training.