This repository provides deep learning pipelines for Apache Spark, specifically offering HorovodRunner to run distributed deep learning training as Spark jobs. It integrates Horovod for multi-GPU and multi-node training within the Spark ecosystem. The open-source version serves local development purposes, while Databricks Runtime ML enables full distributed training capabilities.