meta-pytorch/monarch
A distributed programming framework for PyTorch based on scalable actor messaging for multi-GPU training.
Not currently ranked — collecting fresh signals.
star history
Monarch provides a Python API for creating remote actors that can work with distributed tensors across processes and GPUs. It implements fault tolerance through supervision trees, point-to-point RDMA transfers for memory-efficient GPU communication, and scalable broadcast messaging across actor meshes. The framework enables imperative creation of training processes across multiple GPUs with built-in synchronization primitives.
Frequently asked
- What is meta-pytorch/monarch?
- A distributed programming framework for PyTorch based on scalable actor messaging for multi-GPU training.
- Is monarch open source?
- Yes — meta-pytorch/monarch is open source, released under the BSD-3-Clause license.
- What language is monarch written in?
- meta-pytorch/monarch is primarily written in Rust.
- How popular is monarch?
- meta-pytorch/monarch has 1.1k stars on GitHub.
- Where can I find monarch?
- meta-pytorch/monarch is on GitHub at https://github.com/meta-pytorch/monarch.