pytorch/gloo
A C++ collective communications library used as the distributed training backend for PyTorch.
Not currently ranked — collecting fresh signals.
star history
Gloo is a collective communications library that provides essential primitives for distributed machine learning training, including barrier, broadcast, and allreduce operations. It abstracts transport layers for IP and InfiniBand (or RoCE), supports GPUDirect for cross-machine GPU-to-GPU memory transfers without host-device copies, and works with both system memory and NVIDIA GPU memory buffers. It is the primary distributed communication backend for PyTorch.
Frequently asked
- What is pytorch/gloo?
- A C++ collective communications library used as the distributed training backend for PyTorch.
- Is gloo open source?
- Yes — pytorch/gloo is an open-source project tracked on heatdrop.
- What language is gloo written in?
- pytorch/gloo is primarily written in C++.
- How popular is gloo?
- pytorch/gloo has 1.4k stars on GitHub.
- Where can I find gloo?
- pytorch/gloo is on GitHub at https://github.com/pytorch/gloo.