open-gigaai/giga-train
A distributed training framework for AI models supporting DeepSpeed, FSDP, DDP, and mixed precision optimization.
Not currently ranked — collecting fresh signals.
star history
GigaTrain provides an efficient and scalable training framework for developing large AI models. It offers unified distributed training across multi-GPU and multi-node environments, supporting DeepSpeed ZeRO, FSDP, FSDP2, and DDP strategies. The framework includes mixed precision training (FP16/BF16/FP8), gradient accumulation and checkpointing, EMA, built-in monitoring, and robust checkpointing for resumable long runs. It uses a registry-driven modular design with pluggable components for optimizers, schedulers, and transforms.
Frequently asked
- What is open-gigaai/giga-train?
- A distributed training framework for AI models supporting DeepSpeed, FSDP, DDP, and mixed precision optimization.
- Is giga-train open source?
- Yes — open-gigaai/giga-train is open source, released under the Apache-2.0 license.
- What language is giga-train written in?
- open-gigaai/giga-train is primarily written in Python.
- How popular is giga-train?
- open-gigaai/giga-train has 1.1k stars on GitHub.
- Where can I find giga-train?
- open-gigaai/giga-train is on GitHub at https://github.com/open-gigaai/giga-train.