← all repositories

open-gigaai/giga-train

A distributed training framework for AI models supporting DeepSpeed, FSDP, DDP, and mixed precision optimization.

1.1k stars Python ML Frameworks
giga-train
Velocity · 7d
+4.2
★ / day
Trend
steady
star history

GigaTrain provides an efficient and scalable training framework for developing large AI models. It offers unified distributed training across multi-GPU and multi-node environments, supporting DeepSpeed ZeRO, FSDP, FSDP2, and DDP strategies. The framework includes mixed precision training (FP16/BF16/FP8), gradient accumulation and checkpointing, EMA, built-in monitoring, and robust checkpointing for resumable long runs. It uses a registry-driven modular design with pluggable components for optimizers, schedulers, and transforms.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.