← all repositories

Oneflow-Inc/libai

A distributed training toolbox based on OneFlow for large-scale deep learning model parallelism across data, tensor, and pipeline dimensions.

403 stars Python ML Frameworks
libai
Velocity · 7d
+0.2
★ / day
Trend
steady
star history

LiBai is a large-scale open-source model training framework built on OneFlow. It provides multiple parallelism strategies including Data Parallelism, Tensor Parallelism, and Pipeline Parallelism, along with training techniques such as mixed precision training, activation checkpointing, gradient accumulation, and ZeRO optimizer. The toolbox supports both computer vision and NLP tasks with predefined datasets like CIFAR, ImageNet, and BERT.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.