Azure/MS-AMP
Automatic mixed precision library for training deep learning models with FP8 optimization.

Velocity · 7d
+0.5
★ / day
Trend
→steady
star history
MS-AMP is a Microsoft-developed library that automates mixed precision training for deep learning workloads. It optimizes training through FP8 precision and integrates with PyTorch to enable efficient large language model training. The library targets GPU-based training optimization and is documented alongside the FP8-LM research paper on training FP8 LLMs.