lucidrains/ema-pytorch
A PyTorch library for maintaining Exponential Moving Average versions of neural network models during training.

Velocity · 7d
+0.5
★ / day
Trend
→steady
star history
This repository provides a wrapper to track and update an EMA version of a PyTorch model alongside the primary model during training. It includes warmup logic to delay EMA updates, configurable update frequencies to save compute, and support for post-hoc synthesized EMA as proposed by Karras et al. for improved model checkpointing.