← all repositories

lucidrains/ema-pytorch

A PyTorch library for maintaining Exponential Moving Average versions of neural network models during training.

653 stars Python ML Frameworks
ema-pytorch
Velocity · 7d
+0.5
★ / day
Trend
steady
star history

This repository provides a wrapper to track and update an EMA version of a PyTorch model alongside the primary model during training. It includes warmup logic to delay EMA updates, configurable update frequencies to save compute, and support for post-hoc synthesized EMA as proposed by Karras et al. for improved model checkpointing.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.