← all repositories

lessw2020/Ranger-Deep-Learning-Optimizer

A PyTorch deep learning optimizer that synergistically combines RAdam, LookAhead, and Gradient Centralization techniques.

1.2k stars Python ML Frameworks
Ranger-Deep-Learning-Optimizer
Velocity · 7d
+0.5
★ / day
Trend
steady
star history

Ranger is a Python optimizer library for training deep neural networks. It integrates three optimization techniques—RAdam (Rectified Adam) for adaptive learning rate scheduling, LookAhead for soft weight updates, and Gradient Centralization for improved training stability and efficiency. The optimizer is designed for PyTorch and provides configurable options to enable or disable individual components, with default settings optimized for a 75% flat learning rate followed by a step-down phase.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.