Provides a GradualWarmupScheduler for PyTorch that incrementally raises the learning rate over a specified number of epochs at the start of training, as proposed in the ‘Accurate, Large Minibatch SGD’ paper. It can be chained with other PyTorch schedulers such as StepLR or cosine annealing. This technique helps stabilize early training when using large batch sizes by preventing large gradient updates initially.