This repository provides a PyTorch implementation of the Lion optimizer (Evolved Sign Momentum), an optimization algorithm for training neural networks that was automatically discovered through genetic program search by Google Brain. Lion claims to outperform AdamW on various benchmarks while being simpler in form. The implementation includes configurable hyperparameters for learning rate, weight decay, and beta values, along with guidance on adapting training schedules from AdamW to Lion.