xLSTM is a new RNN architecture based on the original LSTM that incorporates Exponential Gating with normalization and stabilization techniques along with a new Matrix Memory to overcome traditional LSTM limitations. The architecture demonstrates competitive performance on language modeling tasks compared to Transformers and State Space Models. The repository includes training code and a 7B parameter xLSTM Large model trained on 2.3T tokens.