LongLoRA introduces a fine-tuning method that extends large language models’ context window to 100k+ tokens while using LoRA for computational efficiency. LongAlpaca provides models and training data specifically curated for long-context understanding tasks. The project includes training code, evaluation benchmarks, and pre-trained model weights released for research use.