Lightning-AI/lightning-thunder
A source-to-source PyTorch compiler that optimizes deep learning models for training and inference through transformations, kernel fusion, and distributed strategies.

Lightning Thunder is a PyTorch compiler that transforms models into optimized implementations through source-to-source compilation. It provides a Pythonic intermediate representation capturing the full computation, along with a system of transforms that operate on the IR, model, and weights simultaneously. The compiler supports quantization, mixed precision (FP4/FP6/FP8), distributed training strategies (TP/PP/DP), kernel fusion, and custom Triton kernels, bundling these optimizations into composable recipes for easy application across different models.
Frequently asked
- What is Lightning-AI/lightning-thunder?
- A source-to-source PyTorch compiler that optimizes deep learning models for training and inference through transformations, kernel fusion, and distributed strategies.
- Is lightning-thunder open source?
- Yes — Lightning-AI/lightning-thunder is open source, released under the Apache-2.0 license.
- What language is lightning-thunder written in?
- Lightning-AI/lightning-thunder is primarily written in Python.
- How popular is lightning-thunder?
- Lightning-AI/lightning-thunder has 1.5k stars on GitHub.
- Where can I find lightning-thunder?
- Lightning-AI/lightning-thunder is on GitHub at https://github.com/Lightning-AI/lightning-thunder.