facebookresearch/xformers
A research-first PyTorch library providing hackable, optimized transformer components with custom CUDA kernels.

Not currently ranked — collecting fresh signals.
star history
xFormers is a toolbox from Facebook Research that provides composable, reusable building blocks for constructing transformer architectures. It focuses on efficiency with custom CUDA kernels and aims to provide bleeding-edge components not yet available in mainstream libraries. The library is domain-agnostic, supporting vision, NLP, and other transformer-based research applications.
Frequently asked
- What is facebookresearch/xformers?
- A research-first PyTorch library providing hackable, optimized transformer components with custom CUDA kernels.
- Is xformers open source?
- Yes — facebookresearch/xformers is an open-source project tracked on heatdrop.
- What language is xformers written in?
- facebookresearch/xformers is primarily written in Python.
- How popular is xformers?
- facebookresearch/xformers has 10.5k stars on GitHub.
- Where can I find xformers?
- facebookresearch/xformers is on GitHub at https://github.com/facebookresearch/xformers.