← all repositories

facebookresearch/xformers

A research-first PyTorch library providing hackable, optimized transformer components with custom CUDA kernels.

10.5k stars Python ML FrameworksLanguage Models
xformers
Not currently ranked — collecting fresh signals.
star history

xFormers is a toolbox from Facebook Research that provides composable, reusable building blocks for constructing transformer architectures. It focuses on efficiency with custom CUDA kernels and aims to provide bleeding-edge components not yet available in mainstream libraries. The library is domain-agnostic, supporting vision, NLP, and other transformer-based research applications.

Frequently asked

What is facebookresearch/xformers?
A research-first PyTorch library providing hackable, optimized transformer components with custom CUDA kernels.
Is xformers open source?
Yes — facebookresearch/xformers is an open-source project tracked on heatdrop.
What language is xformers written in?
facebookresearch/xformers is primarily written in Python.
How popular is xformers?
facebookresearch/xformers has 10.5k stars on GitHub.
Where can I find xformers?
facebookresearch/xformers is on GitHub at https://github.com/facebookresearch/xformers.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.