facebookresearch/xformers
A research-first PyTorch library providing hackable, optimized transformer components with custom CUDA kernels.

Velocity · 7d
+6.2
★ / day
Trend
→steady
star history
xFormers is a toolbox from Facebook Research that provides composable, reusable building blocks for constructing transformer architectures. It focuses on efficiency with custom CUDA kernels and aims to provide bleeding-edge components not yet available in mainstream libraries. The library is domain-agnostic, supporting vision, NLP, and other transformer-based research applications.