← all repositories

facebookresearch/xformers

A research-first PyTorch library providing hackable, optimized transformer components with custom CUDA kernels.

10.5k stars Python ML FrameworksLanguage Models
xformers
Velocity · 7d
+6.2
★ / day
Trend
steady
star history

xFormers is a toolbox from Facebook Research that provides composable, reusable building blocks for constructing transformer architectures. It focuses on efficiency with custom CUDA kernels and aims to provide bleeding-edge components not yet available in mainstream libraries. The library is domain-agnostic, supporting vision, NLP, and other transformer-based research applications.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.