Separius/awesome-fast-attention
A curated list tracking academic papers and implementations of efficient attention mechanisms like Linformer, Longformer, and Reformer.
Not currently ranked — collecting fresh signals.
star history
This repository compiles research papers and linked implementations of efficient attention modules used in transformer architectures. It catalogs computational complexity, main ideas, and citations for approaches like memory-compressed attention, CBAM, Set Transformer, and related methods aimed at reducing self-attention’s quadratic complexity.
Frequently asked
- What is Separius/awesome-fast-attention?
- A curated list tracking academic papers and implementations of efficient attention mechanisms like Linformer, Longformer, and Reformer.
- Is awesome-fast-attention open source?
- Yes — Separius/awesome-fast-attention is open source, released under the GPL-3.0 license.
- What language is awesome-fast-attention written in?
- Separius/awesome-fast-attention is primarily written in Python.
- How popular is awesome-fast-attention?
- Separius/awesome-fast-attention has 1k stars on GitHub.
- Where can I find awesome-fast-attention?
- Separius/awesome-fast-attention is on GitHub at https://github.com/Separius/awesome-fast-attention.