This repository compiles research papers and linked implementations of efficient attention modules used in transformer architectures. It catalogs computational complexity, main ideas, and citations for approaches like memory-compressed attention, CBAM, Set Transformer, and related methods aimed at reducing self-attention’s quadratic complexity.