IAAR-Shanghai/Awesome-Attention-Heads
A survey and curated list aggregating research on interpretability of attention heads in large language models.

Velocity · 7d
+0.6
★ / day
Trend
→steady
star history
This repository compiles and surveys research on LLM attention head interpretability, covering topics like circuit analysis, chain-of-thought reasoning, and machine psychology in transformers. It serves as a knowledge hub for researchers studying how attention mechanisms contribute to LLM capabilities and behaviors, providing organized references to academic papers on this emerging subfield of LLM research.