← all repositories

IAAR-Shanghai/Awesome-Attention-Heads

A survey and curated list aggregating research on interpretability of attention heads in large language models.

409 stars TeX LearningLanguage Models
Awesome-Attention-Heads
Velocity · 7d
+0.6
★ / day
Trend
steady
star history

This repository compiles and surveys research on LLM attention head interpretability, covering topics like circuit analysis, chain-of-thought reasoning, and machine psychology in transformers. It serves as a knowledge hub for researchers studying how attention mechanisms contribute to LLM capabilities and behaviors, providing organized references to academic papers on this emerging subfield of LLM research.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.