← all repositories

jessevig/bertviz

BertViz provides interactive visualizations of attention patterns in Transformer models within Jupyter/Colab notebooks.

8.1k stars Python LLMOps · EvalLanguage Models
bertviz
Velocity · 7d
+3.0
★ / day
Trend
steady
star history

BertViz is an interactive tool for visualizing attention in Transformer language models. It extends the Tensor2Tensor visualization tool to offer multiple views—including head view, model view, and neuron view—that help researchers and developers understand how attention flows through transformer layers. The tool provides a Python API compatible with most Huggingface models, running inside Jupyter or Colab notebooks.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.