Tracing Attention Computation Through Feature Interactions

Record

Authors
Kamath, H.; Ameisen, E.; et al.
Year
2025
Title
Tracing Attention Computation Through Feature Interactions
Published in
Transformer Circuits Thread
Type
Web page
Links
https://transformer-circuits.pub/2025/attention-qk/index.html
Our note
Tracing Attention Computation Through Feature Interactions
Verification
url-ok: the web address responds (the page itself is not checked).
https://transformer-circuits.pub/2025/attention-qk/index.html: HTTP 200, checked 2026-11-14
Id
kamath-2025-tracing-attention-computation-through-feature-interactions

Cited on

As cited

The pages cite this work in 4 forms.

  • Kamath, H., Ameisen, E., Kauvar, I., Luger, R., Gurnee, W., Pearce, A., Zimmerman, S., Batson, J., Conerly, T., Olah, C., and Lindsey, J. (2025). Tracing Attention Computation Through Feature Interactions. Transformer Circuits Thread, 31 July 2025. https://transformer-circuits.pub/2025/attention-qk/index.html. Section names in this note refer to the web version read in November 2026.
  • Kamath, H., Ameisen, E., Kauvar, I., et al. (2025, July 31). Tracing Attention Computation Through Feature Interactions. Transformer Circuits Thread. https://transformer-circuits.pub/2025/attention-qk/index.html
  • Kamath, H., Ameisen, E., et al. (2025). Tracing Attention Computation Through Feature Interactions. Transformer Circuits Thread, 31 July 2025. https://transformer-circuits.pub/2025/attention-qk/index.html
  • Kamath, H., Ameisen, E., et al. (2025, July 31). Tracing Attention Computation Through Feature Interactions. Transformer Circuits Thread. https://transformer-circuits.pub/2025/attention-qk/index.html

BibLaTeX

@online{kamath-2025-tracing-attention-computation-through-feature-interactions,
  author = {Kamath, H. and Ameisen, E. and others},
  title = {{Tracing Attention Computation Through Feature Interactions}},
  organization = {Transformer Circuits Thread},
  date = {2025},
  url = {https://transformer-circuits.pub/2025/attention-qk/index.html}
}

Download · JSON with CSL-JSON · the whole bibliography