Progress on Attention

Record

Authors
Jermyn, A.; Lindsey, J.; Luger, R.; Turner, N.; et al.
Year
2025
Title
Progress on Attention
Published in
Transformer Circuits Thread
Type
Web page
Links
https://transformer-circuits.pub/2025/attention-update/index.html
Our note
Progress on Attention
Verification
url-ok: the web address responds (the page itself is not checked).
https://transformer-circuits.pub/2025/attention-update/index.html: HTTP 200, checked 2026-11-14
Id
jermyn-2025-progress-attention

Cited on

As cited

The pages cite this work in 5 forms.

  • Jermyn, A., Lindsey, J., Luger, R., Turner, N., Bricken, T., Pearce, A., McDougall, C., Thompson, B., Wu, J., Batson, J., Rivoire, K., and Olah, C.; edited by Lindsey, J. (2025). Progress on Attention. Transformer Circuits Thread, April 2025. https://transformer-circuits.pub/2025/attention-update/index.html. Section names in this note refer to the web version read in November 2026.
  • Jermyn, A., Lindsey, J., Luger, R., Turner, N., et al. (2025). Progress on Attention. Transformer Circuits Thread, April 2025. https://transformer-circuits.pub/2025/attention-update/index.html
  • Jermyn, A., Lindsey, J., Luger, R., Turner, N., et al. (2025). Progress on Attention. Transformer Circuits Thread. https://transformer-circuits.pub/2025/attention-update/index.html
  • Jermyn, A., Lindsey, J., Luger, R., et al. (2025, April). Progress on Attention. Transformer Circuits Thread. https://transformer-circuits.pub/2025/attention-update/index.html
  • Jermyn, A., et al. (2025). Progress on Attention. Transformer Circuits Thread. https://transformer-circuits.pub/2025/attention-update/index.html

BibLaTeX

@online{jermyn-2025-progress-attention,
  author = {Jermyn, A. and Lindsey, J. and Luger, R. and Turner, N. and others},
  title = {{Progress on Attention}},
  organization = {Transformer Circuits Thread},
  date = {2025},
  url = {https://transformer-circuits.pub/2025/attention-update/index.html}
}

Download · JSON with CSL-JSON · the whole bibliography