A Mathematical Framework for Transformer Circuits

Record

Authors
Elhage, N.; Nanda, N.; Olsson, C.; et al.
Year
2021
Title
A Mathematical Framework for Transformer Circuits
Published in
Transformer Circuits Thread, 22 December 2021
Type
Web page
Links
https://transformer-circuits.pub/2021/framework/index.html
Our note
A Mathematical Framework for Transformer Circuits
Verification
url-ok: the web address responds (the page itself is not checked).
https://transformer-circuits.pub/2021/framework/index.html: HTTP 200, checked 2026-11-14
Id
elhage-2021-mathematical-framework-transformer-circuits

Cited on

As cited

The pages cite this work in 7 forms.

  • Elhage, N., et al. (2021). A Mathematical Framework for Transformer Circuits. Transformer Circuits Thread. https://transformer-circuits.pub/2021/framework/index.html
  • Elhage, N., Nanda, N., Olsson, C., Henighan, T., Joseph, N., Mann, B., Askell, A., Bai, Y., Chen, A., Conerly, T., DasSarma, N., Drain, D., Ganguli, D., Hatfield-Dodds, Z., Hernandez, D., Jones, A., Kernion, J., Lovitt, L., Ndousse, K., Amodei, D., Brown, T., Clark, J., Kaplan, J., McCandlish, S., and Olah, C. (2021). A Mathematical Framework for Transformer Circuits. Transformer Circuits Thread, 22 December 2021. https://transformer-circuits.pub/2021/framework/index.html. Section names in this note refer to the web version, including its later correction and follow-up comments.
  • Elhage, N., Nanda, N., Olsson, C., Henighan, T., et al. (2021). A Mathematical Framework for Transformer Circuits. Transformer Circuits Thread. https://transformer-circuits.pub/2021/framework/index.html (Additional Resources; Author Contributions).
  • Elhage, N., Nanda, N., Olsson, C., Henighan, T., et al. (2021, December 22). A Mathematical Framework for Transformer Circuits. Transformer Circuits Thread. https://transformer-circuits.pub/2021/framework/index.html (Additional Resources; Author Contributions).
  • Elhage, N., Nanda, N., Olsson, C., et al. (2021). A Mathematical Framework for Transformer Circuits. Transformer Circuits Thread, 22 December 2021. https://transformer-circuits.pub/2021/framework/index.html
  • Elhage, N., Nanda, N., Olsson, C., et al. (2021). A Mathematical Framework for Transformer Circuits. Transformer Circuits Thread, 22 December 2021. https://transformer-circuits.pub/2021/framework/index.html. Sections "Additional Resources" and "Acknowledgments".
  • Elhage, N., Nanda, N., Olsson, C., et al. (2021). A Mathematical Framework for Transformer Circuits. Transformer Circuits Thread. https://transformer-circuits.pub/2021/framework/index.html

BibLaTeX

@online{elhage-2021-mathematical-framework-transformer-circuits,
  author = {Elhage, N. and Nanda, N. and Olsson, C. and others},
  title = {{A Mathematical Framework for Transformer Circuits}},
  organization = {Transformer Circuits Thread, 22 December 2021},
  date = {2021},
  url = {https://transformer-circuits.pub/2021/framework/index.html}
}

Download · JSON with CSL-JSON · the whole bibliography