Superposition, Memorization, and Double Descent

Record

Authors
Henighan, T.; Carter, S.; Hume, T.; et al.
Year
2023
Title
Superposition, Memorization, and Double Descent
Published in
Transformer Circuits Thread
Type
Web page
Links
https://transformer-circuits.pub/2023/toy-double-descent/index.html
Our note
Superposition, Memorization, and Double Descent
Verification
url-ok: the web address responds (the page itself is not checked).
https://transformer-circuits.pub/2023/toy-double-descent/index.html: HTTP 200, checked 2026-11-14
Id
henighan-2023-superposition-memorization-double-descent

Cited on

As cited

The pages cite this work in 2 forms.

  • Henighan, T., Carter, S., Hume, T., Elhage, N., Lasenby, R., Fort, S., Schiefer, N., and Olah, C. (2023). Superposition, Memorization, and Double Descent. Transformer Circuits Thread, 5 January 2023. https://transformer-circuits.pub/2023/toy-double-descent/index.html. Section names in this note refer to the web version, which includes the comments summarized above.
  • Henighan, T., Carter, S., Hume, T., et al. (2023). Superposition, Memorization, and Double Descent. Transformer Circuits Thread. https://transformer-circuits.pub/2023/toy-double-descent/index.html. Cited for its regime description and the replication in its Comments section.

BibLaTeX

@online{henighan-2023-superposition-memorization-double-descent,
  author = {Henighan, T. and Carter, S. and Hume, T. and others},
  title = {{Superposition, Memorization, and Double Descent}},
  organization = {Transformer Circuits Thread},
  date = {2023},
  url = {https://transformer-circuits.pub/2023/toy-double-descent/index.html}
}

Download · JSON with CSL-JSON · the whole bibliography