In-context Learning and Induction Heads

Record

Authors
Olsson, C.; Elhage, N.; Nanda, N.; Joseph, N.; et al.
Year
2022
Title
In-context Learning and Induction Heads
Published in
arXiv
Type
Web page
DOI
10.48550/arxiv.2209.11895
arXiv
arXiv:2209.11895
Links
https://transformer-circuits.pub/2022/in-context-learning-and-induction-heads/index.html
Our note
In-context Learning and Induction Heads
Verification
verified: its identifier resolves to a record with the same title and author (checked against OpenAlex, 2026-11-14).
Identifiers found: OpenAlex W4297412003 · DOI 10.48550/arxiv.2209.11895 · arXiv:2209.11895
https://transformer-circuits.pub/2022/in-context-learning-and-induction-heads/index.html: HTTP 200, checked 2026-11-14
From the lookup
doi (the pages' own wording is under "As cited" below)
Id
olsson-2022-context-learning-induction-heads

The pages disagree on container: container Transformer Circuits Thread or arXiv. The record above takes the most common value.

Cited on

As cited

The pages cite this work in 4 forms.

  • Olsson, C., Elhage, N., Nanda, N., Joseph, N., DasSarma, N., Henighan, T., Mann, B., Askell, A., Bai, Y., Chen, A., Conerly, T., Drain, D., Ganguli, D., Hatfield-Dodds, Z., Hernandez, D., Johnston, S., Jones, A., Kernion, J., Lovitt, L., Ndousse, K., Amodei, D., Brown, T., Clark, J., Kaplan, J., McCandlish, S., and Olah, C. (2022). In-context Learning and Induction Heads. Transformer Circuits Thread, 8 March 2022. https://transformer-circuits.pub/2022/in-context-learning-and-induction-heads/index.html (also arXiv:2209.11895). Section names in this note refer to the web version.
  • Olsson, C., Elhage, N., Nanda, N., Joseph, N., et al. (2022). In-context Learning and Induction Heads. Transformer Circuits Thread. https://transformer-circuits.pub/2022/in-context-learning-and-induction-heads/index.html (Author Contributions).
  • Olsson, C., Elhage, N., Nanda, N., Joseph, N., et al. (2022, March 8). In-context Learning and Induction Heads. Transformer Circuits Thread. https://transformer-circuits.pub/2022/in-context-learning-and-induction-heads/index.html (Author Contributions).
  • Olsson, C., Elhage, N., Nanda, N., et al. (2022). In-context Learning and Induction Heads. Transformer Circuits Thread. https://transformer-circuits.pub/2022/in-context-learning-and-induction-heads/index.html. Cited for its abstract.

BibLaTeX

@online{olsson-2022-context-learning-induction-heads,
  author = {Olsson, C. and Elhage, N. and Nanda, N. and Joseph, N. and others},
  title = {{In-context Learning and Induction Heads}},
  organization = {arXiv},
  date = {2022},
  doi = {10.48550/arxiv.2209.11895},
  eprint = {2209.11895},
  eprinttype = {arxiv},
  url = {https://transformer-circuits.pub/2022/in-context-learning-and-induction-heads/index.html}
}

Download · JSON with CSL-JSON · the whole bibliography