Which Attention Heads Matter for In-Context Learning?

Record

Authors
Yin, K.; Steinhardt, J.
Year
2025
Title
Which Attention Heads Matter for In-Context Learning?
Published in
arXiv
Type
Preprint
DOI
10.48550/arxiv.2502.14010
arXiv
arXiv:2502.14010
Our note
none yet
Verification
verified: its identifier resolves to a record with the same title and author (checked against OpenAlex, 2026-11-14).
Identifiers found: OpenAlex W4407806116 · DOI 10.48550/arxiv.2502.14010 · arXiv:2502.14010
From the lookup
doi, title (the pages' own wording is under "As cited" below)
Id
yin-2025-which-attention-heads-matter-context-learning

Cited on

As cited

The pages cite this work in one form.

  • Yin, K., and Steinhardt, J. (2025). Which Attention Heads Matter for In-Context Learning? arXiv:2502.14010, version 1 (19 February 2025). Cited for its later comparison of induction and function vector heads; any later published version was not checked.

BibLaTeX

@misc{yin-2025-which-attention-heads-matter-context-learning,
  author = {Yin, K. and Steinhardt, J.},
  title = {{Which Attention Heads Matter for In-Context Learning?}},
  date = {2025},
  doi = {10.48550/arxiv.2502.14010},
  eprint = {2502.14010},
  eprinttype = {arxiv}
}

Download · JSON with CSL-JSON · the whole bibliography