Predictability and Surprise in Large Generative Models

Record

Authors
Ganguli, D.; Hernandez, D.; Lovitt, L.; DasSarma, N.; Henighan, T.; Jones, A.; Joseph, N.; Kernion, J.; Mann, B.; Askell, A.; Bai, Y.; Chen, A.; Conerly, T.; Drain, D.; Elhage, N.; El Showk, S.; Fort, S.; Hatfield-Dodds, Z.; Johnston, S.; Kravec, S.; Nanda, N.; Ndousse, K.; Olsson, C.; Amodei, D.; Brown, T.; Kaplan, J.; McCandlish, S.; Olah, C.; Amodei, D.; Clark, J.
Year
2022
Title
Predictability and Surprise in Large Generative Models
Published in
arXiv
Type
Preprint
DOI
10.1145/3531146.3533229
arXiv
arXiv:2202.07785
Links
https://doi.org/10.1145/3531146.3533229
Our note
none yet
Verification
verified: its identifier resolves to a record with the same title and author (checked against OpenAlex, 2026-11-14).
Identifiers found: OpenAlex W4283157303 · DOI 10.1145/3531146.3533229
Id
ganguli-2022-predictability-surprise-large-generative-models

Cited on

As cited

The pages cite this work in one form.

  • Ganguli, D., Hernandez, D., Lovitt, L., DasSarma, N., Henighan, T., Jones, A., Joseph, N., Kernion, J., Mann, B., Askell, A., Bai, Y., Chen, A., Conerly, T., Drain, D., Elhage, N., El Showk, S., Fort, S., Hatfield-Dodds, Z., Johnston, S., Kravec, S., Nanda, N., Ndousse, K., Olsson, C., Amodei, D., Brown, T., Kaplan, J., McCandlish, S., Olah, C., Amodei, D., and Clark, J. (2022). Predictability and Surprise in Large Generative Models. In 2022 ACM Conference on Fairness, Accountability, and Transparency (FAccT '22), Seoul. https://doi.org/10.1145/3531146.3533229. arXiv:2202.07785v2, 3 October 2022. Section, figure and appendix numbers in this note refer to the arXiv v2 PDF, which its arXiv listing describes as the version accepted at FAccT '22 with peer-review feedback; the ACM PDF itself could not be retrieved for comparison. Against v1 (15 February 2022), v2 changes "unusual combination" to "paradoxical combination" in the thesis, gives the Figure 4 assistant as 52 billion parameters (v1: 50 billion) and rewords the author contributions; the numbers reported in this note are the same in both.

BibLaTeX

@misc{ganguli-2022-predictability-surprise-large-generative-models,
  author = {Ganguli, D. and Hernandez, D. and Lovitt, L. and DasSarma, N. and Henighan, T. and Jones, A. and Joseph, N. and Kernion, J. and Mann, B. and Askell, A. and Bai, Y. and Chen, A. and Conerly, T. and Drain, D. and Elhage, N. and El Showk, S. and Fort, S. and Hatfield-Dodds, Z. and Johnston, S. and Kravec, S. and Nanda, N. and Ndousse, K. and Olsson, C. and Amodei, D. and Brown, T. and Kaplan, J. and McCandlish, S. and Olah, C. and Amodei, D. and Clark, J.},
  title = {{Predictability and Surprise in Large Generative Models}},
  date = {2022},
  doi = {10.1145/3531146.3533229},
  eprint = {2202.07785},
  eprinttype = {arxiv}
}

Download · JSON with CSL-JSON · the whole bibliography