Scaling Data-Constrained Language Models

Record

Authors
Muennighoff, N.; Rush, A. M.; Barak, B.; Le Scao, T.; Piktus, A.; Tazi, N.; Pyysalo, S.; Wolf, T.; Raffel, C.
Year
2023
Title
Scaling Data-Constrained Language Models
Published in
arXiv
Type
Preprint
DOI
10.52202/075280-2191
arXiv
arXiv:2305.16264
Our note
none yet
Verification
verified: its identifier resolves to a record with the same title and author (checked against OpenAlex, 2026-11-14).
Identifiers found: OpenAlex W7133188041 · DOI 10.52202/075280-2191
From the lookup
doi (the pages' own wording is under "As cited" below)
Id
muennighoff-2023-scaling-data-constrained-language-models

Cited on

As cited

The pages cite this work in one form.

  • Muennighoff, N., Rush, A. M., Barak, B., Le Scao, T., Piktus, A., Tazi, N., Pyysalo, S., Wolf, T., and Raffel, C. (2023). Scaling Data-Constrained Language Models. In Advances in Neural Information Processing Systems 36 (NeurIPS 2023). arXiv:2305.16264v5, 28 June 2025. Cited for later results on repeating a whole dataset; section and appendix numbers refer to arXiv v5.

BibLaTeX

@misc{muennighoff-2023-scaling-data-constrained-language-models,
  author = {Muennighoff, N. and Rush, A. M. and Barak, B. and Le Scao, T. and Piktus, A. and Tazi, N. and Pyysalo, S. and Wolf, T. and Raffel, C.},
  title = {{Scaling Data-Constrained Language Models}},
  date = {2023},
  doi = {10.52202/075280-2191},
  eprint = {2305.16264},
  eprinttype = {arxiv}
}

Download · JSON with CSL-JSON · the whole bibliography