Evaluating Language-Model Agents on Realistic Autonomous Tasks

Record

Authors
Kinniment, M.; Sato, L. J. K.; Du, H.; Goodrich, B.; Hasin, M.; Chan, L.; Miles, L. H.; Lin, T. R.; Wijk, H.; Burget, J.; Ho, A.; Barnes, E.; Christiano, P.
Year
2023
Title
Evaluating Language-Model Agents on Realistic Autonomous Tasks
Published in
arXiv
Type
Preprint
DOI
10.48550/arxiv.2312.11671
arXiv
arXiv:2312.11671
Links
https://arxiv.org/abs/2312.11671
Our note
none yet
Verification
verified: its identifier resolves to a record with the same title and author (checked against OpenAlex, 2026-11-14).
Identifiers found: OpenAlex W4390041563 · DOI 10.48550/arxiv.2312.11671 · arXiv:2312.11671
From the lookup
doi (the pages' own wording is under "As cited" below)
Id
kinniment-2023-evaluating-language-model-agents-realistic-autonomous

Cited on

As cited

The pages cite this work in one form.

  • Kinniment, M., Sato, L. J. K., Du, H., Goodrich, B., Hasin, M., Chan, L., Miles, L. H., Lin, T. R., Wijk, H., Burget, J., Ho, A., Barnes, E., and Christiano, P. (2023). Evaluating Language-Model Agents on Realistic Autonomous Tasks. METR (formerly ARC Evals). arXiv:2312.11671v2 (4 January 2024; v1 18 December 2023). https://arxiv.org/abs/2312.11671

BibLaTeX

@misc{kinniment-2023-evaluating-language-model-agents-realistic-autonomous,
  author = {Kinniment, M. and Sato, L. J. K. and Du, H. and Goodrich, B. and Hasin, M. and Chan, L. and Miles, L. H. and Lin, T. R. and Wijk, H. and Burget, J. and Ho, A. and Barnes, E. and Christiano, P.},
  title = {{Evaluating Language-Model Agents on Realistic Autonomous Tasks}},
  date = {2023},
  doi = {10.48550/arxiv.2312.11671},
  eprint = {2312.11671},
  eprinttype = {arxiv}
}

Download · JSON with CSL-JSON · the whole bibliography