Record
- Authors
- Perez, E.; Ringer, S.; Lukošiūtė, K.; et al.
- Year
- 2022
- Title
- Discovering Language Model Behaviors with Model-Written Evaluations
- Published in
- arXiv
- Pages
- 13387–13434
- Type
- Preprint
- DOI
- 10.48550/arxiv.2212.09251
- arXiv
- arXiv:2212.09251
- Links
- https://aclanthology.org/2023.findings-acl.847
https://arxiv.org/abs/2212.09251
https://github.com/anthropics/evals
https://www.anthropic.com/research/discovering-language-model-behaviors-with-model-written-evaluations - Our note
- Discovering Language Model Behaviors with Model-Written Evaluations
- Verification
- verified: its identifier resolves to a record with the same title and author (checked against OpenAlex, 2026-11-14).
Identifiers found: OpenAlex W4312050653 · DOI 10.48550/arxiv.2212.09251 · arXiv:2212.09251 - From the lookup
- doi (the pages' own wording is under "As cited" below)
- Id
perez-2022-discovering-language-model-behaviors-model-written
The pages disagree on year, container: year 2022 or 2023; container Findings of ACL 2023 or Findings of the Association for Computational Linguistics: ACL 2023 or arXiv. The record above takes the most common value.
Cited on
- Challenges in evaluating AI systems read status: not stated
- Discovering Language Model Behaviors with Model-Written Evaluations for pp. 13387-13434 read status: not stated
- Evaluating and Mitigating Discrimination in Language Model Decisions read status: not stated
- Inverse Scaling in Test-Time Compute read status: not stated
- Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training read status: not stated
- Sycophancy to Subterfuge: Investigating Reward Tampering in Language Models read status: not stated
- Testing and mitigating elections-related risks read status: not stated
- The Hot Mess of AI: How Does Misalignment Scale with Model Intelligence and Task Complexity? read status: not stated
- Towards Understanding Sycophancy in Language Models read status: not stated
As cited
The pages cite this work in 6 forms.
-
Perez, E., Ringer, S., Lukošiūtė, K., et al. (2022). Discovering Language Model Behaviors with Model-Written Evaluations. arXiv:2212.09251.
-
Perez, E., Ringer, S., Lukošiūtė, K., Nguyen, K., Chen, E., et al. (2022). Discovering Language Model Behaviors with Model-Written Evaluations. arXiv:2212.09251. Published in Findings of the Association for Computational Linguistics: ACL 2023.
-
Perez, E., et al. (2023). Discovering Language Model Behaviors with Model-Written Evaluations. Findings of ACL 2023. arXiv:2212.09251.
-
Perez, E., Ringer, S., Lukošiūtė, K., Nguyen, K., Chen, E., Heiner, S., Pettit, C., Olsson, C., Kundu, S., Kadavath, S., et al. (2022). Discovering Language Model Behaviors with Model-Written Evaluations. arXiv:2212.09251v1, submitted 19 December 2022. https://arxiv.org/abs/2212.09251. Anthropic page: https://www.anthropic.com/research/discovering-language-model-behaviors-with-model-written-evaluations. Datasets: https://github.com/anthropics/evals
-
Perez, E., Ringer, S., Lukošiūtė, K., Nguyen, K., Chen, E., Heiner, S., et al. (2022). Discovering Language Model Behaviors with Model-Written Evaluations. arXiv:2212.09251.
-
Perez, E., et al. (2023). Discovering Language Model Behaviors with Model-Written Evaluations. In Findings of the Association for Computational Linguistics: ACL 2023, pp. 13387-13434. https://aclanthology.org/2023.findings-acl.847
BibLaTeX
@misc{perez-2022-discovering-language-model-behaviors-model-written,
author = {Perez, E. and Ringer, S. and Lukošiūtė, K. and others},
title = {{Discovering Language Model Behaviors with Model-Written Evaluations}},
date = {2022},
pages = {13387--13434},
doi = {10.48550/arxiv.2212.09251},
eprint = {2212.09251},
eprinttype = {arxiv},
url = {https://aclanthology.org/2023.findings-acl.847}
}