Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Models

Record

Authors
Denison, C.; MacDiarmid, M.; Barez, F.; Duvenaud, D.; Kravec, S.; Marks, S.; Schiefer, N.; Soklaski, R.; Tamkin, A.; Kaplan, J.; Shlegeris, B.; Bowman, S. R.; Perez, E.; Hubinger, E.
Year
2024
Title
Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Models
Published in
arXiv
Type
Preprint
DOI
10.48550/arxiv.2406.10162
arXiv
arXiv:2406.10162
Links
https://arxiv.org/abs/2406.10162
https://github.com/anthropics/sycophancy-to-subterfuge-paper
https://www.anthropic.com/research/reward-tampering
Our note
Sycophancy to Subterfuge: Investigating Reward Tampering in Language Models
Verification
verified: its identifier resolves to a record with the same title and author (checked against OpenAlex, 2026-11-14).
Identifiers found: OpenAlex W4399795554 · DOI 10.48550/arxiv.2406.10162 · arXiv:2406.10162
From the lookup
doi, title (the pages' own wording is under "As cited" below)
Id
denison-2024-sycophancy-subterfuge-investigating-reward-tampering-language

Cited on

As cited

The pages cite this work in 2 forms.

  • Denison, C., MacDiarmid, M., Barez, F., Duvenaud, D., Kravec, S., Marks, S., Schiefer, N., Soklaski, R., Tamkin, A., Kaplan, J., Shlegeris, B., Bowman, S. R., Perez, E., and Hubinger, E. (2024). Sycophancy to Subterfuge: Investigating Reward Tampering in Language Models. arXiv:2406.10162v3, 29 June 2024. Anthropic, Redwood Research, University of Oxford. https://arxiv.org/abs/2406.10162. Anthropic page: https://www.anthropic.com/research/reward-tampering. Prompts, environments and samples: https://github.com/anthropics/sycophancy-to-subterfuge-paper
  • Denison, C., MacDiarmid, M., Barez, F., Duvenaud, D., Kravec, S., Marks, S., et al. (2024). Sycophancy to Subterfuge: Investigating Reward Tampering in Language Models. arXiv:2406.10162.

BibLaTeX

@misc{denison-2024-sycophancy-subterfuge-investigating-reward-tampering-language,
  author = {Denison, C. and MacDiarmid, M. and Barez, F. and Duvenaud, D. and Kravec, S. and Marks, S. and Schiefer, N. and Soklaski, R. and Tamkin, A. and Kaplan, J. and Shlegeris, B. and Bowman, S. R. and Perez, E. and Hubinger, E.},
  title = {{Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Models}},
  date = {2024},
  doi = {10.48550/arxiv.2406.10162},
  eprint = {2406.10162},
  eprinttype = {arxiv},
  url = {https://github.com/anthropics/sycophancy-to-subterfuge-paper}
}

Download · JSON with CSL-JSON · the whole bibliography