Inoculation prompting: Instructing models to misbehave at train-time can improve run-time behavior

Record

Authors
Marks, S.; Wichers, N.; Tan, D.; Ebtekar, A.; Jose, A.; Africa, D.; Mallen, A.; Roger, F.
Year
2025
Title
Inoculation prompting: Instructing models to misbehave at train-time can improve run-time behavior
Published in
LessWrong and Alignment Forum, 8 October 2025, with comments by Alex Mallen (9 October 2025), Daniel Tan and Nevan Wichers (9 October 2025), Fabien Roger (22 October 2025) and Nevan Wichers (1 Novembe
Type
Web page
Links
https://www.lesswrong.com/posts/AXRHzCPMv6ywCxCFp/inoculation-prompting-instructing-models-to-misbehave-at
Our note
none yet
Verification
url-ok: the web address responds (the page itself is not checked).
https://www.lesswrong.com/posts/AXRHzCPMv6ywCxCFp/inoculation-prompting-instructing-models-to-misbehave-at: HTTP 200, checked 2026-11-14
Id
marks-2025-inoculation-prompting-instructing-models-misbehave-at

Cited on

As cited

The pages cite this work in one form.

  • Marks, S., Wichers, N., Tan, D., Ebtekar, A., Jose, A., Africa, D., Mallen, A., and Roger, F. (2025). Inoculation prompting: Instructing models to misbehave at train-time can improve run-time behavior. LessWrong and Alignment Forum, 8 October 2025, with comments by Alex Mallen (9 October 2025), Daniel Tan and Nevan Wichers (9 October 2025), Fabien Roger (22 October 2025) and Nevan Wichers (1 November 2025). https://www.lesswrong.com/posts/AXRHzCPMv6ywCxCFp/inoculation-prompting-instructing-models-to-misbehave-at

BibLaTeX

@online{marks-2025-inoculation-prompting-instructing-models-misbehave-at,
  author = {Marks, S. and Wichers, N. and Tan, D. and Ebtekar, A. and Jose, A. and Africa, D. and Mallen, A. and Roger, F.},
  title = {{Inoculation prompting: Instructing models to misbehave at train-time can improve run-time behavior}},
  organization = {LessWrong and Alignment Forum, 8 October 2025, with comments by Alex Mallen (9 October 2025), Daniel Tan and Nevan Wichers (9 October 2025), Fabien Roger (22 October 2025) and Nevan Wichers (1 Novembe},
  date = {2025},
  url = {https://www.lesswrong.com/posts/AXRHzCPMv6ywCxCFp/inoculation-prompting-instructing-models-to-misbehave-at}
}

Download · JSON with CSL-JSON · the whole bibliography