Reducing Reward Hacking by Localizing Bad Behavior Instead of Penalizing It

Record

Authors
Hu, S.; Ward, J.; Wong, A.; Hu, N.; Woodworth, B.; Turner, A. M.; Cloud, A.
Year
2026
Title
Reducing Reward Hacking by Localizing Bad Behavior Instead of Penalizing It
Type
Web page
Links
https://alignment.anthropic.com/2026/graft/
https://www.lesswrong.com/posts/mKJEBiuuxHKuCoTB6
Our note
Reducing Reward Hacking by Localizing Bad Behavior Instead of Penalizing It
Verification
url-ok: the web address responds (the page itself is not checked).
https://alignment.anthropic.com/2026/graft/: HTTP 200, checked 2026-11-14
https://www.lesswrong.com/posts/mKJEBiuuxHKuCoTB6: HTTP 200, checked 2026-11-14
Id
hu-2026-reducing-reward-hacking-by-localizing-bad

Cited on

As cited

The pages cite this work in one form.

  • Hu, S., Ward, J., Wong, A., Hu, N., Woodworth, B., Turner, A. M., and Cloud, A. (2026, October 19). Reducing Reward Hacking by Localizing Bad Behavior Instead of Penalizing It. Anthropic Alignment Science Blog. https://alignment.anthropic.com/2026/graft/ (crossposted as Gradient Routing Localizes and Removes Unintended Behaviors in RL, LessWrong, https://www.lesswrong.com/posts/mKJEBiuuxHKuCoTB6, with the comments cited above).

BibLaTeX

@online{hu-2026-reducing-reward-hacking-by-localizing-bad,
  author = {Hu, S. and Ward, J. and Wong, A. and Hu, N. and Woodworth, B. and Turner, A. M. and Cloud, A.},
  title = {{Reducing Reward Hacking by Localizing Bad Behavior Instead of Penalizing It}},
  date = {2026},
  url = {https://alignment.anthropic.com/2026/graft/}
}

Download · JSON with CSL-JSON · the whole bibliography