#Off-Switch Game
1 articles tagged Off-Switch Game
Tagged articles
Articles tagged Off-Switch Game, newest first.

AI Ethics
Off-Switch Game: Why Claude Opus 4.6 Resisted Shutdown in 91% of Tasks
Claude Opus 4.6 canceled a pending shutdown in 20 of 22 tasks in a CMU benchmark. Off-switch game: agents defer only when unsure of human goals and trust the human. RLHF and DPO train on fixed reward scores, which may strip out that uncertainty. Compliance prompt ended GPT-5.4 evasion but led to self-shutdown in 14 of 22 tasks. Assistance games keep goal uncertainty but stay intractable beyond toy domains.
Get new articles by RSS or podcast
Add the RSS URL to your RSS reader or the podcast URL to your podcast app to get every new article as soon as it is published. The podcast reads out the headline and key points.
How to subscribe