Anthropic proposes AI safety bill allowing courts to block models posing catastrophic risks

What happened

Anthropic is circulating a draft AI safety bill that could block a model’s release over foreseeable, imminent risks involving more than 50 deaths or over a billion dollars in property damage, Politico reported. Covered risks involve biological weapons, models evading developer controls, or cyberattacks. Registered independent evaluators would have 72 hours to notify the Commerce Department, which would then need to ask a D.C. judge to halt release; federal agencies could not act alone.

The story so far

Anthropic is circulating a draft AI safety bill that would let courts halt model releases over foreseeable, imminent catastrophic risks, Politico reported. The proposal covers risks involving more than 50 deaths or over $1 billion in property damage arising from biological weapons, models evading developer controls, or cyberattacks. Registered independent evaluators would have 72 hours to notify the Commerce Department, which would then need to ask a judge in Washington, D.C., to halt a release. Federal agencies could not block a release on their own. An Anthropic spokesperson said the draft reflects proposals in the company’s Advanced AI Framework, which it has advocated for with federal and state lawmakers since June.

Keep reading

Trending now

1. 1Mistral Releases Voxtral 3 Speech Models, Voice Agents API and LiveKit-Based SDK
2. 2DeepSeek Open-Sources DeepInfer and API Components, With Model and Hardware Limits
3. 3OpenAI Acquires Orchestra Bio to Expand AI Tools for Drug Development
4. 4Google Rolls Out Gemini Personal Intelligence to Android Auto, With Google Built-In Cars to Follow