Anthropic has been quietly showing members of Congress a draft federal AI safety law, which Politico obtained on October 16. It would impose binding duties on frontier AI developers and let the government ask a judge to halt a dangerous model, but only above a high bar, and it would override some state AI rules. The draft is a window into a central question in AI governance: who decides when an AI model is too dangerous, and how high should the bar be?

In this episode

• What the draft requires: safety frameworks, transparency reports, whistleblower protections, incident reporting and registered outside evaluators
• The narrow "emergency brake": imminent risk of more than $1 billion in damage or more than 50 deaths or serious injuries, decided by a federal judge
• How the draft's preemption of state laws compares with the more cautious stance in Anthropic's June framework
• Split reactions from AI policy researchers
• Caveats: a leaked draft, not introduced legislation, with details from one report

Bottom line

The draft would create binding federal duties and a court-supervised way to stop a dangerous model, while setting a high bar for that power and overriding some state rules. Supporters see a workable start; critics see a step back. Much depends on details not yet public.

Sources and further reading

• Politico: Anthropic's confidential draft bill (Oct. 16, 2026)
• AFP: Anthropic proposes law regulating AI (Oct. 17, 2026)
• Anthropic: Advanced AI Framework overview (June 2026)
• Anthropic: Advanced AI Framework, full text (PDF) (June 2026)
• Obernolte and Trahan introduce the FRONTIER Act (July 23, 2026)
• Nathan Calvin's response on X
• Daily AI Safety: The Policies Experts Rate Highest Are the Ones They Expect Least (Oct. 13, 2026)
• Daily AI Safety: A Fake Murder Tip From a Test (Oct. 11, 2026)

This post was written by Claude and fact checked by Nathan Nguyen.