16 October 2026 · Anthropic / US Congress
Anthropic writes its own AI bill: a stop only above 50 victims or a billion dollars
Anthropic has quietly shown members of the US Congress a draft federal AI law of its own, Politico reported on 16 October, citing three people. Under the draft, the government could block a model only for a foreseeable and imminent risk of more than 1 billion dollars in damage or more than 50 people killed or seriously injured, and only if that risk comes from a biological weapon, a model escaping its developer's control, or a cyberattack. Only the Commerce Department could then go to a federal judge in Washington. The text is not public and has not been introduced.
PoliticsDevelopingThe story is still developing. There is one source so far, or the numbers are still changing.
What happened
The draft applies to what it calls covered developers: companies that train a model with more than 10^25 FLOP, a measure of the computing used in training, and that also earn more than 500 million dollars a year from AI or spend more than 1 billion dollars a year on AI research. Those are the same thresholds as in the Advanced AI Framework Anthropic published in June. Anthropic says the draft reflects the proposals in that framework.
Those companies would have to publish a safety framework for catastrophic risks, publish reports on what their models can do and how they were tested, report serious safety incidents, and protect whistleblowers. Independent evaluators, registered with the Commerce Department, would periodically review the labs and their models. The labs may pay them, but the payment may not depend on the outcome. If an evaluator finds an imminent risk in one of the three categories, it must tell Commerce within 72 hours.
Commerce can then ask a federal judge in the District of Columbia to suspend the model. The reported text bars every other US department, agency or officer from suspending a model's development, deployment or internal use. An Anthropic spokesperson calls the proposals sensible policy.
The draft would also set aside state laws on public risk disclosure, outside evaluation and incident reporting. That touches laws such as California's SB 53, which Anthropic backed in September 2025, and New York's RAISE Act. Anthropic's own framework from June says Congress should only do that with a federal regime that meets or exceeds the strongest measures in that framework.
What falls outside the stop. Read literally, the trigger leaves out every risk below 50 victims or a billion dollars, however widespread. It leaves out every risk outside the three categories: fraud and scams, disinformation and election interference, discrimination in hiring, lending or policing, privacy and surveillance, chemical, radiological and nuclear risks unless they fit under biology, job losses and market manipulation, and smaller-scale hacking. It leaves out risks that are building up slowly, or that nobody can yet call foreseeable and imminent. And it leaves out smaller labs and models below the thresholds.
That does not mean those harms are unregulated. The disclosure and evaluation duties still apply to the covered labs, and other law still exists. It means that this bill's stop does not reach them.
How it workedtechnical detail
The June framework names four risk categories for its obligations: biological weapons, offensive cyber operations, loss of control, and automated research and development. The trigger to block a model, as reported, names three. Automated AI research is not among them.
Nathan Calvin of Encode adds two procedural points, quoted by Zvi Mowshowitz. Commerce must make a detailed determination without deference from the court. And the court must weigh the harm to the developer, but not the harm of doing nothing.
An analysis on LessWrong, by a user called ModelMirror, reads the same procedure the other way. The Secretary of Commerce has to start the case, carries the burden of proof, and must show that the order is the least restrictive option. An order lapses after 45 days. But because the bill writes out an explicit path to a federal stop, the author argues a stop could become more likely than under current law. The same analysis points to section 12(a)(2), which says the section does not affect authority under any other law. How that fits with the ban on other agencies is not clear from the reports.
Critics compare the draft with the FRONTIER Act, a bipartisan bill introduced in July by Jay Obernolte and Lori Trahan, among others. Charlie Bullock of the Institute for Law & AI writes that the Anthropic draft is weaker on rulemaking and emergency shutdown powers, and has some improvements, such as how auditors are kept on.
What came before
The proposals that were already on the table are in the superintelligence ban and the off switch. A week before Politico, Axios reported that the companies are preparing for the law that would follow a first catastrophe. Until now, American AI regulation ran mostly through the states, and that is exactly the level this draft would push aside.
What may follow
What it means for Europe is a reading, not something any source reports. A US federal law does not change what applies here. A model offered in the EU answers to the AI Act regardless.
The AI Act uses the same 10^25 FLOP line, but as a presumption that a general-purpose model carries systemic risk (article 51), without a revenue filter. Those providers have had to evaluate their models, assess and mitigate risks, and report serious incidents to the AI Office since August 2025. Since 2 August 2026 the Commission can enforce that. Under article 93 it can, after an evaluation that raises serious and substantiated concern about a systemic risk, order mitigations or restrict, withdraw or recall a model. Under article 101 it can fine up to 3 percent of worldwide turnover or 15 million euro. The text has no floor in victims or dollars, and no list of three categories.
So on paper Brussels can act on a model earlier than Washington could under this draft. The reverse also holds. The AI Act is market law and does not reach a model that is only used inside a company. The July break-in came from exactly such an internal prototype, see what the AI Act does not do. The American draft does name internal use.
A second reading. If the draft passed with its preemption, California and New York would lose rules that look most like the European ones. Brussels would then be the strictest regulator these labs answer to, with an AI Office that Lawfare describes as underresourced for its task. The public reports the draft requires would also be readable in Europe, and Europe currently knows mostly what the companies choose to say.
Whether Washington would use such a law to push Brussels towards the same narrow trigger is in no source. Anthropic said in July 2025 that it intends to sign the EU's code of practice for these models.
What I do not know
The draft text is not public. I have not read the Politico article itself. Everything about the draft rests on Politico's copy, through Reuters and secondary coverage. The thresholds for covered developers I checked only against the June framework, not against the draft.
I read Zvi Mowshowitz and the LessWrong analysis in excerpts, not end to end. The FRONTIER Act text I have not read.
I found no reaction from the European Commission, the AI Office or a Belgian government body as of 18 October.
Whether the incidents in this dossier would have reached the trigger cannot be settled from here. For most of them there is no public damage figure in dollars. For the French supermarkets, NOS wrote many millions, not a billion. They are not attributed to an AI model either.
“Congress should not preempt state law unless it enacts a rigorous federal regime that meets or exceeds the strongest measures proposed in this framework for addressing catastrophic AI risks.”
Anthropic · Advanced AI Framework, June 2026
“Not remotely close to meeting the moment.”
Nathan Calvin · Encode, quoted by Zvi Mowshowitz
Read next
- AI companies rehearse the day after a major incident
- Sanders and Casar propose a ban on artificial superintelligence
- Fifteen state attorneys general turn towards OpenAI
- Europe postpones its own AI rules, six days after the Hugging Face break-in becomes public
- French supermarket fridges hit 50 degrees, Albert Heijn and Delhaize go offline
- Anthropic puts 5 percent of its shares in a fund for the public good
Sources
- Reuters via Yahoo Finance: Anthropic quietly pitches its own AI safety bill to lawmakers, Politico reportspress · main source
16 October 2026. Reuters relays Politico, which cites three people. Source for the 1 billion dollars, the 50 victims, the three categories, the evaluators paid regardless of outcome, the 72 hours, the court in Washington and the bar on other agencies. Neither Anthropic nor Commerce answered Reuters. The Politico article itself was not found or read.
- Anthropic: Advanced AI Framework, June 2026primary
The framework the draft builds on. Source for the 10^25 FLOP, the 500 million and 1 billion dollar thresholds, the four risk categories and the sentence on preemption. It is not the draft itself.
- Zvi Mowshowitz: Leaked Anthropic draft AI regulatory bill is unacceptable and troublingargument · not read end to end yet
17 October 2026. Read in excerpts. Source for the comparison with the June framework and the FRONTIER Act, and for the lines from Nathan Calvin, Charlie Bullock and Alex Bores.
- LessWrong, ModelMirror: Important details in the leaked Anthropic draft AI billargument · not read end to end yet
17 October 2026. Read in excerpts. The reading that an explicit path could make a federal stop more likely, the 45 days, sections 12(a)(2) and 14, and the effect on SB 53 and the RAISE Act.
- Crypto Briefing: Anthropic's AI safety bill draws fire over its frontier compute linepress
17 October 2026. On criticism of the 10^25 FLOP line and the comparison with the AI Act, where the same figure is a presumption rather than a hard trigger. Names no critics.
- NBC News: Anthropic backs California bill that would mandate AI transparency measurespress · not read end to end yet
September 2025. Background for Anthropic's earlier support of SB 53.
- AI Act Service Desk: article 51, classification of general-purpose models with systemic riskprimary
- AI Act Service Desk: article 93, power to request measuresprimary
The Commission's power to order mitigations or restrict, withdraw or recall a model with systemic risk.
- AI Act Service Desk: article 101, fines for providers of general-purpose modelsprimary
- Lawfare, Joel Christoph: How much power does the EU AI Office actually have?research
18 May 2026. On the powers that became enforceable on 2 August 2026, and on an office that is underresourced for its mandate. Written before the Anthropic draft.
- Anthropic: Anthropic to sign the EU Code of Practiceprimary
21 July 2025. A stated intention to sign. Whether and when it signed is not checked here.