Dario Amodei says Anthropic does not want open-weight AI banned, but it does want every sufficiently powerful model tested before release. Yet, he doesnt want to sign the coalition letter for open AI.
tl,dr Responding to criticism from across the industry, Amodei calls open models without dangerous capabilities a public good. He argues that banning their use by US companies would barely affect malicious actors. Instead, Anthropic supports three measures:
1) Keep powerful chips and chipmaking equipment out of China 2) Stop industrial-scale distillation of US models 3) Require safety testing for capable open and closed models Amodei also rejects the claim that openness automatically improves safety. Once weights are released, guardrails can be removed and the model cannot be withdrawn. In areas such as biology, he fears broader access may help attackers more than defenders.
Honestly, to me that sounds like: we don't want to ban open source AI. But actually, we would like to see it for Chinese models.