Anthropic IPO filing warns of AI risks without safeguards

Anthropic warned in its IPO filing on Monday that advanced AI systems could pose catastrophic or existential risks to humanity if developed without proper safeguards, oversight, and security measures. The company said such systems could be misused, replicated, weaponised, or allowed to operate with high autonomy, echoing concerns raised by researchers, regulators, and policymakers. Anthropic also noted its AI models already accelerate its own research. The filing added that risks could increase if AI substantially automates AI research and development, potentially accelerating progress beyond the company's ability to evaluate and safeguard new models, which could adversely affect its business and financial results.