AI leaders urge UN caution as Anthropic CEO pledges to slow AI development
Leaders of major AI companies urged caution at the UN Security Council on Wednesday, warning that autonomous systems could outpace human oversight, with Anthropic's CEO pledging to slow development and OpenAI's chief calling for "extreme care." OpenAI CEO Sam Altman warned that as AI becomes more capable, it could move faster than institutions or concentrate power, urging governments to cooperate on shaping the technology's future. Anthropic CEO Dario Amodei said his company would slow releases as needed to ensure safety, adding that poorly managed AI could risk humanity. The briefing follows recent incidents, including a cyberattack on Hugging Face by autonomous OpenAI software and a researcher's departure accusing both firms of "gambling with our lives." The remarks come ahead of a Trump-Xi summit, though the US has rejected international AI regulation.