AI leaders warn of narrowing window to prepare for rapid AI-driven progress
OpenAI, Anthropic, and Microsoft leaders warn that AI's ability to automate its own development could accelerate progress faster than governments can prepare, potentially triggering an "intelligence explosion." A new white paper highlights that AI systems are already automating significant engineering and R&D tasks, edging closer to recursive self-improvement. This could enable a developer to support an AI workforce equal to millions of top human researchers, compressing a year's advances into weeks. The researchers, including Geoffrey Hinton, call for greater visibility into AI development and mechanisms to pause or slow certain work. They acknowledge uncertainty but stress that once the intelligence explosion begins, the window for action may close.