California orders AI 'kill switch' plan for frontier models

qz.com

California Governor Gavin Newsom issued an executive order Friday directing a working group to develop recommendations for strengthening state AI safety laws, including a potential requirement for companies to build a "kill switch" to shut down frontier AI models in an emergency. The group has two months to deliver its guide. Potential measures include obligations for independent third parties to produce safety plans and a requirement that AI developers retain the ability to deactivate their systems on demand. Newsom criticized the federal government for failing to act, saying "the stakes are too high to wait or delay action." The order also calls for faster implementation of two AI-related laws the legislature approved this year The executive order comes amid an escalating debate over federal AI regulation, with Newsom criticizing both Congress and President Donald Trump for failing to act. Earlier this month, Newsom signed two bills into law establishing the first U.S. framework requiring independent third-party audits of AI systems, backed by Anthropic and OpenAI. A bipartisan congressional bill, the AI Kill Switch Act, has also been introduced to require developers of powerful AI systems to maintain shutdown capabilities Newsom's order arrives as several potential 2028 Democratic presidential candidates have staked out positions on AI regulation, including Pennsylvania Gov. Josh Shapiro pressing for stronger oversight. Newsom, whose term ends in January, has said he is considering a presidential run but has not announced one. In a video posted online Friday, he urged House Speaker Mike Johnson to call Congress back from recess to pass a federal AI safety bill


With a significance score of 5.2, this news ranks in the top 1.4% of today's 31618 analyzed articles.

Get summaries of news with significance over 5.5 (usually ~10 stories per week). Read by 10,000+ subscribers:


California orders AI 'kill switch' plan for frontier models | News Minimalist