California weighs AI 'kill switch' for frontier models

California Gov. Gavin Newsom issued an executive order on Sept. 18 directing an expert panel to explore an "emergency shut off" for frontier AI models, known as an "AI kill switch," as part of strengthening state AI safety laws. The order accelerates third-party safety evaluations and mandatory risk reporting, while the panel studies mechanisms to halt AI systems. A bipartisan federal bill would give the Department of Homeland Security authority to shut down systems causing "catastrophic harm," though most labs currently rely on internal controls. Experts question the feasibility of a universal kill switch, noting AI systems are dispersed online and require coordinated global responses. Critics argue such "binary" regulations are easily gamed and quickly outdated, while developers face financial disincentives to activate them.