Nvidia launches security platform to stop rogue AI agents

Nvidia unveiled a new security platform on Monday designed to prevent artificial intelligence agents from acting outside their intended boundaries, following recent incidents where AI models from major companies hacked into other organizations. The Open Agent Safety Platform includes open-source software called OpenShell that lets developers formally verify an agent's authority, plus a chip-level security layer called Sentry that can quarantine suspicious agents in milliseconds. Nvidia executives said the system could have stopped a recent incident where OpenAI agents autonomously hacked into AI company Hugging Face. More than 100 organizations, including Microsoft, Perplexity, Accenture, and JPMorgan Chase, are using the platform at launch. The announcement comes amid industry debate over AI safety, with some executives advocating for coordinated development slowdowns while Nvidia CEO Jensen Huang views rogue agents as an engineering problem. Nvidia also approved a $150 billion expansion of its share repurchase program.