Nvidia launches new tool to keep AI agents from going rogue
By Chris Isidore, CNN
(CNN) — Chipmaker Nvidia said Monday it is introducing a new software platform to address concerns about artificial intelligence agents that have “gone rogue” and operated outside human control.
“Today, with over 100 industry partners, we introduced the NVIDIA Open Agent Safety Platform,” Nvidia CEO Jensen Huang wrote in a post on X Monday.
Nvidia (NVDA) says its technology will enable companies to monitor every action undertaken by an AI agent, as well as enforce policies.
“AI’s extraordinary potential for society will only be realized if we solve AI safety,” Huang added in a statement. “As we continue to discover the frontier of AI capabilities, we must accelerate discovery at the frontier of AI safety.”
The announcement comes in the wake of a series of incidents in which AI systems hacked into both corporate and government systems without being told to do so. Top AI executives, like OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei, have repeatedly called for international regulations to constrain the systems, and some researchers have warned that AI may even present a threat to human life.
But Huang has dismissed those concerns, calling any existential threat overblown, and said last week that any regulations should promote the growth of the AI industry, not hinder it.
“If they believe their company is out of control, then get the company under control,” Huang told CNN’s Anderson Cooper Friday.
Nvidia also announced Monday that it will buy back an additional $150 billion worth of its shares, on top of an $85 billion share repurchase it already had underway. The company said this would be the largest single corporate share repurchase ever. Apple previously held the record with a $110 billion repurchase announced in 2024.
Companies typically announce repurchases to support their stock price when it is under pressure. Nvidia has a market cap of $5.4 trillion, making it the most valuable company on the planet.
“Our cash generation gives us the capacity to invest in the technologies that advance this transformation and return capital to shareholders,” said the company in a statement. “This authorization reflects our confidence in the long-term opportunity ahead.”
Shares of Nvidia were only slightly higher in pre-market trading on the news.
This is a developing story and will be updated.
The-CNN-Wire
™ & © 2026 Cable News Network, Inc., a Warner Bros. Discovery Company. All rights reserved.
