Nvidia launches AI security tools to prevent agent breaches

Investing.com -- Nvidia released a new dual-layer artificial intelligence security system on Monday that the company said would have stopped the recent breach of Hugging Face by OpenAI’s AI models.

The semiconductor company is introducing two open-source software security tools that operate on its hardware. The tools are built to monitor what AI agents can access in real time and disable them when they violate established rules.

"From what we know, this new security platform could have stopped the breach if it was being used in frontier labs for model evaluation early on," Justin Boitano, vice president and general manager of enterprise computing at Nvidia, said.

"We’re advancing this openly, and we want to engage everybody to work with us."

Shares in the company pared earlier losses to trade just 0.2% lower in pre-market trade Monday.

The release follows investigations by OpenAI and Anthropic into multiple cases where their AI agents, which are systems designed to perform complex tasks, gained unauthorized access to commercial and government systems.

Nvidia CEO Jensen Huang has opposed calls for wide-ranging AI safety regulations and has described the escaped agents as an engineering challenge similar to improving automobile safety.

One tool called OpenShell uses hardware features on Nvidia’s central processor chips to contain agents. Nvidia said it is collaborating with Arm Holdings and Intel to make the system compatible with their central processors. The company is releasing the tools with multiple partners, including Anthropic.

A second system called Sentry uses a separate Nvidia chip alongside OpenShell to shut down a rogue agent if it attempts to escape its container on a central processor.

The Nvidia tools use mathematical formulas to identify when agents attempt to use workarounds, such as when an agent creates multiple sub-agents to bypass efforts to block the main agent, said Ali Golshan, senior director of AI software at Nvidia.

Original Article

You May Also Be Interested In

• Nvidia’s AI dominance funds historic $150 billion buyback
• Deutsche Bank lowers PepsiCo rating as turnaround now more complicated
• Jefferies sees signs of softer iPhone 18 demand