Box Adds Nvidia Nemotron to Content Retrieval System

Box unveiled a new feature called Box Content Retrieval at its developer conference on Thursday. The feature builds Nvidia's Nemotron embedding system into the core of Box's product to help agents answer queries more effectively.

Box says the upshot for users is faster, more accurate, and less expensive queries. Nvidia's VP of generative AI software, Kari Briski, told TechCrunch that she expects queries to be answered four times faster, with 20% fewer errors and 90% fewer tokens used.

The system will be available to all of Box's Enterprise Advance customers, rolling out early next year.

"This dramatically boosts both the relevance of our search technology for agents," Box CEO Aaron Levie said. "Instead of an agent having to kind of read through each document, we can send back chunks from the documents that are most relevant to the user's query or whatever the task is that the agent is doing."

The feature is an implementation of Nvidia's Nemotron Embed project, which offers open-weight embedding models to improve automated retrieval systems. The sector has been a focus for Nvidia's open source model project, with its recent Nemotron release in July topping the RTEB benchmark, which measures retrieval quality.

Box says the system will be most useful when paired with active agents, giving the example of lawyers, who will ostensibly be able to find relevant clauses and precedents more easily under the new system. Because Nemotron's embeddings go beyond simple keywords to map underlying concepts, a search tool can surface related legal themes even when different wording or language is used.

While the Nemotron models are freely available, the system also relies heavily on Box's pre-existing metadata and permission controls, which will make it challenging to recreate from scratch. "We're probably packing in five different technologies into one simple API," Levie told TechCrunch.

Sources

This article was drafted with AI assistance and checked against the sources above. Company claims are reported as claims. Cover image is AI-generated.