The system is designed to decrease latency in AI purposes by pairing Nvidia’s accelerated computing and software program with Cisco’s high-performance Ethernet networking
In sum – what to know:
Cisco expands Safe AI Manufacturing unit with Nvidia – New infrastructure provides VAST Knowledge integration to hurry up retrieval-augmented technology (RAG) pipelines and assist agentic AI at enterprise scale.
Decrease latency for AI workloads – AI PODs cut back RAG pipeline response occasions from minutes to seconds, serving to brokers entry information quicker and ship extra related, real-time enterprise insights.
Deal with safety and governance – The system contains role-based entry, audit readiness, and observability by Splunk, aiming to safeguard enterprise information whereas enabling AI adoption.
U.S. networking firm Cisco has introduced an growth of its Safe AI Manufacturing unit with Nvidia, introducing new infrastructure capabilities designed to assist enterprise adoption of agentic AI.
In a launch, Cisco famous that the brand new options give attention to accelerating retrieval-augmented technology (RAG) pipelines, enabling quicker and safer information entry for AI brokers at scale.
The corporate mentioned its AI PODs — infrastructure modules that mix compute, storage, and networking — are actually obtainable with VAST Knowledge’s InsightEngine. This integration is constructed on the Nvidia AI Knowledge Platform reference design, permitting organizations to arrange uncooked information into usable AI datasets, the agency mentioned.
Cisco famous that these PODs are powered by its UCS servers outfitted with Nvidia RTX PRO 6000 Blackwell Server Version GPUs, among the many first to undertake the Nvidia AI Knowledge Platform reference structure.
The agency defined that the system is designed to decrease latency in AI purposes by pairing Nvidia’s accelerated computing and software program with Cisco’s high-performance Ethernet networking. The Safe AI Manufacturing unit framework additionally integrates with Splunk for observability and Cisco AI Protection for safety guardrails, it added.
Jeremy Foster, senior vice chairman and common supervisor of Cisco Compute, mentioned: “Agentic AI has the potential to unlock the worth of AI for enterprises around the globe. Transferring past chatbots to brokers that may assist clear up true enterprise challenges is revolutionary, however provided that enterprises can successfully leverage the best information on the proper occasions. Cisco, Nvidia and VAST are working collectively to provide prospects a easy path to unlocking the worth of their information. We’re designing the structure for the way the enterprise will construct the subsequent technology of AI factories.”
Justin Boitano, vice chairman of Enterprise AI at Nvidia, added: “The following wave of agentic AI will probably be fueled by enterprise information, enabling brokers to faucet into enterprise information throughout inference for exact, up-to-date insights. Bringing collectively Cisco Safe AI Manufacturing unit with Nvidia and VAST InsightEngine creates an built-in platform for operating highly effective AI brokers at scale.”
John Mao, vice chairman of strategic alliances at VAST Knowledge, mentioned: “By integrating the VAST Knowledge InsightEngine into the Cisco Safe AI Manufacturing unit with Nvidia, we’re giving enterprises the primary built-in design for RAG acceleration at scale. This collaboration with Cisco and Nvidia represents a significant milestone within the evolution of enterprise AI.”
In accordance with Cisco, the brand new design addresses enterprise issues round information entry, governance, and efficiency. By decreasing RAG pipeline latency from minutes to seconds, the system goals to offer near-real-time AI responses. It additionally helps a number of brokers and workloads concurrently, whereas incorporating role-based entry controls and audit readiness to assist organizations shield delicate info as they develop AI use circumstances, the agency added.
In June, Cisco launched a variety of knowledge heart and networking improvements aimed toward serving to organizations scale their synthetic intelligence (AI) infrastructure.
The corporate famous that the brand new capabilities have been unveiled following a robust third quarter during which the networking agency exceeded its annual $1 billion AI infrastructure order goal from hyperscalers.
