Zoom Communications Inc. is working with NVIDIA to deliver faster, higher-quality and customizable AI to enterprises. Zoom’s federated architecture has expanded to include NVIDIA Nemotron open technologies to support AI Companion 3.0 across finance, health care, government and other industries, company officials said.
“This framework is expanding to a next-generation hybrid language model approach, a breakthrough AI architecture that can intelligently route queries between Zoom’s proprietary small language models (SLMs), optimized for low latency and quality for a particular skill or tasks, and a fine-tuned large language model (LLM) for complex reasoning,” officials said. “The new hybrid model will accelerate enterprise productivity and collaboration experiences with optimized cost efficiency, quality and latency.”
Zoom’s AI framework is designed to use a federated architecture to intelligently select the best AI model for each task. Through this approach, Zoom AI Companion can leverage NVIDIA’s advanced AI infrastructure, services and software, alongside other models, to deliver enhanced capabilities while optimizing cost for customers, the company said. This includes Zoom’s new 49-billion-parameter LLM, based on NVIDIA Nemotron and developed with NVIDIA NeMo tools for balanced speed, cost and accuracy. The architecture is designed to allow enterprise customers and government organizations to benefit from open and closed model innovation to improve cost efficiency, AI workflows, reasoning capabilities and collaboration within AI Companion.
The initiative is intended to power the next evolution of Zoom’s federated AI architecture. The company’s patent-pending federated AI approach is designed to deliver high-quality performance for real-time transcription, translation and summarization. The new approach extends Zoom’s performance with the NVIDIA open model innovations, the company said.
“We’ve increased our speed and enhanced lower-cost model decision-making using NVIDIA GPUs and AI software stack, helping to optimize AI Companion’s core capabilities and enable faster go‑to‑market timelines,” said X.D. Huang, chief technology officer at Zoom. “With the help of NVIDIA Nemotron open technologies, we’re accelerating the development of our enterprise retrieval-augmented generation (RAG) capabilities, allowing AI Companion to work seamlessly with Microsoft 365, Microsoft Teams, Google Workspace, Slack, Salesforce and ServiceNow. This partnership allows us to deliver powerful, security-focused and scalable AI experiences to our customers at rapid speed.”
“The integration of NVIDIA Nemotron into Zoom AI Companion allows enterprises like NVIDIA to experience a private, powerful and personalized work environment for enhanced productivity,” said Kari Briski, VP of generative AI software at NVIDIA. “Our collaboration with Zoom to bring smart and efficient AI reasoning to customers is just beginning.”
Zoom indicated the company is committed to expanding AI responsibly and plans to utilize NVIDIA Nemotron reasoning models to enhance decision-making and manage multistep tasks across meetings, chat, documents and more. These models are designed to empower AI Companion to reason more deeply, automate workflows and deliver intelligent assistance throughout an enterprise, officials said.
The collaboration also lays the groundwork for future AI deployments, enabling Zoom to extend its AI capabilities to industries in which data privacy is paramount, the company said.
