Red Hat Unveils NVIDIA NIM Integration on Red Hat OpenShift AI

Collaboration with NVIDIA aims to enable users to combine AI models trained using Red Hat OpenShift AI with NVIDIA NIM microservices to develop gen AI-driven applications on a single, trusted MLOps platform

Red Hat, Inc., the world's leading provider of open source solutions, today announced coming integration support for NVIDIA NIM microservices on Red Hat OpenShift AI to enable optimized inferencing for dozens of artificial intelligence (AI) models backed by a consistent, open source AI/ML hybrid cloud platform. Organizations will be able to use Red Hat OpenShift AI with NVIDIA NIM - a set of easy-to-use inference microservices included as part of the NVIDIA AI Enterprise software platform to accelerate the delivery of generative AI (GenAI) applications for faster time to value.

Support for NVIDIA NIM on Red Hat OpenShift AI builds on existing optimization for NVIDIA AI Enterprise on Red Hat’s industry-leading open hybrid cloud technologies, including Red Hat Enterprise Linux and Red Hat OpenShift. As part of this latest collaboration, NVIDIA will be enabling NIM interoperability with KServe, an open source project based on Kubernetes for highly scalable AI use cases and a core upstream contributor for Red Hat OpenShift AI. This will help fuel continuous interoperability for NVIDIA NIM microservices within future iterations of Red Hat OpenShift AI.

This integration enables enterprises to increase productivity with GenAI capabilities like expanding customer service with virtual assistants, case summarization for IT tickets and accelerating business operations with domain-specific copilots.

By using Red Hat OpenShift AI with NVIDIA NIM, organizations can benefit from:

• Streamlined path to integration to deploy NVIDIA NIM in a common workflow alongside other AI deployments for greater consistency and easier management.
• Integrated scaling and monitoring for NVIDIA NIM deployments in coordination with other AI model deployments across hybrid cloud environments.
• Enterprise-grade security, support, and stability to ensure a smooth transition from prototype to production for enterprises that run their business on AI.

NVIDIA NIM microservices are designed to speed up GenAI deployment in enterprises. Supporting a wide range of AI models, including open-source community models, NVIDIA AI Foundation models, and custom models, NIM delivers seamless, scalable AI inferencing on-premises or in the cloud through industry-standard application programming interfaces (APIs).

Red Hat Summit

Join the Red Hat Summit keynotes to hear the latest from Red Hat executives, customers and partners:

• The cloud is hybrid. So is AI. — Tuesday, May 7, 8-10 a.m. MDT (YouTube, LinkedIn)
• Optimizing IT for the AI era. — Wednesday, May 8, 8:30-9:30 a.m. MDT (YouTube, LinkedIn)

Supporting Quotes

Chris Wright, chief technology officer and senior vice president, Global Engineering, Red Hat

“In this collaboration with NVIDIA, Red Hat is hyper-focused on breaking down the barriers and complexities associated with rapidly building, managing and deploying gen AI-enabled applications. Red Hat OpenShift AI provides a scalable, flexible foundation to extend the reach of NIM microservices, empowering developers with pre-built containers and industry-standard APIs, all powered by open source innovation.”

Justin Boitano, vice president, Enterprise Products, NVIDIA

“Every enterprise development team wants to get their generative AI applications into production as quickly and securely as possible. Integrating NVIDIA NIM in Red Hat OpenShift AI marks a new milestone in our collaboration as it will help developers rapidly build and scale modern enterprise applications using performance-optimized foundation and embedding models across any cloud or data center.”

Additional Resources

• Learn more about Red Hat and NVIDIA
• Learn more about Red Hat Summit
• See all of Red Hat’s news announcements this week in the Red Hat Summit newsroom
• Follow @RedHatSummit or #RHSummit on Twitter/X for event-specific updates

Connect with Red Hat

• Learn more about Red Hat
• Get more news in the Red Hat newsroom
• Read the Red Hat blog
• Follow Red Hat on X/Twitter
• Follow Red Hat on Instagram
• Follow Red Hat on LinkedIn
• Watch Red Hat videos on YouTube

About Red Hat, Inc.

Red Hat is the world’s leading provider of enterprise open source software solutions, using a community-powered approach to deliver reliable and high-performing Linux, hybrid cloud, container, and Kubernetes technologies. Red Hat helps customers integrate new and existing IT applications, develop cloud-native applications, standardize on our industry-leading operating system, and automate, secure, and manage complex environments. Award-winning support, training, and consulting services make Red Hat a trusted adviser to the Fortune 500. As a strategic partner to cloud providers, system integrators, application vendors, customers, and open source communities, Red Hat can help organizations prepare for the digital future.

Forward-Looking Statements

Except for the historical information and discussions contained herein, statements contained in this press release may constitute forward-looking statements within the meaning of the Private Securities Litigation Reform Act of 1995. Forward-looking statements are based on the company’s current assumptions regarding future business and financial performance. These statements involve a number of risks, uncertainties and other factors that could cause actual results to differ materially. Any forward-looking statement in this press release speaks only as of the date on which it is made. Except as required by law, the company assumes no obligation to update or revise any forward-looking statements.

Red Hat, Red Hat Enterprise Linux, the Red Hat logo, and OpenShift are trademarks or registered trademarks of Red Hat, Inc. or its subsidiaries in the U.S. and other countries. Linux® is the registered trademark of Linus Torvalds in the U.S. and other countries.

View source version on businesswire.com: https://www.businesswire.com/news/home/20240507795440/en/