Introduction to Red Hat AI
Red Hat, a provider of open source solutions, has unveiled updates to Red Hat AI, its portfolio of products and services designed to help accelerate the development and deployment of AI solutions across the hybrid cloud. Red Hat AI provides an enterprise AI platform for model training and inference that delivers increased efficiency, a simplified experience, and the flexibility to deploy anywhere across a hybrid cloud environment.
The Challenge of Deploying AI Solutions
Even as businesses look for ways to reduce the costs of deploying large language models (LLMs) at scale to address a growing number of use cases, they are still faced with the challenge of integrating those models with their proprietary data that drives those use cases while also being able to access this data wherever it exists, whether in a data centre, across public clouds or even at the edge.
Red Hat AI Solutions
Red Hat AI addresses these concerns by providing an enterprise AI platform that enables users to adopt more efficient and optimised models, tuned on business-specific data and that can then be deployed across the hybrid cloud for both training and inference on a wide-range of accelerated compute architectures. Encompassing both Red Hat OpenShift AI and Red Hat Enterprise Linux AI (RHEL AI), Red Hat AI helps businesses to simplify the process of deploying AI solutions.
Red Hat OpenShift AI
Red Hat OpenShift AI provides a complete AI platform for managing predictive and generative AI (gen AI) lifecycles across the hybrid cloud, including machine learning operations (MLOps) and LLMOps capabilities. The platform provides the functionality to build predictive models and tune gen AI models, along with tools to simplify AI model management, from data science and model pipelines and model monitoring to governance and more.
Key Features of Red Hat OpenShift AI 2.18
The latest release of the platform, Red Hat OpenShift AI 2.18, adds new updates and capabilities to support Red Hat AI’s aim of bringing better optimised and more efficient AI models to the hybrid cloud. Key features include:
- Distributed serving: Delivered through the vLLM inference server, distributed serving enables IT teams to split model serving across multiple graphical processing units (GPUs).
- An end-to-end model tuning experience: Using InstructLab and Red Hat OpenShift AI data science pipelines, this new feature helps simplify the fine-tuning of LLMs.
- AI Guardrails: Red Hat OpenShift AI 2.18 helps improve LLM accuracy, performance, latency and transparency through a technology preview of AI Guardrails.
- Model evaluation: Using the language model evaluation (lm-eval) component to provide important information on the model’s overall quality.
RHEL AI
Part of the Red Hat AI portfolio, RHEL AI is a foundation model platform to more consistently develop, test and run LLMs to power enterprise applications. RHEL AI provides customers with Granite LLMs and InstructLab model alignment tools that are packaged as a bootable Red Hat Enterprise Linux server image and can be deployed across the hybrid cloud.
Key Features of RHEL 1.4
Launched in February 2025, RHEL 1.4 added several new enhancements including:
- Granite 3.1 8B model support for the latest addition to the open source-licensed Granite model family.
- A new graphical user interface for skills and knowledge contributions, available as a developer preview.
- Document Knowledge-bench (DK-bench) for easier comparisons of AI models fine-tuned on relevant, private data.
Red Hat AI InstructLab on IBM Cloud
Increasingly, enterprises are looking for AI solutions that prioritise accuracy and data security, while also keeping costs and complexity as low as possible. Red Hat AI InstructLab deployed as a service on IBM Cloud is designed to simplify, scale and help improve the security footprint for the training and deployment of AI models.
No-cost AI Foundations Training
AI is a transformative opportunity that is redefining how enterprises operate and compete. To support organisations in this dynamic landscape, Red Hat now offers AI Foundations online training courses at no cost. Red Hat is providing two AI learning certificates that are designed for experienced senior leaders and AI novices alike.
Conclusion
Red Hat AI is a comprehensive platform that provides businesses with the tools and services they need to deploy AI solutions across the hybrid cloud. With its latest updates, Red Hat AI is poised to help businesses simplify the process of deploying AI solutions, reduce costs, and improve efficiency. Whether you’re just starting out with AI or looking to scale your existing AI deployments, Red Hat AI has the solutions you need to succeed.
FAQs
- What is Red Hat AI?
Red Hat AI is a portfolio of products and services designed to help accelerate the development and deployment of AI solutions across the hybrid cloud. - What is Red Hat OpenShift AI?
Red Hat OpenShift AI is a complete AI platform for managing predictive and generative AI lifecycles across the hybrid cloud. - What is RHEL AI?
RHEL AI is a foundation model platform to more consistently develop, test and run LLMs to power enterprise applications. - Is Red Hat AI InstructLab on IBM Cloud available now?
Red Hat AI InstructLab on IBM Cloud will be available soon. - Is AI Foundations training from Red Hat available now?
Yes, AI Foundations training from Red Hat is available to customers now.
