INTELLIGENT BRANDS // Cloud

The NAI offering delivers a consistent hybrid multicloud operating model for accelerated AI workloads , enabling organisations to leverage their models and data in a secure location of their choice while improving return on investment , ROI .

Leveraging NVIDIA NIM for optimised performance of foundation models , Nutanix Enterprise AI helps organisations securely deploy , run and scale inference endpoints for large language models , LLMs to support the deployment of generative AI , GenAI applications in minutes , not days or weeks .

“ With Nutanix Enterprise AI , we are helping our customers simply and securely run GenAI applications on-premises or in public clouds ,” said Thomas Cornely , SVP , Product Management , Nutanix .

“ Generative AI workloads are inherently hybrid , with training , customisation , and inference occurring across public clouds , on-premises systems , and edge locations ,” said Justin Boitano , Vice President of Enterprise AI at NVIDIA .

Generative AI is an inherently hybrid workload , with new applications often built in the public cloud , fine-tuning of models using private data occurring on-premises , and inferencing deployed closest to the business logic , which could be at the edge , on-premises or in the public cloud .

This distributed hybrid GenAI workflow can present challenges for organisations concerned about complexity , data privacy , security , and cost .

Nutanix Enterprise AI provides a consistent multicloud operating model and a simple way to securely deploy , scale and run LLMs with NVIDIA NIM optimised inference microservices as well as open foundation models from Hugging Face .

This enables customers to stand up enterprise GenAI infrastructure with the resiliency , day 2 operations , and security they require for business-critical applications , on-premises or on AWS Elastic Kubernetes Service , EKS , Azure Managed Kubernetes Service , AKS , and Google Kubernetes Engine , GKE .

Thomas Cornely , SVP Product Management , Nutanix

Additionally , Nutanix Enterprise AI delivers a transparent and predictable pricing model based on infrastructure resources , which is important for customers looking to maximise ROI from their GenAI investments . This contrasts with hard-to-predict usage or token-based pricing .

Nutanix Enterprise AI is a component of Nutanix GPT-in-a-Box 2.0 . GPT-in-a-Box also includes Nutanix Cloud Infrastructure , Nutanix Kubernetes Platform and Nutanix Unified Storage along with services to support customer configuration and sizing needs for on-premises training and inferencing .

For customers looking to deploy in public cloud , Nutanix Enterprise AI can be deployed in any Kubernetes environment but is operationally consistent with onpremises deployments .

Nutanix Enterprise AI can be deployed with the NVIDIA full-stack AI platform and is validated with the NVIDIA AI Enterprise software platform , including NVIDIA NIM , a set of easyto-use microservices designed for secure , reliable deployment of high-performance AI model inferencing . Nutanix-GPT-in-a-Box is also an NVIDIA-Certified System , also ensuring reliability of performance . p

56 INTELLIGENTCIO AFRICA www . intelligentcio . com