What is this?
A roll-up on the new version of Nutanix Enterprise AI (NAI)!
What is NAI?
Nutanix Enterprise AI (NAI) is a centralized inferencing control plane that’s simple, secure, and sovereign helping you standardize generative AI infrastructure across an organization, including applications, developers, and data scientists. NAI can provide inferencing on any CNCF Kubernetes, running at the edge, datacenter, and public clouds, with day 2 operations to ensure your success.
What is new in NAI 2.3?
Expanded, Pre-Validated Models
| Hugging Face meta-llama/Llama-4-Scout-17B-16E meta-llama/Llama-3.2-90B-Vision-Instruct meta-llama/Llama-3.2-11B-Vision-Instruct ibm-granite/granite-embedding-107m-multilingual meta-llama/Llama-Guard-3-8B - safety unsloth/Llama-3.3-70B-Instruct-bnb-4bit | NVIDIA NIM and NeMo llama-3.3-nemotron-super-49b-v mistral-7b-instruct-v0.3 phi-3-mini-4k-instruct llama-3.1-swallow-8b-instruct-v0.1 llama-3.1-nemoguard-8b-topic-control |
Performance & Acceleration
CPU Inferencing with AMX: CPU-based AI inferencing with Intel's AMX accelerator
Advanced Inference Endpoint Configuration: Customize token limits based on your hardware
Model Management & Integration
Import Hugging Face Models via URL: Deploy LLMs from Hugging Face without local storage
Vision Model Support: Process images and videos alongside text
Observability & Management
OpenTelemetry Export: Connect Nutanix Enterprise AI metrics to any observability tool
Endpoint Hibernation: Pause and resume AI endpoints on demand to free up resources
REST APIs: Control the data plane for NAI https://www.nutanix.dev/api_reference/apis/nai.html
Usability & Accessibility
Japanese Language Support: Enterprise AI is now speaking Japanese!
Nutanix Enterprise AI Licensing: Manage access and usage with our new licensing framework
Deployment & Infrastructure
Self-Managed PostgreSQL Support: Integrate with existing PostgreSQL databases
What now?
Nutanix customers can download a 45-day trial of NAI right now on the support portal that can run on any Kubernetes: https://portal.nutanix.com/page/downloads/list
Get started with installing NAI here: https://portal.nutanix.com/page/documents/details?targetId=Nutanix-Enterprise-AI-v2_3:top-nai-install-t.html