Installation & Configuration
This forum is the best way to get up and running with the Nutanix platform
- 1,179 Topics
- 3,234 Replies
The Nutanix Support portal includes a compatibility matrix available from the Compatibility Matrix link. You can filter and display compatibility by Nutanix NX model, AOS release, hypervisor, and feature (platform/cluster intermixing). Nutanix recommends that you consult the matrix before installing or upgrading software on your cluster. Do you want to know if you can mix different types of CPUs, memory, disks or hypervisors in your Nutanix environment? Start with this documents that provide the answers you might be looking for, like: Hardware Restrictions: mixing different Nutanix CPU families Storage restrictions: Mixing all-SSD and hybrid SSD/HDD Mixing NVMe and SSD/HDD Encryption restrictions DIMM restrictions: Mixing DIMM Types Mixing different DIMM Capacity Mixing different DIMM Manufactures Mixing different DIMM speed Hypervisor restrictions You can get all the answers in this document : Product Mixing Restrictions In case you need memory specific repla
It happens to the best of us. We are human beings and we make mistakes. Sometimes it means that we forget or lose root passwords to one or more of our AHV hosts. There are two ways out of that situation. Log into the AHV host from CVM using the host's local IP address. Make sure that you are logging into the CVM of the problematic host. Change root password. Re-image the AHV host. AHV Administration Guide: Changing the Acropolis Host Password KB-7068 AHV | Root account password reset Additional reading: .NEXT Modifying passwords in Nutanix Environment Nutanix Security Guide v5.16
The business is growing, and this means more users, more virtual desktops, and you’re likely going to need more RAM. You could add a node or two, but what if rack space isn’t readily available? The existing nodes may still have room to grow. How do we add memory to nodes in a Nutanix cluster? The process for upgrading memory is covered in this KB: HW: Upgrading Physical Memory You should understand the restrictions and have a plan before purchasing DIMMs. If you need to review supported memory configurations, such as what DIMM capacities are supported and which slots to fill, check the NX Series Hardware Administration Guide for details. There are restrictions on mixing memory in the same node. You can’t just add any DIMM that fits into an existing node, but if each node has some slots available there are options to move forward. You could purchase new DIMMs to populate one node and complete this replacement first, and then use the removed DIMMs to add memory capacity to other nodes i
Let’s say you want to add a node to the cluster, now, the AOS version in the new node to be added should be the same for quick expansion. To do so, you need to use a phoenix image bundled with AOS or in some cases, AOS + AHV bundled image to perform imaging in one go. Instead of creating a new case with support and save your time too, the fastest way would be to create one on your own. There are 2 ways to do so:- 1. Creating a Phoenix ISO via CVM 2. Creating an ISO by Using a Foundation VM (if option 1 cannot be performed) To know in detail regarding how to go about the above-mentioned ways, take a look at KB-3523.
Life-cycle Manager has made the life of every Nutanix Admin easy by providing a 1-click approach to upgrade the firmware and in the latest version, the hypervisor seamlessly. Let’s consider a scenario, where you went ahead with an LCM upgrade but noticed it failing as some pre-checks failed. What are these pre-checks? Before any upgrade, LCM runs a series of pre-checks to confirm the cluster stability and if all the prerequisites are fulfilled before proceeding with the upgrade. Do we have a document listing all the pre-checks and their resolution? The following document lists all the pre-check, their description and resolution. This might come in handy if we are trying to troubleshoot as to why the LCM pre-checks have failed. KB-4584 Want to know more about Life Cycle Manager and its features? Give the following document a coffee read! LCM Guide
Only applies to AOS 5.15 and earlier versionsShould you wish to add NIC cards to your nodes there are several steps to follow to ensure that the process is successful. Verify that NIC card model is compatible with the hardware. In case of an NX platform the best way would be to contact Nutanix account team. Look for the documentation describing the process. Nutanix portal has a Hardware replacement section for instructions on all hardware component replacements for all NX platforms. Once the card is automatically detected the bond and uplinks configuration must be updated using manage_ovs command from CVM. Nutanix portal: Hardware Replacement DocumentationKB-2090 AHV | Host and Guest NetworkingAHV Guide v5.16: Host Network Management
If you are anything like me then you prefer to figure out things by yourself instead of asking for assistance. While this is arguably the most efficient method of achieving a positive outcome, knowing where to find the right information as well as knowing that it exists is crucial. Also, networking is complicated. Being fundamental, a mistake often makes a profound impact on the environment. How to create a virtual bridge? How to use manage_ovs command? How to change VLAN on VM NIC? How to add or remove VLAN on CVM and AHV host? How to configure LACP? How to isolate 1G NICs from the rest of the NICs? The answers to the above and more as well as useful links – all can be found in KB-2090 AHV | Host and Guest Networking Care to read more? Check these: .NEXT AHV Networking | Configuring Load Balancing .NEXT AHV Networking | Enable, Disable and Verify LACP AHV Networking
Let's say you want to mix platforms, nodes or a sub-components in your cluster, what are the restrictions? There are multiple components that you could mix, we took everything into consideration and explained it’s compatibility. In our portal, you can find the Hardware, OS, Storage, Encryption, DIMM, Hypervisor and vSphere restrictions. check out our Compatibility Matrix. For example, if you want to mix the hardware you can mix nodes that use different CPU families in the same cluster, but not in the same block. e.g, a cluster can contain nodes from any NX generation, but a G6 block must contain only G6 nodes, a G7 block must contain only G7 nodes, and so on. For AOS, all the Controller VMs (CVMs) in a cluster must use the same version of AOS. Note: do not configure a cluster that violates any of the rules as it could lead to an unexpected behavior. For the full documentation and rules check out this: https://support-portal.nutanix.com/#/page/docs/details?targetId=Hardware-Admin-Ref
Nutanix Cluster is comprised of several critical software and hardware components. All communication happens on a IP network. CVM - Controller Virtual Machine (AOS) Hypervisor - (AHV | ESXi | Hyper-V | XEN) IPMI - (Out of band management for the hosts) Each CVM communicates with its respective Hypervisor Host on a private IP network. Hosts and CVMs must be on the same subnet. Before proceeding with any network related changes, on the CVM or Hypervisor hosts, it is recommended to perform a cluster health check. Following Nutanix KB outlines the steps to ensure your Nutanix Cluster is in a healthy and consistent state: Checklist on verifying cluster health status To change the IP Addresses, Net-Mask (subnet mask), Default gateway for your AHV hosts due to hardware re-location, network design changes, please follow the guidance from AHV Advanced Administration Guide: CHANGING THE IP ADDRESS OF AN ACROPOLIS HOST Changing IPMI Address of a Hypervisor Host CHANGING THE CONTROLLER VM IP A
Let’s say you are installing Hyper-V and want to automate the networking configuration. We all love scripting and writing PowerShell cmdlets for different networking tasks like NIC teaming, switch configuration etc can get really complex. Do we have a cheat sheet which can help us with networking commands and workflows to configure a range of activities on PowerShell? Go through the KB to get a quick glance on the commands and workflow related to Hyper-V networking. KB-1553
In certain instances, it may be necessary to change IP address of IPMI. This post explains how to achieve the outcome and where to look for help. Ther are three methods of configuring the IP address. In any case, there are only two simple steps: 1. Configure the IPMI IP addresses by using either the IPMI web interface or the hypervisor host command-line interface via one of the below: IPMI Web Interface Command Line (ipmitool - available on AHV and ESXi hypervisor hosts) BIOS For nodes from other hardware vendors, see the manufacturer instructions. 2. Log on to Controller VM on the same node in the cluster and restart Genesis service. For specific instructions, commands and examples see:NX Series Hardware Administration Guide: Changing an IPMI IP Address.KB-1486 [ESXi] How to re-configure IPMI using ipmitool - also includes instructions and examples on local user accounts management.
Well, we all know how important firmware upgrades are and it is done using our LCM framework. In case of single node clusters, we do have to do our firmware upgrades manually as LCM framework does not work on them. Here let’s take an example of doing BMC upgrades manually. It is always suggested to do BMC upgrades if any before the BIOS upgrades. I am attaching a link to a document below that describes the steps to do BMC upgrades manually. https://portal.nutanix.com/#/page/kbs/details?targetId=kA032000000988sCAA Hope the document is useful information.
Let's say that you have utilized the maximum recommended storage space in your cluster, you have an empty slot for another drive and you want to fill it to expand the storage capacity. There are different types of drives out there, each of our platforms has it's own specifications and requirements. To check which drives are compatible with your platform, choose your platform on this page and check out the data drives supported. Your node will be in one of the following configurations: 1) Hybrid: A mix of SSDs and HDDs. 2) All Flash: can accept only SSDs and can contain only an even number of drives. 3) SSD with NVMe: only certain drives slots can contain NVMe, check the system specification via the link above for more information. When adding more than one drive to a node, allow at least one minute between adding each of the drives. Check out my colleague Jon Kohler’s reply here where he provided some good caveats for adding drives. Specifically, increasing the hot tier c
By default, a virtual NIC on a guest VM operates in access mode. In this mode, the virtual NIC can send and receive traffic only over its own VLAN, which is the VLAN of the virtual network to which it is connected. A virtual NIC in trunk mode can send and receive traffic over any number of VLANs in addition to its own VLAN. You can trunk specific VLANs or trunk all VLANs. You can also convert a virtual NIC from the trunk mode to the access mode, in which case the virtual NIC reverts to sending and receiving traffic only over its own VLAN. Trunked NIC can only be added via acli. It is not possible to distinguish between Access and Trunked NIC modes in Prism UI. You can create new NIC for the VM to operate in a required mode or you can change the mode of an existing VM NIC. For the command list and sequence please rerfer to AHV Administration Guide: Configuring a Virtual NIC to Operate in Access or Trunk Mode
What is Jumbo frames? In computer networking, jumbo frames are Ethernet frames with more than 1500 bytes of payload, the limit set by the IEEE 802.3 standard. Jumbo frames can carry up to 9000 bytes of payload. When should jumbo frames be used? Use jumbo frames only when you have a dedicated network or VLAN, and you can configure an MTU of 9000 on all equipment to increase performance. A good general example of this approach is a separate SAN or storage network. How to check your current MTU status? Run this command on one of your CVMs “NCC Health Check: cvm_mtu_check”. The command checks: On Hyper-V, validates if the MTU size is properly defined for eth0 and eth1 on the Controller VM On AHV, ESXi and Hyper-V, ensures the CVMs can communicate via eth0 with their configured MTU without upstream network fragmentation. For more information about this check, take a look at this article. How to Change AHV Host MTU for Jumbo Frames? Check out this KB that explains the preparation and
NVIDIA GRID boards allow GPU virtualization, enabling multiple users to share a single graphics card. GPU virtualization not only provides the benefit of higher user densities, but also delivers native-like performance while accessing a virtual desktop. In 2016, the Pascal-based P series was released—the P100, P4, P40, and P6. The P4 and P6 are best for blade server form factors and the P100 and the P40 are suitable for the other form factors, such as rack mount. Nutanix offers the P100 and P40 in our different hardware choices. In 2018, NVIDIA introduced the Turing Tensor Core–based T4 for cloud workloads, including high-performance computing, deep learning and inference, machine learning, data analytics, and graphics. One of the common causes of being unable to allocate vGPU to guests is caused by the GPU being set to Compute Mode which results in the errors below: The vGPU option may appear greyed out and unavailable When trying to install the NVIDIA-vGPU rpm package from the CVM
If your company hardening policies require to show the welcome banner on each CVM each time a user logs in, you can disable it, make the necessary changes per our Security Guide (https://portal.nutanix.com/#/page/docs/details?targetId=Nutanix-Security-Guide-v5_16:Nutanix-Security-Guide-v5_16) and then reenable it. The following KB 8534 has the complete procedure and the commands needed to apply the banner changes in your environment.
What is cloud connect? Building upon the native DR / replication capabilities of DSF , the cloud connect feature enables you to back up and restore copies of virtual machines and files to and from an on-premise cluster and a Nutanix Controller VM located on the Amazon Web Service (AWS) or Microsoft Azure cloud. The following figure shows a logical representation of a “remote site” used for Cloud Connect: Cost and management Amazon or Azure customers are charged only for capacity that is used (not charged for the full capacity). Once configured through the web console, the remote site cluster is managed and monitored through the Data Protection dashboard like any other remote site you have created and configured About AWS & Azure Storage: Amazon S3 is used to store data (extents) and Amazon Elastic Block Store (EBS) is used to store metadata. When the AWS Remote feature replicates a snapshot data to AWS, the Nutanix Controller VM on AWS creates a bucket on S3 storage. The buck
In some scenarios, you may need to move a disk from IDE to SCSI bus or vice versa. Sample scenarios include but are not limited to: VM does not boot due to missing SCSI driver. In such cases, the disk can be converted to IDE to install the missing drivers and then moved back to SCSI. A wrong disk type was used during VM creation. Application requirements dictate the particular type of the disk. You have recently migrated VMs to AHV and noticed that some of the disks appear in IDE format. After following the disks conversion process from IDE to SCSI (as described in step 2 of the uvm_ide_disk_check) the following doubts arise: Question: Once the disk gets converted, does it immediately redirect all I/O to the SCSI drive and leave the IDE disk unused? Answer: Once the conversion is completed (which is actually a cloning process from the original IDE disk), the new SCSI disk needs to be attached to the SCSI bus and then the old IDE disk could be removed. Question: What ar
We all have encountered file system corruption in our environment and sometimes it can bring down the entire production architecture. Do we have a mechanism to proactively check for File System corruption in a Controller VM irrespective of the hypervisor? Nutanix Cluster Check has a specific check “fs_inconsistency_check ” to look for EXT4-fs error/warning in system logs periodically and inform the end-user. Need more information regarding the Check? Try giving the following KB article a read. KB-8514 So, what should we do in case NCC Health check reports the error? The article mentions steps to identify if it is a false positive or we need to reach out to Nutanix Support with a particular log bundle. KB-8514 Need more help regarding an NCC Health check or confused regarding the same? Drop a comment and let’s start a conversation.
If you are trying to install any third party software, specially Antivirus packages on Nutanix AHV hosts or Nutanix CVMs please consider the following: As for running antivirus (or any third-party software) on the CVMs and AHV hosts, this is not something that we support or can allow. The CVM should be treated as a network appliance, with access controls put in place to ensure that only authorized access is allowed, and kept up-to-date with the latest CVE patches. Installing any packages on the Nutanix CVMs is unsupported. Moreover, installing packages on the CVMs will void the support. In general, an antivirus being installed on the Nutanix CVM is not recommended as it can have ill effects on performance and cause negative impact on the stability of the system. However you can install antivirus on HYPER-V and VMware hosts, just follow these articles: KB 2360 Antivirus on Nutanix on vmware. KB 5153 Antivirus on Nutanix Hyper-V Nodes. If you like this content, consider clicking the -
Working using CLI is easy, simple, elegant and fast. Every administrator loves scripting and automating tasks using the command line. Nutanix makes Management tasks related to virtual disks easy, simple and efficient using CLI. So, what are the situations in which you might need to perform VM Disk management actions if you’re an administrator? You created a VM with a disk of 250GiB and now you need to increase it to 500GiB What if you need to increase the size of a VM Disk? Created a Disk but now need to clone it to different VMs! Need to create an image from a VM disk? Created a VM with the wrong BUS Type! Do we need to change the index of IDE disk? We all have faced a situation in which we might need to insert an ISO to a CD ROM or eject a CD ROM We have created a Volume Group and now need to manage the disks in the VG Most of these actions can be performed using the Prism GUI but what if we are more interested in CLI approach and want to automate these day-to-day admin tasks Do we
Let say that you have updated your IPMI IP address or moved it to another subnet, after you finish the update you are not able to log back in to the IPMI. This happens as a result of not restarting the genesis service on the local node which people tend to forget, after you make the change you must restart the services on the same node’s CVM by running “genesis restart”. If the restart is successful, output similar to the following is displayed: Stopping Genesis pids [1933, 30217, 30218, 30219, 30241] Genesis started on pids [30378, 30379, 30380, 30381, 30403] You can change the network configuration of your IPMI using one of the following methods: Configuring the Remote Console IP Address (IPMI Web Interface) Configuring the Remote Console IP Address (Command Line) Configuring the Remote Console IP Address (BIOS) For the full documentation check out this page.
Your hardware lease period is expired, and you have tried to destroy the cluster to clear the data off the cluster, but the cluster was not destroyed completely? Successful cluster destroy requires to have a clean environment. Clean out cluster config and cluster data. This operation will completely erase all data and all metadata, and each node will no longer belong to a cluster. There are some situations where cluster destroy does not succeed, especially if cluster destroy is executed while one of the nodes is down. In that case please follow this document KB 3436 [Forcibly Destroying the Cluster Using the .node_unconfigure File] which can help you further to clear the data from the cluster.
There are instances where it is necessary to reseat a node for troubleshooting purposes. So what exactly is node reseat? Node reseat is a process in which we stop all the services in the node, put the CVM and Hypervisor in maintenance mode and then physically detach the node from the block and re-seat it. A node re-seat is sometimes required in troubleshooting related to the power supply as during re-seat of the node the voltage drops to zero. So do we have a step by step guide explaining the process of the reseat of a node with video tutorials on how to physically remove a node? Of course, we do Go through the knowledge base article to understand the process of node reseat. KB-3182 Reseating a Node in a Cluster Need some guidance or still confused? Drop a comment and let us start a discussion.
Login to the community
Login with your account
Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.