Deployment Success

Find out how easy it is to upgrade AOS with Nutanix! Follow along as we walk through how Nutanix enables you to upgrade AOS with no downtime to your clusters or any disruption to your VMs. Stay Connected! Subscribe to our YouTube channel to get instant updates!  

ESXTOP can be very good to tool to see the live stats and usage of the Physical host and its components, but more often than not, we would like to use that data to plot graphs or even save the data to examine it later. This brings us to the most important use case of ESXTOP is to run ESXi in batch mode. Batch mode provides us a way to collect esxtop stats from a physical ESXi host and analyze it on a Windows machine using Perfmon. Capture the Data:First thing would be capture only the relevant info and omit all the metrics you don't need.Use ‘f’ to ADD/Remove FieldsUse ‘o’ to change the order of Metrics Use ‘W’ to save the settings that you just edited.Caution: If you don't input a file name, the default settings will be saved as such. We are ready to run the esxtop in batch mode. esxtop -b -d 2 -n 100 > esxtop.csv b=batch moded=delayn=No of Iterationsa=all Metrics Usually capturing esxtop for an extended period of time can result in a large file. In order to avoid this, we can zip

I’m seeing:Detailed information for garbage_egroups_size_check:Node 10.1.11.32:FAIL: 67% of disk 415104829 occupied by garbage egroupsRefer to KB 1574 (http://portal.nutanix.com/kb/1574) for details on garbage_egroups_size_check or Recheck with: ncc health_checks stargate_checks garbage_egroups_size_checkon 2019.02.11 LTSDisk 415104829 (SSD) was added yesterday. I also added one ssd to 2 nodes tonight. The new ssd’s are very busy right now.

I’d like to rename the host name on a single-node cluster - assuming that I update the name in the /etc/sysconfig/network and /etc/hostname files, I guess I would also need to stop/start the acropolis service. I know this is safe to do on a 3-node cluster but is there are risk/impact with a 1-node cluster?

Hello,I was hoping to get some clarification as to what features are included in AOS Starter.  I usually use the following link as a guide:Nutanix Software Editions & Licensing: Solutions to Run on Our AppliancesThe above link states that “Basic Compression (LZ4) - Inline and post process” are included starter.  However as soon as I enable post compression I get a license violation notice.  In prism element it also shows the available features for starter and post compressions shows as yes:Is post compression available in Starter? Also the link states that lz4hc compression is not available for Starter but running the following command on a starter clusters show it is available and compressing data:curator_cli display_data_reduction_report Has something changed to make lz4hc available to starter? Is there another document or link with a comprehensive list of features available for each edition? Thanks,--Zip

As i know that if drive failure, Nutanix will rebuilt the data immediately. May i know if node failure, how long does the Nutanix will trigger to rebuilt if have sufficient node and capacity in existing cluster? Thanks

Below are the top knowledge base articles for the month of January 2021.KB 7503 - NX Hardware [Memory] – G6, G7 platforms - DIMM Error handling and replacement policy KB 1540 - What to do when /home partition or /home/nutanix directory on a Controller VM is full KB 4141 - Alert - A1046 - PowerSupplyDown KB 1113 - HDD/SSD Troubleshooting KB 4409 - LCM: (Life Cycle Manager) Troubleshooting Guide KB 4158 - Alert - A1104 - PhysicalDiskBad KB 2090 - AHV host networking KB 2473 - NCC Health Check: cvm_memory_usage_check KB 4519 - NCC Health Check: check_ntp KB 6945 - How Upgrades Work at Nutanix KB 1863 - NCC Health Check: sufficient_disk_space_check KB 3741 - NGT: Nutanix Guest Tools Troubleshooting Guide KB 4273 - NCC Health Check: aged_third_party_backup_snapshot_check and  aged_entity_centric_third_party_backup_snapshot_check KB 8932 - NCC Health Check: pc_vm_resource_resize_check KB 3523 - How to create a Phoenix ISO or AHV ISO from a CVM or Foundation VM KB 5582 - NCC Health Check: idf

Below are new knowledge base articles published on the week of January 24-30, 2021.KB 9399 - NCC Health Check: ipv6_config_check KB 10053 - NCC Health Check: vmd_driver_disablement_check KB 10616 - Connectivity or performance issues with pfSense VM after AHV upgrade KB 10620 - Zookeeper: Check failed: zoo_error == ZeusError::kNoNode (kRuntimeInconsistency vs. kNoNode) KB 10658 - Critical Alert - A1033 - VM action error KB 10659 - Stargate service crashing on the DR destination cluster due to incompatible compression algorithm in prior AOS versions after primary site has been upgraded to 5.19.x version KB 10682 - Move - Migration may stuck with status: Sync Snapshot (MOVESnap-0)Note: You may need to log in to the Support Portal to view some of these articles.

There are instances when you have to perform a rolling restart of the CVMs (Controller VMs) or a rolling restart of the hypervisor hosts or a restart of just one of the CVMs. This is a list of health checks to execute prior to the restart to verify cluster health. Verify if any nodes or services are in a 'down' state. Run the following command for smaller sized clusters: nutanix@cvm$ cluster status If the cluster contains multiple nodes, running the following command which excludes services that are UP from the output may be more convenient:nutanix@cvm$ cluster status | grep -v UPNodes or services that are unexpectedly in a 'down' state need to be fixed before proceeding with the restart.  Verify if any nodes are missing or are in a 'down' state in the Cassandra ring. There should be the same number of nodes as the number of IPs in the svmips output (four nodes in the example below). If a node is missing, it means it was removed from the Cassandra ring:nutanix@cvm$ nodetool -h 0 ringAd

LCM 2.4 introduced a new protocol called the Redfish Protocol. It uses a RESTful API interface for server management. While there are many improvements introduced in the backend, there are a couple of improvements done on the frontend as well.The main improvement on the frontend is that LCM now performs the BMC and BIOS updates using Redfish twice as fast as the older method of using a Phoenix ISO. The time gained is due to fewer restarts needed for BMC and BIOS (no restarts needed for BMC updates and one restart for BIOS updates).While there are specific requirements for LCM to utilize the Redfish protocol, the LCM UI in LCM 2.4 displays this information in the Inventory Pane.For more information about the requirements and the LCM UI, take a look at the Redfish Protocol documentation on the Support Portal.

Added 9 nodes(AHV) to existing cluster successfully and when i try to verifyLACP status with command (hostssh "ovs-appctl bond/show br0-up" | egrep "===|lacp_status") it is showing LACP status off.Steps i performed before adding the nodes to existing cluster1.Configured network on all 9 nodes2.Configured LACP on all 9 nodes Please advice.  

How many nodes we can deploy at the same time in nutanix ? Is there any limit or shall we just go ahead and deploy all the nodes at the same time ?Same query is related to cluster expansion, can we add multiple nodes at the same time in existing cluster ?Thanks

I’m new to Nutanix so bear with me if this has been asked. Is it possible to simulate a x-over cable between two VM’s? basically I want any traffic leaving a load balancer to be passed via layer 1-2 to a WAF appliance so it can be inspected. The WAF is in transparent mode and won’t have an IP Address. In the past with physical machines i would just cable them inline. 

Dear All,May I have a question about the below situation?RF=23 node cluster2 x disks failure in same nodeMay i know whether the cluster will be corrupted or not? From my understanding, it should not be corrupted as 2 x disks failure in same node (NOT different node).

Hi All,Current environment (~40 sites & HO) do not have any 10GbE switches and we are planning 2-node clusters per site. If using 2 x 1GbE Nic for the management like a witness communication, can we connect ESXi nodes using  10gbit ‘direct cable’ to support the workload for all VM traffic, vMotion, vmKernel, and Nutanix and most important, two node disks datastore? It should be not any issue for the Nutanix/VMware level, Switch is on L2.

Can I change IP or VLAN in IPMI after Foundation that will be concern or affect to AHV environment?

HiI’m using Nutanix Prism Central v3 API and I want to run the API call referenced here:https://www.nutanix.dev/reference/prism_central/v3/api/categories/postcategoryquery/to get the category information.I’m calling this API: https://<prism_ip>:9440/api/nutanix/v3/category/query, using Postman. My problem is filling the request body. The example at the bottom of the page shows this request body:{  "api_version": "3.1.0",  "group_member_count": 123,  "group_member_offset": 123,  "usage_type": "string",  "category_filter": {    "type": "CATEGORIES_MATCH_ANY",    "kind_list": [      "string"    ],    "params": {}  }} But the params property is empty and I can’t figure out how to fill it properly.It says in the description that it’s supposed to have “a list of category key and list of values”, but no matter what I try I either get an error regarding the json structure or this error: For a search specify the correct usage type. Can someone please provide an example of how to use this

HiIs there a way to check the versions of all Nutanix components in one view? “ncli cluster info” displays the AOS and NCC versions, but not those of AHV and PC. The AHV and PC versions may be obtained from the PC UI (in different places though). Further, the Nutanix release timeline shows AOS 5.18 as the latest, but the documentation has tags for 5.19?

I feel it is time to address a seemingly minor question: should you re-image your nodes when re-using them from an existing cluster? To give a better idea of a setup, think of a cluster with eight nodes, for example. You would like to scale down the cluster and re-use 4 of those nodes to form another cluster. You have evicted the nodes, and you could create a new cluster at this stage but let's take a look at the pros and cons of rushing forward.Cluster creation does no wipe the system. All the files on the nodes remain as they are when you trigger cluster creation. That sometimes can mean issues with LCM upgrades or the cluster creation may error out. To resolve those issues you would need to find those files and chances are you would need a Nutanix Support Engineer to deal with that.Some features introduced in software releases are only available if the version is a fresh installation rather than an upgrade.Any networking changes you might need are easy to apply during the foundation

Hi, I’m trying to create a automated NGT install script for my environment: Code:curl --insecure --request POST --url https://x.x.x.x:9440/PrismGateway/services/rest/v2.0/vms/ef064f22-7ac8-4221-96dd-4cc6f2433dfb/manage_vm_guest_tools --header 'authorization: Basic xxxxx' --header 'content-type: application/json' --data '{"operation":"MOUNT","override_guest":true,"uuid":"ef064f22-7ac8-4221-96dd-4cc6f2433dfb"}' Response:{"message":"Hypervisor ahv not supported","detailed_message":null,"error_code":{"code":1101,"help_url":"http://my.nutanix.com"}} AOS: 5.15.1

Hi! After using 2 of API callshttps://www.nutanix.dev/reference/prism_element/v2/api/alerts/post-alerts-acknowledge-acknowledgealerts/https://www.nutanix.dev/reference/prism_element/v2/api/alerts/post-alerts-resolve-resolvealerts/i’ve received this response{ "num_successful_updates": 1,  "num_failed_updates": 0,  "alert_status_list": [   {  "id": "0:0", "successful": true,  "message": null  }   ] }I wasn’t able to understand what the “id” field in “alert_status_list” means, if someone here could clarify I would really appreciate it.

While expanding cluster out of 4 nodes able to add one and remaining three nodes failed with error “Controller VM disconnected from network”Description:Controller VM  is not reachable from Controller VM  in the last 3 attempts.

Below are new knowledge base articles published on the week of January 17-23, 2021.KB 10178 - [JPKB] Files ストレージネットワークに存在するクライアントからファイル共有にアクセスできません KB 10234 - acli host.enter_maintenance_mode_check on AHV is not deterministic KB 10422 - After LCM upgrade an ESXi host is showing "Installing... Please be patient..." on ESXi DCUI for a long period of time KB 10548 - "Unknown device" in Device Manage of Windows VM running in BIOS mode KB 10602 - Nutanix Files - Error message "Error creating share/export: Duplicate client entry!" when creating an NFS Share with non-default access permissions KB 10603 - Objects - Unable to deploy VMware based cluster. Failing with 'Failed to initialize vcenter client for Prism Element' KB 10612 - Alert - A1137 - Node Failure KB 10613 - RHEL 7.8 installer hangs at "Installing Boot Loader" for AHV VM on AOS 5.18.x when using Secure Boot for VM KB 10628 - LCM upgrade failure with mesage "Contorller is missing on the OS, tried PCI rescan for 3 times, it did not

Era offers the following key services for several database engines:One-Click Provisioning. Copy Data Management. Database Protection. One-Click Patching.One-Click ProvisioningEra enables you to easily provision database environments (either production or otherwise) on your Nutanix clusters. Era provisioning service includes the following components:Database engines: Custom software images that can be tailored to fit your enterprise needs. (See Oracle Database Management, Microsoft SQL Server Database Management, PostgreSQL Database Management, MySQL Database Management, MariaDB Database Management, and SAP HANA Database Management for more information) Database profiles: Customizable database profiles for software, compute, networking, and database parameters. (See Era Profiles for more information) Database recovery SLAs: Customizable recovery SLAs for continuous, daily, weekly, monthly, and quarterly Recovery Point Objectives (RPOs). (See SLA Management for more information)VM Affini

Many users are not aware that a recent change has been made to the default password setting of new Nutanix nodes. Specifically, the default password for the IPMI interface is now the serial number of the node itself (using capital letters). Please note that the node serial number is different from the block serial number. You can find more information regarding this change as per the Common BMC and IPMI Utilities and Examples Knowledge Base article.Also, if you desire to change the IPMI password, you can do so using the IPMI management utility located within the file system of the operating system running on the node. Further, you can even change the password, without having an operating system installed/running, by using the utility from a bootable DOS environment. You can find more information regarding this within the Changing the IPMI Password section of the NX Series Hardware Administration Guide.