How It works

Hi…I recently was called from a client with an old nx-1065-g4, and running aos 4.5.2.1 (i asumme was never updated).Solved hardware problem and rebuild the node building phoenix iso from a newer nx and installer from original cvm.I wonder if the latest AOS 4 branch (4.7.7.2) is available somewhere so I can also upgrade the system to a newer 5 or 6 branch, as recommended upgrade path.My client has no support contract.Is it possible to find these old packages?Thanks

Hello Nutanix expertsI have a question for youAmong the functions of Nutanix, the alert is known as a good function that can immediately inform the status of the clusterAs far as I know, if you don't press the resolve on the prism, the alarm that occurred once will not recurThrough the filter of the alert, I checked if I pressed auto reserve or manual reserveIs there a reason why the alert occurs again when it is not applicable to both options I'd appreciate it if you could explain it ============================================================================For example, a routine inspection conducted in the previous month asks the customer to confirm that the alert is a new alert because the alert has been reactivated even though the customer is aware of it

Below are new knowledge base articles published on the week of April 30-May 6, 2023.KB 14435 - Alert - A1100254 - AwsExternalSGLimitExceeded KB 14628 - After upgrading Prism Central 2022.6.x with MSP enabled, the MSP cluster will be broken KB 14651 - Configure hugepages settings on Postgres KB 14662 - NDB - Oracle log catchups failing due to datafiles being on the wrong disk KB 14674 - File Analytics - file server fails to get enabled on a new file analytics after file server migration KB 14688 - AOS upgrade failed with "LCM failed performing action delete_lcm_aos_upgrade_zk_wal in phase PostActions" KB 14702 - NDB - DB Server Provisioning from NDB fails with error message 'Failed to get IP' KB 14705 - Space Accounting | Prism show cluster/container space usage different than total usage from all VMs on it. KB 14717 - Nutanix Cloud Cluster (NC2) on Azure - Disk failed alert KB 14721 - NDB - Users fail to login on NDB Console with error "Failed to fetch cluster details. Retry login." KB

I’ve been trying to create webhooks using Nutanix API V3 (using Nutanix API explorer) and it works fine. The only problem I’ve been getting is to send some custom parameters along with the payload. Let’s say I want to send a custom parameter named cluster ip and value is “10.247.xxx.xx”. It’s just an example, but I want to receive this custom parameter whenever the event is triggered (so basically send this when event is sent to my webhook URL).  I’ve tried googling it but no use. I cannot seem to find anything in documentation as well. Is there anyone WHO can help me with this?  

Below are the top knowledge base articles for the month of April 2023.KB 1540 - AOS Only - What to do when /home partition or /home/nutanix directory on a Controller VM (CVM) is full KB 7503 - NX Hardware [Memory] - DIMM Error handling and replacement policy KB 8885 - Alert - A15039 - IPMI SEL UECC Check KB 1113 - HDD or SSD disk troubleshooting KB 4409 - LCM: Life Cycle Manager Troubleshooting Guide KB 5228 - NCC Health Check: pcvm_disk_usage_check KB 13476 - Domain Manager Internal Service has Stopped Working (helios) KB 14671 - LCM: /home partition is filling up due to continuous lcm log collection KB 2090 - AHV host networking KB 3786 - Alert - A1081 - CuratorScanFailure KB 4519 - NCC Health Check: check_ntp KB 8569 - Accessing Prism from Chrome browser blocked by ERR_CERT_REVOKED error KB 13136 - NCC Health Check: microservice_infrastructure_status_check KB 2473 - NCC Health Check: cvm_memory_usage_check KB 4872 - How to cancel an ongoing LCM update operation using the "Stop Updat

Below are new knowledge base articles published on the week of April 23-29, 2023.KB 14475 - Space Accounting | Nutanix Storage Usage Guide and FAQ KB 14515 - Space Accounting - Determining VM Space Usage KB 14516 - Space Accounting | Identifying Snapshots on a Nutanix Cluster KB 14525 - Space Accounting - Are the space saving settings on my containers configured correctly? KB 14600 - Space Accounting | Cluster space used by images KB 14617 - NDB - Scale Database UI for MSSQL DB Log Area "xx GB used of allocated xx GB" does not change after the size is extended KB 14639 - Prism Central - App Switcher showing no apps after upgrade to 2023.1.0.1 due to no IP address set to NTNX_LOCAL_AZ account KB 14659 - CMSP upgrade failed during PC upgrade from 2022.6.0.1 to 2022.9 KB 14665 - Migrating from ESXi to AHV Windows VMs not updating DNS records to DNS server KB 14670 - Uploading SSL certificates on PRISM could fail due to SSL certificates are password protected KB 14681 - Simultaneous VM mig

Below are new knowledge base articles published on the week of April 16-22, 2023.KB 14024 - Calm application deployment fails with "Failed getting banner" KB 14386 - Deploy button visible for Nutanix Category Apps instead of Open button post deployment KB 14572 - MS Office files fail to save to Files Server with message "Access Denied: Contact your administrator" KB 14583 - Elasticsearch failing due to missing rule for port 4199 in iptables KB 14619 - LCM BIOS upgrade to P[X]70.002 version on G6/G7 nodes fails with 'Host did not reboot in 3600 secs time' error due to CATERR events being generated on it KB 14626 - AHV upgrade fails with "Could not deserialize msgpack message" error while running salt KB 14634 - Nutanix Files - PC Files Manager unable to reach File server if PCVM and File Sever internal network are on different subnets KB 14637 - MSSQL: AG provision operation fails with error "An error occurred while creating the cluster <OU_path> An error occurred creating cluster

Below are new knowledge base articles published on the week of April 9-15, 2023.KB 12864 - Alert - A400117 - PolicyEngineVersionMismatch KB 13793 - NDB - scheduled daily snapshots break MSSQL differential backup chain KB 14359 - Prism Central - Redeploy errored out Infrastructure App from My Apps in Admin Center KB 14419 - Nutanix Objects Alert - kUnsynchronizedClock KB 14420 - Nutanix Objects Alert - kLowWALStorage KB 14421 - Nutanix Objects Alert - kMultipleFailedLeaderElections KB 14508 - No license eligible to convert KB 14517 - Unable to power on or migrate VMs to GPU enabled host KB 14599 - Prism Central 1-click deployment may fail when the gateway does not respond to ICMP Echo requests KB 14608 - Exporting an AHV VM using UEFI to OVA and importing to ESXi cluster causes an unbootable VM.Note: You may need to log in to the Support Portal to view some of these articles.

Below are new knowledge base articles published on the week of April 2-8, 2023.KB 13467 - No compatible products found when uploading cluster summary file KB 13903 - LCM Pre-check: "test_node_removal_status" KB 14104 - NCC Health Check: check_cvm_ssh_security KB 14121 - LCM Pre-check: "test_expand_cluster_status" KB 14277 - LCM Precheck: test_lacp_configuration KB 14304 - LCM 2.6: LCM upgrade will not fail when num_candidates > 0 KB 14407 - NDB | MSSQL AG Clone group deployment fails KB 14465 - Cluster outage can occur during multi-node removal when services go down on node which is yet to be detached KB 14522 - Slow start time of Siemens NX application on AHV due to FlexLM network query KB 14558 - Nutanix Cloud Cluster (NC2) on AWS - High space utilization during/post cluster recovery from S3 KB 14561 - License alert - Cluster is under-utilizing the Files license capacity. Usage: 0.00 TiB, Allowed license capacity: 1.0 TiB KB 14566 - NDB - OracleDB patching leaves old home and grid

Hello, I understand that if the node fails, the ha function is activated and attempts to recover. If one node fails in a Data Resilience Status Critical state due to a lack of storage space, will the cluster collapse? What happens.

Morning all!I have a 5 node cluster (5.20/ESXi7.0U3).  its about 4-5 years old.  Just got approval to upgrade and ordered a new 5 node cluster.Question:  Is it best to expand current cluster and remove a node at a time, or set up net new and migrate?Looking for suggestions and experience.Thanks in advance!TJ

Can someone provide a brief explanation of Nutanix local key manager and how it handles the following in ‘???’:key access: access to the management console is restricted to authorized individuals abased on job function. changing / updating keys: encryption keys are updated from the management console, software encryption (rekey button) if necessary. revoking keys: ??? (when does revoking keys happen?) recovery keys: ??? (how do you recover if you have the key backup?) archiving keys: keys are archived (backed up) from the management console, managed keys where you download the key backup by setting up a recovery password to decrypt the backup file.  activity logs: ??? (is there activity logs for keys? If yes, where is this stored and how long is the retention before the activity is overwritten?)BTW: I have this link already Native Local Key Manager (nutanix.com) but is does not have any details of the Thanks in advance. 

Below are the top knowledge base articles for the month of March 2023.KB 1540 - [AOS Only] What to do when /home partition or /home/nutanix directory on a Controller VM (CVM) is full KB 7503 - NX Hardware [Memory] - DIMM Error handling and replacement policy KB 8885 - Alert - A15039 - IPMI SEL UECC Check KB 1381 - NCC Health Check: host_nic_error_check KB 1113 - HDD or SSD disk troubleshooting KB 4409 - LCM: Life Cycle Manager Troubleshooting Guide KB 2090 - AHV host networking KB 13476 - Domain Manager Internal Service has Stopped Working (helios) KB 3786 - Alert - A1081 - CuratorScanFailure KB 2473 - NCC Health Check: cvm_memory_usage_check KB 2475 - NCC Health Check: storage_pool_space_usage_check KB 5228 - NCC Health Check: pcvm_disk_usage_check KB 8514 - NCC Health Check: fs_inconsistency_check KB 13150 - NCC Health Check: cfs_fatal_check KB 13136 - NCC Health Check: microservice_infrastructure_status_check KB 13870 - Prism Virtual IP is configured but unreachable alert and VIP be

Below are new knowledge base articles published on the week of March 26-April 1, 2023.KB 13758 - NCC health check: usb_nic_status_check KB 14480 - LCM 2.5: Intel hardware DCF firmware upgrade failure since the KCS Policy Control Mode is currently set to "RESTRICTED" KB 14488 - Error: Protection domain 'XXXX' has entities in clone. Delete the clones before deleting this protection domain KB 14502 - ASMFD may cause instability on Linux VMs running on AHV KB 14504 - After enabling CMSP on PC the protected entities under remote AZ shows error "Failed to Fetch" KB 14510 - How to extend storage on SQL database servers managed by NDB KB 14530 - Nutanix Files: "Invalid start IP address" error during deployment KB 14532 - Unable to install NGT as CDROM is not recognized in a Windows VM KB 14538 - VMware Update Manager (VUM) service crashing caused by a large amount of connections made to vCenter KB 14564 - Powering on the VM on the AHV host may fail with the "Unexpected combination of memoryBac

Hi, How can I disable ani-affinity rules ? 

Below are new knowledge base articles published on the week of March 19-25, 2023.KB 13943 - NCC Health Check: mantle_keys_mirroring_check KB 14416 - HW : Sporadic Link down alerts in IPMI Health event logs on a G8 hardware KB 14491 - Nutanix Object - Limitations of an Object-enabled cluster KB 14495 - Genesis service keeps crashing if a public key with a leading space character added to the cluster in PRISM Cluster Lockdown Settings KB 14496 - Era DB-Server Agent upgrade operation failed. Reason: cannot import name 'convert_bytes_to_string' KB 14503 - Data Protection - Error: Specified protection domain XXXX is protecting a Vstore which has id yyyy KB 14512 - Cluster Expansion fails if the new node was previously a Compute-Only node with network segmentation enabled KB 14514 - HPE DX380 G10 Plus: Filesystem Errors and I/O errors on a hypervisor boot volume KB 14519 - AHV and ESXi Lenovo Whitley platform hosts updated to UEFI 1.31 may restart due to NMINote: You may need to log in to th

Hello,I would like to change the password expiration for a local user I have created in the prism element.I’ve tried to change it via the command:nutanix@cvm$ sudo chage -M <MAX-DAYS> admin I’ve managed to do that to the admin user, but when I change “admin” with my local user, It says that the user does not exist in etc/passwd. Is their any way of changing the password expiration for a local user that it is not “admin”.(The user is a cluster admin).

Below are new knowledge base articles published on the week of March 12-18, 2023.KB 13746 - NCC health check: LongRunningSubtasks KB 13913 - LCM inventory fails with the error "nothing to open" on pc.2021.9.0.5 and later due to frequent registration/unregistration KB 14088 - NCC Health Check: check_host_password_expiry KB 14307 - Unable to start docker due to inode exhaustion in Objects cluster. KB 14391 - AHV upgrade or host rolling reboot tasks may fail on AHV clusters with AMD CPU during test_cluster_config pre-check KB 14433 - Objects: Bucket deletion failed with "The bucket you tried to delete is not empty. You must delete all versions in the bucket." error KB 14450 - Oracle DB in Oracle Dataguard configuration shows high latency / lag while performing NDB operation KB 14467 - Cluster will fail to upgrade through LCM if AOS version is 5.10.x or 5.5.x KB 14477 - NCC check may fail to complete due to vCenter connectivity failure KB 14479 - AHV hosts or VMs may lose network connectiv

Greetings, Does the Nutanix Local Key Manager (LKM) satisfy the recommendations/requirements to safely implement the Data at Rest Encryption?The documentation at: https://portal.nutanix.com/page/documents/details?targetId=Nutanix-Security-Guide-v6_5:wc-security-data-encryption-aos-wc-c.html has the warning: "Caution: DO NOT HOST A KEY MANAGEMENT SERVER VM ON THE ENCRYPTED CLUSTER THAT IS USING IT!! Doing so could result in complete data loss if there is a problem with the VM while it is hosted in that cluster." I too share this concern, which led me to investigate External Key Managers, but I am wondering how does using the LKM alleviate this risk? Also, as stated in the Nutanix Bible as well as here: https://portal.nutanix.com/page/documents/solutions/details?targetId=TN-2026-Information-Security:TN-2026-Information-Security "Now that Nutanix supports its own native LKM, Nutanix also takes the KEK and wraps it with a 256-bit encryption key called the machine encryption key (MEK). The

Below are new knowledge base articles published on the week of March 5-11, 2023.KB 12446 - NCC Health Check: pc_to_ahv_secondary_ip_reachability_check KB 14162 - Foundation Failing Due to Incorrect Date or TimeNote: You may need to log in to the Support Portal to view some of these articles.

Below are new knowledge base articles published on the week of February 26-March 4, 2023.KB 13178 - NCC Health Check: cluster_node_count KB 13481 - Increasing /dev/sda3 filesystem partition size on Policy VM upgraded to 3.6.1 KB 13653 - Nutanix Database Service | Pulse Telemetry KB 14018 - Alert - A130365 - PauseStretchTriggeredByWitness KB 14032 - Upgrading to NDB 2.5.1 for HA-enabled setups fails KB 14303 - Unable to delete a Nutanix Storage Container KB 14326 - AOS upgrade to 6.1.x (or above) stuck on network segmentation enabled cluster with mixed hypervisors. KB 14366 - Nutanix Database Service - MongoDB brownfield to greenfield conversion fails after upgrade from a version lower than 2.5.1 to a higher one KB 14367 - IPMI Network Configuration Requirements & Best Practices KB 14372 - Data Lens - how to re-enable file server after been disabled KB 14373 - Storage Container Usage may increase after AOS upgrade in ESXi clusters with Thick Provisioned virtual disks larger than 4Ti

We have our Nutanix 5 node cluster installed with VMware vSphere 7.0U3. RF=2 so I should be bale to withstand a 1 node failure. I would like to test the HA capability of VMware/Nutanix by taking a node offline abruptly and ensure everything works as expected before placing production workloads on it.I was thinking of placing a test VM on a node and then pulling the power cables and ensuring that VM is powered up on a remaining host.Does anyone have any better or preferred way to test HA?

Below are the top knowledge base articles for the month of February 2023.KB 1540 - [AOS Only] What to do when /home partition or /home/nutanix directory on a Controller VM (CVM) is full KB 7503 - NX Hardware [Memory] - DIMM Error handling and replacement policy KB 8885 - Alert - A15039 - IPMI SEL UECC Check KB 1381 - NCC Health Check: host_nic_error_check KB 4409 - LCM: Life Cycle Manager Troubleshooting Guide KB 3827 - Alert - A130087 - Node Degraded KB 1113 - HDD or SSD disk troubleshooting KB 2090 - AHV host networking KB 2473 - NCC Health Check: cvm_memory_usage_check KB 13870 - Prism Virtual IP is configured but unreachable alert and VIP becomes permanently unreachable observed on AOS 6.5.1 and later KB 3786 - Alert - A1081 - CuratorScanFailure KB 8514 - NCC Health Check: fs_inconsistency_check KB 4519 - NCC Health Check: check_ntp KB 13150 - NCC Health Check: cfs_fatal_check KB 5228 - NCC Health Check: pcvm_disk_usage_check KB 8094 - NCC Health Check: disk_status_check KB 4158 -

Below are new knowledge base articles published on the week of February 19-25, 2023.KB 13146 - Flow Network Security may block traffic using virtual IP address or forwarded traffic KB 13587 - List of IAM Migration Alerts during Upgrade to Prism Central pc.2022.9 KB 14017 - Alert - A130354 - FailoverTriggeredByWitness KB 14308 - Network performance of VXLAN interfaces inside VMs severely degraded if VM is running on AHV host with Broadcom BCM57414 NICs with Hardware Generic Receive Offload (GRO) feature enabled KB 14332 - Metric IO stats missing from Prism or the Insights Portal KB 14343 - Prism Central - Templates view is empty for LDAP Users on Prism Central with enabled Microservices Platform (CMSP) KB 14344 - Prism Central: report is missing values or shows only a dash (-) KB 14351 - How to obtain quota limits via API after enabling Calm Policy Engine KB 14353 - Unable to change the VPN route priority in Nutanix DRaaS KB 14369 - AHV Metro/SyncRep : Services on Pacemaker unable to ru

I got existing 3 nodes with Dell XC740 running with AHV. And I’ve order new 3 nodes x Dell XC750 but it came with factory install ESXi 7.0.Question is any special instruction do before adding new node to the existing cluster and I would like to new node XC750 to run the same AHV hypervisor in existing cluster too. So, can I follow expand step here Prism 6.5 - Expanding a Cluster (nutanix.com)?Thank you.