Deployment Success

Customers can observe cluster issues when they use more than 90 percent of the total available storage on the cluster. This article provides general guidelines on the maximum storage utilization on a cluster. The total available storage capacity on a Nutanix cluster is the sum of all the available storage space across the nodes.Customers should not try to use all the available space in the cluster. Sufficient space should always be available in the cluster in case a failure occurs. For example, when a disk fails in the cluster, the extent groups that were present on that disk have to be copied to other disks to ensure that all the data is at the configured replication factor. If the disk space is unavailable for this activity, then there is a risk of data loss if more failures occur with the data in an under-replicated state. The formula for calculating the maximum recommended usage for clusters is one of the following. Recommended maximum utilization of a cluster with containers using

In some scenarios, when you enable the remote support tunnel, it’ll tell you that it has been temporarily enabled but the status will show “disabled”.To troubleshoot, you can start by checking Basic IP connectivity to nsc01.nutanix.net or nsc02.nutanix.net. If that times out, then it is either a DNS resolution problem or a firewall issue.Check the firewall rules of your system to allow outbound connections to nsc.nutanix.com on port 80 or 8443.For more details on troubleshooting, check KB-1044

Hello Team, I’m running a small 3 node cluster, during an AHV upgrade to the latest version one of the servers failed to reboot so AOS started to rebuild trying to restore HA. After several hours rebuilding failed, looking at the logs I saw the message: “not enough space available”. If I’m not mistaken a 3 node cluster can tolerate only one node down, but lets say the two running nodes had enough space, is it possible to restore HA? It basically means that after some time rebuilding, if one of the 2 remaining nodes fails, cluster is still up in a single node mode.Just curious because it looked like AOS tried to rebuild HA despide only 2 nodes were up

Below are new knowledge base articles published on the week of October 4-10, 2020.KB 9646 - Pre-check: test_is_nos_upgrade_supported_on_esx KB 9782 - LCM pre-check : is_cvm_in_maintenance_mode KB 9876 - 1-click Hypervisor Upgrade from ESXi 6.x to ESXi 7.0 fails with "Upgrade bundle is not compatible with current VIBs installed" on Dell platforms KB 9879 - LCM Pre-check: test_nx_ipmi_health_check KB 9892 - NCC check marvell_boss_card_status_check fails on ESXi 7.0 on Dell platforms. KB 10018 - VirtIO 1.1.6 installation on Windows 7, Windows Server 2008 R2 KB 10068 - Era 2.0 FAQs KB 10070 - Calm: VM image upload fails with error "Unexpected error: the following NVRAM files cannot be imported: calm-vm-pc-x.x.x-calm-x.1-file1.nvram." KB 10073 - LCM 2.3.4 NIC Firmware Upgrade limitations KB 10094 - Move - Ability to NOT Retain static IP and set it to DHCP on destination cluster KB 10097 - Cassandra Crashing with: "None of the SVM's IPs on interfaces match the service vm external IPs in Zeus

Note -  Nutanix highly recommends using Nutanix Move to migrate VMs to AHV. See the Nutanix Move documentation at the Nutanix Support portal. This KB should only be used if Nutanix Move cannot be used or for reference only. For large scale migrations of business critical systems, Nutanix Global Services organization provides resources to assist with streamlining migration scenarios. For information on available services, see: http://www.nutanix.com/services/consulting-services/.The following high-level steps are required when migrating Linux VMs from another hypervisor to AHV. Determining what VirtIO drivers are available in the Guest OS kernel and deciding which BUS ((IDE, SCSI, etc.) type to use when creating AHV disks for the VM. Determining what VirtIO drivers are built into the Guest OS initial boot image (initrd or initramfs) to allow booting the VM in AHV. Rebuilding the GuestOS initrd or initramfs with VirtIO drivers (If needed). Updating Guest OS boot configuration files

As companies become more security aware, third party security tools are being utilized more heavily than ever before. One such tool is a security scanner which can review open network ports within an environment and report back on certain vulnerabilities (CVEs). This includes the open ports of Nutanix specific components such as the IPMI.While it is important to keep the IPMI/BMC upgraded to the latest version so as to integrate the latest security patches, there are CVEs that will still report as failed by scanners based upon the default IPMI configuration. This is due to the virtual media port (623) and the iKVM port (5900) being opened by default.The virtual media port allows the user to open a remote session to the host console and the iKVM port allows the hosts to query information from the BMC.The specific CVEs affected by these two ports being open can be found in KB 2555. NOTE: If these features are disabled, you will be unable to query any BMC info nor able to open a remote co

Do you already have many security policies defined within one instance of Flow and, have another instance where you need the same set of policies but do not wish to recreate them? Or, do you wish to simply have a backup of your existing security policies just in case you should ever need to restore them sometime in the future?Flow has the native ability to export (and subsequently import) security policies that have already been defined previously. Policies are exported into a single binary file, which can then be transferred to a different instance of Flow or stored-away for backup purposes.Please also note that, when importing a previously exported binary file, any existing policies which are already defined within a given Flow instance are automatically removed in-favor of the newly imported policies.You can find more information regarding this within the Exporting and Importing Security Policies section of the Flow Microsegmentation Guide.

Synopsis: The goal of this workflow is to walk-through troubleshooting VM to VM communication issues in a Nutanix Cluster. Most customers are very vague when they state they have a networking issue. We will go through painting a complete picture of the network topology by asking the right questions and running commands on the Hypervisors.  Initial Triage:Questions to Ask:  What hypervisor is running on the cluster?  What guestOS is running on the VMs? Are the VMs on the same node or different nodes?  Are the VMs configured to use the same VLAN?  What method is the customer using to test connectivity?  Is there any Firewalls or ACLs that would stop this VM traffic?   Information to gather:  NIC teaming/bond configuration on node. Switch vendor and model from upstream switch. Interface configurations for the interfaces connecting to the nodes. If ESXi is the customer running  on a Standard vSwitch or Distributed vSwitch? VLAN information for each VM. IP and Subnet Mas

Hi all.I’ve been trying to figure out how I can execute a PowerShell script inside a guest VM, both Linux and Microsoft, on AHV through the host but can’t find any solid information on the topic.There is a discussion called “Execute Script Inside AHV VM?” but that is only for initial configuration of the VM. I’m looking for a way to execute an arbitrary script on any running VM without having access to the VM through its default network configuration.It’s basically a hosting situation where customer VMs exist within their own isolated environments and I’m responsible for running various scripts for - among other things - joining new servers to AD, installing SQL Server, patching the OS, etc, etc.Looking at this post there seems to be a way to run scripts through NGT but when reading the Nutanix Bible that option seems to be limited to VM creation or cloning.Any workaround I can come up with doesn’t scale well when we reach thousands of VM’s and hundreds of customers. Is there a way to

Are you new to Era and want to learn more about it? Are you an experienced engineer working with the product looking for answers?Era is a database as a service (DBaaS) that automates and simplifies database administration, bringing one-click simplicity and invisible operations to database provisioning and life-cycle management. Nutanix has an article with over 50 questions answered about Nutanix Era 2.0. The article covers questions on the variety of topics, such as:Time Machines Profiles Provisioning and Cloning Across Multiple CLusters SAP HANA on Era Copy Data Management for Multiple Databases SQL Server Patching SQL Server Database Group PostgreSQL Patching Oracle Restore PostgreSQL RestoreSome of the questions answered are:Can a single Era management plane handle multiple Nutanix clusters?What type of networks are supported for Era Agents?Can two or more pre-2.0 Era instances be converged into one?What version of Oracle is supported for Oracle Restore?Can we clone a few databases

Please consider the possibility of incorporating the existing IP scheme in the new infrastructure. If changing the IP address is the only option we can utilize a script to change the CVM IP address. You can use the external IP address reconfiguration script in the following scenarios: Change the IP addresses of the CVMs in the same subnet. Change the IP addresses of the CVMs to a new or different subnet.In this scenario, the external IP address reconfiguration script works successfully if the new subnet is configured with the required switches and the CVMs can communicate with each other in the new subnet. Change the IP addresses of the CVMs to a new or different subnet if you are moving the cluster to a new physical location.In this scenario, the external IP address reconfiguration script works successfully if the CVMs can still communicate with each other in the old subnet.  Following is the summary of steps that you must perform to change the IP addresses on a Nutanix cluster. 

We have a 15 block HPE environment built with AOS 5.15.2. we need to enable flash mode on a NVMe device (vmdk) which is presented within vSphere but cannot be seen via prism element under the VM vDisks or via ssh shell to cvm’s is this feature not currently supported? any ideas I am struggling to find much on the support portal?still unsure on this how do we pin the NVMe vmdk to the performance tier  cheers

If you have a storage container on the cluster and the name starts with a “#”, you may see this error while trying to upload an image:"Could not access the URL nfs://127.0.0.1/%23ISO_Images/.acropolis/image/106ac31b-6236-4534-a2ae-808c08bb912f: Failed to parse the file size" That happens because the URL cannot have the # in the name and it gets automatically replaced with %23. Therefore, this creates the inconsistency between the container name and the URL.To resolve the issue, rename the container and remove the # from the container name and retry the image upload.Take a look at KB-10117 for more information.Check this guide on storage containers.

To verify if we have replaced DIMM on correct slot and CPU we can use the following method We can look at hardware.history file which records any replacement for example DIMM,SSD,HDD,NIC being made to that node. This file remains local to each CVM After we replace DIMM we will boot the host up Power on CVM and run following command ncc hardware_info update_hardware_info           This will update the hardware.history file present in ~/config directory and it will recognize any new replacement Open hardware.history using less less ~/config/hardware.history Go to last line by pressing shift+g Check out the most recent replacement it should look something like this Mon, 05 Oct 2020 15:37:01 CDT|Component changed: Memory module{locator:P1-DIMMC1} Old values: |{serial_number: 423D07AF}|(Last Detected Mon, 05 Oct 2020 10:13:25 CDT) New values: |{serial_number: 152057A5} It mentions DIMM P1-DIMMC1 was replaced and its serial number is changed from 423D07AF to 152057A5 This is a quick and

Hello,i have some questions regarding “Switch stacking”1-) Is it possible to use " 2 stacked switches " as TOR with AHV? there will be a problem if we use this configuration?2-) The best practice is to use 2 Stacked switches or 2 individual switches?We plan to use Active-Backup configuration and conect SFP to Switch1 and the other SFP to Switch2I am not a network specialist so i am not sure if both switches are stacked, and we plug 1 SFP to SW1 and the other SFP to SW2, the active passive configuration will work

Hi, I am working on an integration between Nutanix and Citrix but stuck at the moment at this point: Where in the Citrix Cloud can I find these values?Kind regardsChristian

The upgrade process for the VCSA from a major release to another is as follows:A new VCSA with a temp IP is created in the vSphere host/cluster by the upgrade process. The upgrade process migrates the config/data from the old VCSA to the new one. The Old VCSA is shutdown and the new VCSA is renamed/re-ip with the values of the old VCSA. New VCSA is then rebooted.At this point the new VCSA should have the old VCSA name and IP address.  My question for those that have done this already is, how does the Nutanix cluster Prism element reacts to this in regards to its vcenter registration? Will all this be transparent to it or will it see the new VCSA as a new device and create a duplicate entry? I assume the migration process will copy SSH keys and certs from the old VCSA to the new one so Prism won’t bat an eye, but I just wanted to confirm. 

Hello ... can anyone provide feedback on getting Network Visualization working with Cisco Nexus 9K Switches. The Nexus Series is on the Supported Switch list, but I've had a ticket open with Support for weeks and we can't get it working. https://portal.nutanix.com/#/page/docs/details?targetId=Web-Console-Guide-Prism-v510:wc-network-visualizer-supported-switches-r.html LLDP is enabled globally on the 9K, and I can populate the 9K switch info into Prism just fine. The issue is I can't get any port data. Nutanix Support is saying the issue is by default the "port-id-subtype" is set "locally-assigned", and it needs to be changed to "interface-name". The 9Ks are in ACI-Mode, not NX-OS, and no one seems to know how or where the change is made. Has anyone gotten this setup to work? Here are some pics from my environment. Thanks!

Hi, I have one CVM out of space in /home, I have seen that I have the file localhost_access_host.txt with almost 20GB.Could I rotate or delete this file?In another CVM I don’t see this file.Regards,Antonio Maeso

In the first 3 Sections we saw solutions with classical snmp monitoring, dynamic monitoring with checkmk and metrics with prometheus and grafana.No we try the windows way. A Windows Application from the german vendor “Paessler” which could be tried for free for 100 sensors (not Nodes or VMs!).We download the Package here and install.After successfull Installation we get a Browser Page on Port :8080 and a LoginPrompt with default  prtgadmin / prtgadmin.We login and create a new Host over the Menue Geräte/Geräte hinzufügen for our Nutanix Cluster:Zum Einsortieren hab ich hier “Virtuelle Systeme” gewählt und keinen eigenen neuen Knoten angelegtType in Name and IP from our Cluster (Nutanix Cluster IP) ATTENTION: Scroll DOWN and type in the Values from your SNMP Secrets!:  After Click on OK the Host is created and a basic check is made via PING.. The System tries an autodisovery now but this is not needed for a nutanix cluster here! We klick on NOT “Automatic Discovery”  (takes very long ag

The dynamic Inventory of a Hosts and the creation of Service Checks is one of the benefits of the checkmk opensource tool CheckMK. This Tool could be installed as a single Installation but it is also part OMD or Openitcockpit, which are using checkmk as an extension In my Homelab i will give a short overview of the use of checkmk with Openitcockpit with a nutanix 3 node cluser.Requirements: Enable SNMP in Prsim Centrala) Port 161/UDPb) Ein Username und Kennwörter fuer SHA und AESIf the Requirements are finished just create a new Host in Openitcockpit with Default Values. Ping is the standard Check first then. AFTER the Creation and Export of the Config we chood CHECKMK_DiscoveryWe choose SNMP V3 as Discovery Method and type in the Credentials which we prepared a step above in Prism Central.The FIRST Discovery tooks some time! If no result is shown, the credentials may we wrong or MD5 is set instead of SHA in the Auth section! If its working we get a bunch of discoverd services now:We g

Below are new knowledge base articles published on the week of September 27-October 3, 2020.KB 8607 - NCC Health Check: inconsistent_file_groups_check KB 9072 - NCC Health Check: file_server_task_stuck_check KB 9491 - NCC Health Check: container_on_removed_storage_pool KB 9728 - NCC Health Check: nearsync_stale_staging_area_check KB 9902 - NCC Health Check: vm_updates_disabled_check KB 10050 - Prism Central throwing "ErrorCode: 4" on VM update operations KB 10067 - Karbon - Private Registry Addition Troubleshooting KB 10071 - Move - Service start timed out error on Hyper-V KB 10077 - Alert ID 130096 - Failed to Recover NGT Information for VM KB 10079 - Alert ID 130095 - Failed To Recover NGT Information KB 10081 - Alert - A21014 - CassandraWaitingForDiskReplacement KB 10091 - Ubuntu 20.04 Server installation failes in guest VM running on AHVNote: You may need to log in to the Support Portal to view some of these articles.

Nutanix Clusters Console receives the results of the status checks performed by AWS to see the status of the instances.Status checks on AWS are performed every minute, returning a pass or a fail status. If all checks pass, the overall status of the instance is OK. If one or more checks fail, the overall status is impaired.    There are two types of status checks, system status checks, and instance status checks. System status checks monitor the AWS systems on which instance runs. Instance status checks monitor the software and network configuration of individual instances.If Nutanix Orchestrator detects that AWS has marked system status or instance status of an instance impaired, following WARNING message will be seen in the Notification Center of the Nutanix Clusters Console: More information on - http://portal.nutanix.com/9704 What does Nutanix Cluster On AWS mean :- Nutanix Clusters provides a single platform that can span private and public clouds but operates as a single c

Nutanix Move is a very versatile tool which is used to migrate existing VMs, from various storage sources and hypervisors, into a Nutanix infrastructure. Many users have already enjoyed its functionality and ease-of-use.Often, users will migrate multitudes of VMs into their new Nutanix infrastructure using Move, and then either delete or forget about the Move VM itself thereafter. Later, when more VMs are sought to be migrated, users will either reinstall Move again or attempt to leverage the Move VM that remained from the previous migration.For those users leveraging an existing Move VM within their infrastructure and, as it is generally a good idea to use the latest version of Move when possible, it is possible to upgrade the Move VM to the latest available version right from its own dashboard (and, even by CLI if desired).You can find more information regarding upgrading Move from within the Online Upgrade section of the Move User Guide.

Hardening is the process of securing a system by reducing its surface of vulnerability, which is larger when a system performs more functions; in principle a single-function system is more secure than a multipurpose one. Reducing available ways of attack typically includes changing default passwords, the removal of unnecessary software, unnecessary usernames or logins, and the disabling or removal of unnecessary services. There are various methods of hardening Unix and Linux systems. This may involve, among other measures, applying a patch to the kernel such as Exec Shield or PaX; closing open network ports; and setting up intrusion-detection systems, firewalls and intrusion-prevention systems. There are also hardening scripts and tools like Lynis, Bastille Linux, JASS for Solaris systems and Apache/PHP Hardener that can, for example, deactivate unneeded features in configuration files or perform various other protective measures. We can implement Security Hardening features for Nutani