Look like 2020 is a quiet year for Nutanix. I’m rather new to Nutanix. Just created 2 clusters, here are my experiences and seek other for knowledge & advice.
Setup 1 ; 3 x SFF PCs
2 x Lenovo M93p, i7-4770, 32GB
One with Evo 850 250GB & Evo 850 500GB ssd
Another with 2 x Evo 860 500GB
1 x HP Z230, i7-4770, 32GB, Transcend 512GB and Evo 860 500GB SSD.
2 x Samsung USB3 Bar 32GB (thumb drive)
1 x Sandisk 32GB SD card in a USB reader (thumb drive)
PCs connected to a single TP-link 1gbits switch.
Setup 2; a thin HP 14s laptop with Win10pro, VMware workstation 15.5.2, i7-10510U (4/8), 64GB, 512GB Nvme, 1TB SSD
3 x VMs with 4vCPU, 16GB, 200gb and 500gb vmdk.
- Download the CE image and the ce.vmdk, into the laptop
- Create a VM and test booting the image, then add “<pmu state='off'/>” into the file “/home/install/phx_iso/phoenix/svm_template/kvm/default.xml”. Change the “/var/cache/libvirt/qemu/capabilities/3c76bc41d59c0c73xxxxxx...xml” file by deleting “pc-i440fx-rhel7.2.0…” and changing one line “pc-i440fx-rhel7.3.0” to “pc-i440fx-rhel7.2.0”
- Create a Centos 7 OS VM, mount the tested image file into it, then using fdisk and resize2fs to increase the size of the image to 15GB. (reason; found the default too small and during test it got up to 80%+ usage. Select 15GB to fit into 16GB USB drive) Test the image by creating a single cluster VM.
- Using Rufus 3.5p (3.10 fail sometime) to create bootable USB drives.
- Set laptop and SFF PCs to UTC time (reason; the default installation does not ask for timezone & got timing issue if I use local time)
- Install all SFF with CE via the USB, and “cluster -s IPaddresses create”.
- Install another cluster with the laptop & VMware Workstation.
- Even after I set the hardware to UTC time, there are reported of NTP configuration issue. Check via “ntpq -pn” , show it did get the time from external default NTP. Got this in Single Cluster setup too. I’m at timezone +8. So, setting to UTC should resolve this issue, but it did not. After reboot, the alarm did not appear, so I leave it. Which file should I set in the pre-installation image to correct timezone?
- Ubuntu 18.4 VM failed to boot after installation. Need to try again..
- Windows 2016 need to install NGT for the network to work. Does this issue appear in current version of Nutanix? Took me some time to figure NGT need to be installed (with nic driver), never occur to me as other worked “out of the box”.
- Once, I need to change the file twice “/var/cache/libvirt/qemu/capabilities/xxxxxx...xml”. It creates another file with the old setting after booting up and VM can’t be created without changing this file. This is during single cluster test.
- I can’t login to the NEXT account to complete the Cluster creation via Prism during the initial setup, if the Browser is on a difference timezone (time) with the cluster. And there is no error or message telling this is the issue.
- If I connect to Prism via one of the CVM IP, I can’t connect to the Prism via cluster IP. Believe this is due to the IP redirection.
- Running off the laptop, the CPU utilization is very high, even after run overnight in hope to stabilize it. The Prism loading is slow. The password sync still waiting for response from the other nodes after 10hours+. On the same laptop, I installed nested ESXi servers, vcenter, window DNS/NTP server and FreeNAS (for iSCSI), the CPU load is much lower. I don’t run both setup at the same time. It is not practical to run Nutanix cluster in my laptop, maybe 8 cores 128GB RAM can handle it.
- Some time can’t boot the SFF PC using USB3, USB 2 no issue.
- 3 times noticed the SFF PC booted to the Nutanix splash screen, not able to login via the console, but it actually booted AHV, able to ssh into and start the cluster.
- What is svm? old name of CVM?
- With CE version, should we shutdown using “cvm_shutdown -P” or “shutdown -P” for CVM? Used both, if the first failed “can’t get token error”, I use the other command.
- Got “Latency between CVMs is higher than 15ms” alarm while trying to install 2 VMs; Centos and Windows 2016. Centos installation very slow, still at 242/308 packages after 2hours.
- Got this error on the SFF PC cluster upon first reboot of the setup; “Possible degraded node 192.168.0.## with Controller VM ID 6 reported by component zookeeper-monitor.” Ask to contact Nutanix support.
- Not able to get into the VM BIOS or able access the boot screen, let say you want to interrupt the boot to get into WinPE, etc.. for troubleshoot.
Wouldn’t be using the cluster in the Laptop, it just too slow.
Is there way to get Prism center eval? Other than via the demo website?
Is way setup a nutanix lab with ESXi?
Any advice? My hardware setup too old, slow?