Hi everyone,
I am trying to stop/destroy a 3-node Nutanix AHV cluster running on HPE ProLiant DX hardware in an offline/dark-site environment to reconfigure network IPs.
Whenever I run "cluster stop" or "cluster destroy", the command fails with the following critical error: "CRITICAL MainThread cluster:3611 Destroy is in progress on the nodes: ['192.168.10.18']" Environment details:
- Hardware: HPE ProLiant DX (Enterprise AOS)
- Nodes: 3 (192.168.10.14, 192.168.10.15, 192.168.10.18)
- Current State in 'cluster status': * CVM: 192.168.10.14 Up * CVM: 192.168.10.15 Up, ZeusLeader * CVM: 192.168.10.18 Up, Unconfiguring
- User VMs: All powered off (State: Off)
What is happening:
- On CVM .18, ~/data/logs/genesis.out is stuck in a loop reporting: "INFO node_manager.py:1124 Unconfiguring node... Using legacy firewall framework as node is in unconfigured state"
- Inspecting $(which cluster) around line 3611 shows an RPC check against the SVMs checking for ongoing destroy operations. Because node .18 returns True, the script raises log.FATAL and aborts execution.
- Attempts to abort tasks via "ecli task.list" or clean common marker files did not reset the unconfiguring state of the node.
Goal: I need to either gracefully stop the cluster to run external_ip_reconfig or cleanly destroy the cluster to recreate it with the new IP scheme from scratch. How can I force CVM .18 out of the "Unconfiguring" loop, or how can I cleanly wipe/reset cluster metadata across all 3 nodes so they can be re-initialized? Any guidance is appreciated. Thanks!
