AHV 5.11.1.2 upgrade hung, CVM won't start | Nutanix Community
Skip to main content

AOS upgrade appears to go well, but my CE three node cluster didn’t complete the first AHV upgrade. Now CVM is off line.  I’m looking a logs but not sure what to look for. 

/var/log

proot@NTNX-04524900-A log]# cat ahv-host-agent.log
2020-01-30 19:02:44,734 host_agent_.py:34 INFO Starting host agent
2020-01-30 19:02:44,734 host_agent_.py:67 INFO Generating /var/lib/ahv-host-agent/schema//api.json
2020-01-30 19:02:44,818 host_agent_.py:92 INFO Connecting to libvirt
2020-01-30 19:02:44,819 task_store.py:354 INFO Started task garbage collector
2020-01-30 19:02:44,821 host_agent_.py:98 INFO Connected to libvirt
2020-01-30 19:02:44,821 manager.py:50 INFO Starting CollectorManager
2020-01-30 19:02:44,825 manager.py:50 INFO Starting pid monitor OvsVSwitchdMonitor
2020-01-30 19:02:44,825 manager.py:110 INFO EventManager thread is listening on 127.0.0.1:2031
2020-01-30 19:02:44,825 process_monitor.py:99 INFO Starting ovs-vswitchd process monitoring ...
2020-01-30 19:02:44,872 server.py:56 INFO Starting server on port 127.0.0.1:2030
2020-01-30 21:14:56,889 host_agent_.py:77 INFO Stopping host agent
2020-01-30 21:14:56,890 manager.py:55 INFO Stopping pid monitor OvsVSwitchdMonitor
2020-01-30 21:14:56,918 process_monitor.py:113 INFO Received ovs-vswitchd process monitoring exit event, terminating monitoring ...
2020-01-30 21:14:56,918 process_monitor.py:116 INFO ovs-vswitchd monitoring thread terminating ...
2020-01-30 21:20:59,707 host_agent_.py:34 INFO Starting host agent
2020-01-30 21:20:59,708 host_agent_.py:67 INFO Generating /var/lib/ahv-host-agent/schema//api.json
2020-01-30 21:20:59,769 host_agent_.py:92 INFO Connecting to libvirt
2020-01-30 21:20:59,770 task_store.py:354 INFO Started task garbage collector
2020-01-30 21:20:59,781 host_agent_.py:98 INFO Connected to libvirt
2020-01-30 21:20:59,781 manager.py:50 INFO Starting CollectorManager
2020-01-30 21:20:59,785 manager.py:50 INFO Starting pid monitor OvsVSwitchdMonitor
2020-01-30 21:20:59,786 manager.py:110 INFO EventManager thread is listening on 127.0.0.1:2031
2020-01-30 21:20:59,786 process_monitor.py:99 INFO Starting ovs-vswitchd process monitoring ...
2020-01-30 21:20:59,835 server.py:56 INFO Starting server on port 127.0.0.1:2030
 

Hi Mark,

The CVM is most likely still in maintenance mode and maybe the host as well. 

to check if the CVM is in maintenance run this on any other CVM “ncli host list”

You will see the hosts (the CVMs) and if it’s in maintenance mode.

If you want to check if the host itself is in maintenance you can run “acli host.list”

It’s also very simple to pull a CVM/host out of maintenance mode: https://portal.nutanix.com/kb/4639