CVM node unreachable | Nutanix Community
Skip to main content
Solved

CVM node unreachable

  • August 12, 2021
  • 6 replies
  • 1661 views
D
Forum|alt.badge.img+1

Hi Everyone,

 My Nutanix cluster had 4 node running AHV version Nutanix 20170830.337 and AOS version 5.10.9.1 LTS.

Suddenly, one of the node had CVM unreachable issue. When I’m running cluster status command got message 1 CVM down.

I’m try to run nodetool -h 0 ring got something like this. 

When I’m issue cmd ncli host list. I’m notice the problem node got this message “Node marked to be added back to metadata store”

1 of my colleague try to repair host boot device but no luck.

 

What should we do now?

 

 

Best answer by Magdy

@dot_slash Please upgrade your cluster as I can see the AHV and AOS versions are old and this can cause lots of issues. Prism 5.15 - Acropolis Upgrade Guide (nutanix.com)You might as well come across cluster downtime if not upgraded soon.

View original
Did this topic help you find an answer to your question?
This topic has been closed for comments

6 replies

B
Nutanix Employee
Forum|alt.badge.img+1

Hi @dot_slash, it looks like, host is down for a long time. Login to host console vi IPMI and check the current status of the host. Based on the "nodetool -h 0 ring" output, node is detached from metadata ring due to unavailability.

D
Forum|alt.badge.img+1
  • dot_slash
  • Author
  • Voyager
  • 2 replies
  • August 13, 2021

Yes, this host is down for a long time. Any idea how to do?

B
Nutanix Employee
Forum|alt.badge.img+1

Hi @dot_slash is host still down? if yes, could you please post screen shot for the IPMI console? Also provide output of cs | grep -v UP.

if host is down, this might be a hardware issue. Please open case with Nutanix for further assistance.

D
Forum|alt.badge.img+1
  • dot_slash
  • Author
  • Voyager
  • 2 replies
  • August 14, 2021

Hi @Bala Murali Krishna 

host is up. AHIV running, but CVM no connection.

cs | grep -v UP as below

This host is eol & eosl by nutanix but we still using it as DR cluster 

M
  • Magdy
  • Adventurer
  • 3 replies
  • Answer
  • August 15, 2021

@dot_slash Please upgrade your cluster as I can see the AHV and AOS versions are old and this can cause lots of issues. Prism 5.15 - Acropolis Upgrade Guide (nutanix.com)You might as well come across cluster downtime if not upgraded soon.

S

@dot_slash First troubleshooting tip is to keep your cluster up-tp-date as the older versions can cause lots of issues which you cannot comprehend (If you are having a bad day of course).Please follow the official doc for upgrading your cluster and the order of the upgrade is also to keep in mind.

Terms & Conditions