Solved

Cluster DOWN. Unable to access IPMI because lacked of credential

  • 26 August 2023
  • 7 replies
  • 344 views

Badge

I got an issue where the cluster is DOWN and I unable to access the CVM and AHV via SSH. I have requested for credential to access IPMI, but they do not found any valid credential to access IPMI, even with a default password. There 4 nodes in 1 block, which I only have an access to 1 node [CVM and AHV]. I also unable to access the Prism. Is there any possible way to UP the cluster? Besides, I unable to create case to support.

icon

Best answer by sl.farhanparkar 26 August 2023, 20:37

View original

This topic has been closed for comments

7 replies

Userlevel 3
Badge +5

Hi,

  1. You will either need to access IPMI or can u connect KVM to node and access AHV/CVM
  2. Had you tried default IPMI credentials, till G7 it was “ADMIN” starting G8 its node serial number.
  3. As you said you can access 1 node, can u access other three nodes from that accessible node.
  4. my first recommendation is look at network port configuration.

Hope there is no production running on it.

F>P

Badge

Hi, really appreciate for your respond.

  1. I might be able to access IPMI on the running node where I could change the password via AHV but it seems like I only able to access 1 IPMI. Besides, I have no experience in KVM but willing to know.
  2. Yes, I have tried both credential ADMIN/ADMIN (uppercase and lowercase) and ADMIN/Serial Number, still not working. Seems like they has changed the password before.
  3. I unable to ssh to another nodes either nutanix@cvm or root@ahv.
  4. The network port is fine.

Fortunately, there is no production running in the cluster.

I wonder if it is possible to change the IPMI password by connecting directly to the node?

Userlevel 2
Badge +3

What hardware are you running on? You say that you are unable to access IPMI or CVM/AHV over SSH. Does Prism access work? Are you running Prism Central or only a Prism Element cluster instance? Does the IPMI web page display or are you unable to connect completely?

Userlevel 3
Badge +5

Hi,

Yes you ca always change the IPMI password from AHV through physical monitor and keyboard, if you are able to login to AHV though.

Check what you can see on the node console by directly connecting monitor.

F>P

Badge

What hardware are you running on? You say that you are unable to access IPMI or CVM/AHV over SSH. Does Prism access work? Are you running Prism Central or only a Prism Element cluster instance? Does the IPMI web page display or are you unable to connect completely?

The cluster is running on NX-1450-G4. Unable to access Prism even trying to browse using the only 1 running CVM IP. This cluster should be running the PC, but they powered off the PCVM for a moment before this issue occured. The IPMI web page displayed normally, but the password already changed and unable to found the current password. So, I try to get some advice on how I can access the IPMI at least to power on the host.

Badge

Hi,

Yes you ca always change the IPMI password from AHV through physical monitor and keyboard, if you are able to login to AHV though.

Check what you can see on the node console by directly connecting monitor.

F>P

Hi,

Thanks for your advice sir. Is there anything you would like share or remind me before we do the changes? I find it hard found a documentation on how to setup new password direct to the node. 

Userlevel 3
Badge +5

Hi Amr,

Not anything in particular, the guide line is as follows

  1. Connect monitor, and keyboard to each node and make sure you can see AHV login prompt, and able to login to AHV with root.
  2. Once logged in to node, check network configuration using ifconfig command and able to ping gateway or other IP. (you might need to check physical cables are proper and all the switch ports are configured)
  3. Try pinging CVM on 192.168.5.254 from AHV prompt on every node.

IPMI is only hardware monitoring, any modifications does not impact, if there is any data you should be more worried of AHV/CVM.

To login to AHV you should have credentials, all the nodes AHV root passwords is same.

DM me on the above so i can guide you on further action plan. 

F>P