AOS Installation failed with error "because dependencies not met"

Question

Hello All,

I tried to install AOS 5.11.2 with foundation 4.5.1 but I faced from some issues.

The system consists of 01 Bloc NX-3060-G4 with 04 nodes.

The existing AOS version is 5.11.1 and the existing AHV version is 20170830.270.

Please find below all the log output obtained from foundation process :

========================================================================

20191218 03:02:38 DEBUG Setting state of <ImagingStepValidation(<NodeConfig(172.18.8.34) @2890>) @ef90> from PENDING to RUNNING
20191218 03:02:38 INFO Running <ImagingStepValidation(<NodeConfig(172.18.8.34) @2890>) @ef90>
20191218 03:09:40 DEBUG Cache HIT: key(<function common_validations at 0x380d7d0>_()_{'global_config': <foundation.config_manager.GlobalConfig object at 0x47ce150>})
20191218 03:09:40 DEBUG Setting state of <ImagingStepValidation(<NodeConfig(172.18.8.34) @2890>) @ef90> from RUNNING to FINISHED
20191218 03:09:40 INFO Completed <ImagingStepValidation(<NodeConfig(172.18.8.34) @2890>) @ef90>
20191218 03:09:40 DEBUG Setting state of <GetNosVersion(<NodeConfig(172.18.8.34) @2890>) @e850> from PENDING to RUNNING
20191218 03:09:40 INFO Running <GetNosVersion(<NodeConfig(172.18.8.34) @2890>) @e850>
20191218 03:09:40 INFO Node IP: CVM(172.18.8.34) HOST(172.18.8.24) IPMI(10.30.4.14)
20191218 03:13:46 DEBUG Cache HIT: key(<function get_nos_version_from_tarball at 0x28e7ed8>_(u'/home/nutanix/foundation/nos/nutanix_installer_package-release-euphrates-5.11.2-stable-x86_64.tar.gz',)_{})
20191218 03:13:46 INFO NOS Version is: 5.11.2
20191218 03:13:46 INFO metadata update: {"nos_version": "5.11.2"}
20191218 03:13:46 DEBUG Setting state of <GetNosVersion(<NodeConfig(172.18.8.34) @2890>) @e850> from RUNNING to FINISHED
20191218 03:13:46 INFO Completed <GetNosVersion(<NodeConfig(172.18.8.34) @2890>) @e850>
20191218 03:13:46 DEBUG Setting state of <ImagingStepTypeDetection(<NodeConfig(172.18.8.34) @2890>) @6250> from PENDING to RUNNING
20191218 03:13:46 INFO Running <ImagingStepTypeDetection(<NodeConfig(172.18.8.34) @2890>) @6250>
20191218 03:13:46 INFO Attempting to detect device type on 10.30.4.14
20191218 03:13:46 DEBUG factory mode is False
20191218 03:13:46 INFO Checking if this is Quanta
20191218 03:13:47 INFO Checking if this is Intel
20191218 03:13:48 INFO Checking if this is an Ironwood system.
20191218 03:13:49 INFO Checking if this is a Lenovo system.
20191218 03:13:49 INFO Manufacturer ID = 10876
20191218 03:13:49 INFO Checking if this is UCS standalone node
20191218 03:13:50 INFO Checking if this is Dell
20191218 03:13:53 INFO Checking if this is HPE or NEC or HITACHI
20191218 03:13:55 INFO Checking if this is HUAWEI
20191218 03:13:56 ERROR Unable to process the response data
20191218 03:13:56 INFO Checking if this is Inspur
20191218 03:13:57 INFO Checking if this is SMC
20191218 03:14:06 INFO Detected class smc_wa for node with IPMI IP 10.30.4.14
20191218 03:14:06 DEBUG Setting state of <ImagingStepTypeDetection(<NodeConfig(172.18.8.34) @2890>) @6250> from RUNNING to FINISHED
20191218 03:14:06 INFO Completed <ImagingStepTypeDetection(<NodeConfig(172.18.8.34) @2890>) @6250>
20191218 03:14:06 DEBUG Setting state of <ImagingStepPrepareVendor(<NodeConfig(172.18.8.34) @2890>) @6350> from PENDING to RUNNING
20191218 03:14:06 INFO Running <ImagingStepPrepareVendor(<NodeConfig(172.18.8.34) @2890>) @6350>
20191218 03:14:06 DEBUG Setting state of <ImagingStepPrepareVendor(<NodeConfig(172.18.8.34) @2890>) @6350> from RUNNING to FINISHED
20191218 03:14:06 INFO Completed <ImagingStepPrepareVendor(<NodeConfig(172.18.8.34) @2890>) @6350>
20191218 03:14:06 DEBUG Setting state of <ImagingStepInitIPMI(<NodeConfig(172.18.8.34) @2890>) @fc90> from PENDING to RUNNING
20191218 03:14:06 INFO Running <ImagingStepInitIPMI(<NodeConfig(172.18.8.34) @2890>) @fc90>
20191218 03:14:06 INFO Making node specific Phoenix image
20191218 03:14:06 DEBUG Setting state of <ImagingStepInitCVM(<NodeConfig(172.18.8.34) @2890>) @f8d0> from PENDING to RUNNING
20191218 03:14:06 INFO Running <ImagingStepInitCVM(<NodeConfig(172.18.8.34) @2890>) @f8d0>
20191218 03:14:06 DEBUG skipped, this node will be imaged via IPMI
20191218 03:14:06 DEBUG Setting state of <ImagingStepInitCVM(<NodeConfig(172.18.8.34) @2890>) @f8d0> from RUNNING to FINISHED
20191218 03:14:06 INFO Completed <ImagingStepInitCVM(<NodeConfig(172.18.8.34) @2890>) @f8d0>
20191218 03:14:31 INFO Using foundation-layouts egg /home/nutanix/foundation/lib/foundation-platforms/foundation_layout-1.2+r.1087.40c3aba-py2.7.egg
20191218 03:14:31 DEBUG Injecting aurora-1.0.2-6e258dc.tar.gz to phoenix
20191218 03:14:31 DEBUG Injecting tartarus-0.6.1-c1b7f480.tar.gz to phoenix
20191218 03:14:33 DEBUG Cache HIT: key(<function get_md5sum at 0x2f2a1b8>_('/home/nutanix/foundation/lib/phoenix/x86_64/squashfs.img',)_{})
20191218 03:14:33 DEBUG Cache HIT: key(<function get_md5sum at 0x2f2a1b8>_('/home/nutanix/foundation/lib/phoenix/x86_64/squashfs.img',)_{})
20191218 03:14:41 INFO Setting boot mode
20191218 03:14:41 DEBUG No implementation found for setting boot mode to BootMode.LEGACY. Skipping
20191218 03:14:41 INFO Powering off node
20191218 03:14:42 INFO current power state is on
20191218 03:14:42 DEBUG changing power state to off, attempt 1/4
20191218 03:15:08 WARNING failed to change power state, retrying: timeout
20191218 03:15:13 DEBUG changing power state to off, attempt 2/4
20191218 03:16:22 INFO changed power state to off
20191218 03:16:27 INFO Mounting phoenix iso image
20191218 03:16:28 INFO Starting SMCIPMITool
20191218 03:16:38 INFO current power state is off
20191218 03:16:38 INFO Disconnecting virtual media
20191218 03:16:39 INFO Attaching virtual media: /home/nutanix/foundation/tmp/sessions/20191218-030235-1/phoenix_node_isos/foundation.node_172.18.8.34.iso
20191218 03:16:44 DEBUG 1/3] Checking virtual media: /home/nutanix/foundation/tmp/sessions/20191218-030235-1/phoenix_node_isos/foundation.node_172.18.8.34.iso
20191218 03:16:44 DEBUG vmwa status: vmwa status
Device 1: None
Device 2: ISO File [/home/nutanix/foundation/tmp/sessions/20191218-030235-1/phoenix_node_isos/foundation.node_172.18.8.34.iso]

, ASPD_T>, ASPD_T>
20191218 03:16:44 DEBUG Virtual media is mounted successfully: /home/nutanix/foundation/tmp/sessions/20191218-030235-1/phoenix_node_isos/foundation.node_172.18.8.34.iso
20191218 03:16:44 INFO Setting cdrom as boot device for next boot
20191218 03:17:06 INFO Next boot device is set to optical
20191218 03:17:06 INFO Power status is off
20191218 03:17:06 DEBUG changing power state to on, attempt 1/4
20191218 03:17:55 WARNING failed to change power state, retrying: timeout
20191218 03:18:00 DEBUG changing power state to on, attempt 2/4
20191218 03:18:33 DEBUG Ignoring exception None and retry
20191218 03:18:42 DEBUG Ignoring exception None and retry
20191218 03:18:53 DEBUG Ignoring exception None and retry
20191218 03:18:58 INFO Exiting SMCIPMITool
20191218 03:18:58 ERROR Exception in <ImagingStepInitIPMI(<NodeConfig(172.18.8.34) @2890>) @fc90>
Traceback (most recent call last):
File "foundation/decorators.py", line 77, in wrap_method
File "foundation/imaging_step_init_ipmi.py", line 313, in run
File "foundation/imaging_step_init_ipmi.py", line 160, in boot_phoenix
File "/home/nutanix/foundation/bin/../lib/foundation-platforms/foundation_bmc-1.2+r.1087.40c3aba-py2.7.egg/bmc_utils/boot_media.py", line 47, in wrapped
return fn(self, iso, *args, **kwargs)
File "/home/nutanix/foundation/bin/../lib/foundation-platforms/foundation_bmc-1.2+r.1087.40c3aba-py2.7.egg/bmc_utils/_remote_boot_vmwa.py", line 146, in boot
self.boot_from_iso(media.path)
File "/home/nutanix/foundation/bin/../lib/foundation-platforms/foundation_bmc-1.2+r.1087.40c3aba-py2.7.egg/bmc_utils/_remote_boot_vmwa.py", line 358, in boot_from_iso
self.set_power("on")
File "/home/nutanix/foundation/bin/../lib/foundation-platforms/foundation_bmc-1.2+r.1087.40c3aba-py2.7.egg/bmc_utils/_remote_boot_vmwa.py", line 219, in set_power
self.ipmi_password) as ipmi:
File "/opt/cross/el7.3-x86_64/sysroot/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
return self.gen.next()
File "/home/nutanix/foundation/bin/../lib/foundation-platforms/foundation_bmc-1.2+r.1087.40c3aba-py2.7.egg/bmc_utils/ipmi_util.py", line 95, in ipmi_context
"Failed to get BMC session after %s attempts" % attempts)
StandardError: Failed to get BMC session after 3 attempts
20191218 03:18:58 ERROR Exception in running <ImagingStepInitIPMI(<NodeConfig(172.18.8.34) @2890>) @fc90>
Traceback (most recent call last):
File "foundation/imaging_step.py", line 161, in _run
File "foundation/decorators.py", line 77, in wrap_method
File "foundation/imaging_step_init_ipmi.py", line 313, in run
File "foundation/imaging_step_init_ipmi.py", line 160, in boot_phoenix
File "/home/nutanix/foundation/bin/../lib/foundation-platforms/foundation_bmc-1.2+r.1087.40c3aba-py2.7.egg/bmc_utils/boot_media.py", line 47, in wrapped
return fn(self, iso, *args, **kwargs)
File "/home/nutanix/foundation/bin/../lib/foundation-platforms/foundation_bmc-1.2+r.1087.40c3aba-py2.7.egg/bmc_utils/_remote_boot_vmwa.py", line 146, in boot
self.boot_from_iso(media.path)
File "/home/nutanix/foundation/bin/../lib/foundation-platforms/foundation_bmc-1.2+r.1087.40c3aba-py2.7.egg/bmc_utils/_remote_boot_vmwa.py", line 358, in boot_from_iso
self.set_power("on")
File "/home/nutanix/foundation/bin/../lib/foundation-platforms/foundation_bmc-1.2+r.1087.40c3aba-py2.7.egg/bmc_utils/_remote_boot_vmwa.py", line 219, in set_power
self.ipmi_password) as ipmi:
File "/opt/cross/el7.3-x86_64/sysroot/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
return self.gen.next()
File "/home/nutanix/foundation/bin/../lib/foundation-platforms/foundation_bmc-1.2+r.1087.40c3aba-py2.7.egg/bmc_utils/ipmi_util.py", line 95, in ipmi_context
"Failed to get BMC session after %s attempts" % attempts)
StandardError: Failed to get BMC session after 3 attempts
20191218 03:18:58 DEBUG Setting state of <ImagingStepInitIPMI(<NodeConfig(172.18.8.34) @2890>) @fc90> from RUNNING to FAILED
20191218 03:18:58 DEBUG Setting state of <ImagingStepRAIDCheckPhoenix(<NodeConfig(172.18.8.34) @2890>) @f7d0> from PENDING to NR
20191218 03:18:58 WARNING Skipping <ImagingStepRAIDCheckPhoenix(<NodeConfig(172.18.8.34) @2890>) @f7d0> because dependencies not met, failed tasks: b<ImagingStepInitIPMI(<NodeConfig(172.18.8.34) @2890>) @fc90>]
20191218 03:18:58 DEBUG Setting state of <ImagingStepPreInstall(<NodeConfig(172.18.8.34) @2890>) @2290> from PENDING to NR
20191218 03:18:58 WARNING Skipping <ImagingStepPreInstall(<NodeConfig(172.18.8.34) @2890>) @2290> because dependencies not met
20191218 03:18:58 DEBUG Setting state of <ImagingStepPhoenix(<NodeConfig(172.18.8.34) @2890>) @27d0> from PENDING to NR
20191218 03:18:58 WARNING Skipping <ImagingStepPhoenix(<NodeConfig(172.18.8.34) @2890>) @27d0> because dependencies not met
20191218 03:18:58 DEBUG Setting state of <InstallHypervisorKVM(<NodeConfig(172.18.8.34) @2890>) @2ad0> from PENDING to NR
20191218 03:18:58 WARNING Skipping <InstallHypervisorKVM(<NodeConfig(172.18.8.34) @2890>) @2ad0> because dependencies not met

========================================================================

Could you help to fix this issue ?

Thanks in advance.

Page 1 / 1

@angeessan Hi, It looks like the process fails in:

20191218 03:18:58 ERROR Exception in <ImagingStepInitIPMI(<NodeConfig(172.18.8.34) @2890>) @fc90>
Traceback (most recent call last):

and it complains:

StandardError: Failed to get BMC session after 3 attempts
20191218 03:18:58 DEBUG Setting state of <ImagingStepInitIPMI(<NodeConfig(172.18.8.34) @2890>) @fc90> from RUNNING to FAILED

I checked a few reported issues and in all cases it appears there was something wrong with BMC state of the node. If you can access the ipmi page of this node by booting up to BIOS mode and setting ipmi address to a static ip address or dhcp, so you can reach it using the assigned or acquired ip address, reseting the BMC to the factory defaults may help getting over this issue.

Since the other nodes appear to be ok based on what you mentioned, you may already have a cluster and this node is the one that is left. In that case you can actually use phoenix to image this node and add it tot he cluster in prism or via ncli command line

Hope this helps a little; let me know.

Regards,

-Said

sbarab · Answer

@angeessan Hi, It looks like the process fails in:

20191218 03:18:58 ERROR Exception in <ImagingStepInitIPMI(<NodeConfig(172.18.8.34) @2890>) @fc90>
Traceback (most recent call last):

and it complains:

StandardError: Failed to get BMC session after 3 attempts
20191218 03:18:58 DEBUG Setting state of <ImagingStepInitIPMI(<NodeConfig(172.18.8.34) @2890>) @fc90> from RUNNING to FAILED

I checked a few reported issues and in all cases it appears there was something wrong with BMC state of the node. If you can access the ipmi page of this node by booting up to BIOS mode and setting ipmi address to a static ip address or dhcp, so you can reach it using the assigned or acquired ip address, reseting the BMC to the factory defaults may help getting over this issue.

Since the other nodes appear to be ok based on what you mentioned, you may already have a cluster and this node is the one that is left. In that case you can actually use phoenix to image this node and add it tot he cluster in prism or via ncli command line

Hope this helps a little; let me know.

Regards,

-Said

Sign up

Login to the community

Scanning file for viruses.

This file cannot be downloaded