2026-08-04 19:59:11,350Z imaging_step.py:123 DEBUG Setting state of <ImagingStepValidation(<NodeConfig(10.253.163.9) @65e0>) @68e0> from PENDING to RUNNING
2026-08-04 19:59:11,352Z imaging_step.py:159 INFO Running <ImagingStepValidation(<NodeConfig(10.253.163.9) @65e0>) @68e0>
2026-08-04 19:59:11,355Z cache_manager.py:133 DEBUG Cache MISS: key(common_validations_()_{'global_config': <foundation.config_manager.GlobalConfig object at 0x7f6414036eb0>})
2026-08-04 19:59:11,356Z config_validator.py:312 INFO Validating parameters. This may take few minutes
2026-08-04 19:59:11,356Z config_validator.py:367 INFO Running validations to ensure non-duplicacy of hostnames
2026-08-04 19:59:11,357Z config_validator.py:339 INFO Running hypervisor hostname pattern validations
2026-08-04 19:59:11,357Z config_validator.py:395 INFO Running HyperV hostname validations
2026-08-04 19:59:11,358Z config_validator.py:592 INFO Running lacp validations
2026-08-04 19:59:11,359Z config_validator.py:893 INFO Running validations on AOS tarball
2026-08-04 19:59:11,461Z config_validator.py:1287 INFO Running AHV bundled with AOS validations
2026-08-04 19:59:11,462Z parameter_validation.py:312 DEBUG Validating kvm: /home/nutanix/foundation/isos/hypervisor/kvm/AHV-DVD-x86_64-10.0-808.iso
2026-08-04 19:59:11,463Z parameter_validation.py:356 DEBUG Starting whitelist_check
2026-08-04 19:59:11,464Z parameter_validation.py:177 DEBUG in_memory iso_whitelist version: 1751558172
2026-08-04 19:59:11,464Z cache_manager.py:142 DEBUG Cache HIT: key(get_nos_version_from_tarball_()_{'nos_package_path': '/home/nutanix/foundation/nos/nutanix_installer_package-release-ganges-7.0-stable-2b780c6331a28149892d8df46287b7827617d906-x86_64.tar'})
2026-08-04 19:59:11,465Z parameter_validation.py:359 DEBUG Finished whitelist_check
2026-08-04 19:59:11,465Z parameter_validation.py:367 WARNING It's recommended to use AHV bundled with AOS.
2026-08-04 19:59:11,466Z foundation_tools.py:796 INFO metadata update: {"iso_entry": {"compatible_versions": {"kvm": ["^10\\.0(-808)?$"]}, "deprecated": null, "filesize": 1448986624, "friendly_name": "AHV 10.0", "hypervisor": "kvm", "min_foundation": "5.7", "min_nos": "7.0", "sha256sum": "58dcdf88f109120608290c64d22e0a8c5f018495d6afa323e7134b0936c48e5b", "unsupported_hardware": ["^CS82[12]$"], "version": "10.0"}}
2026-08-04 19:59:11,467Z config_validator.py:1427 INFO Running chassis configuration validations
2026-08-04 19:59:11,468Z config_validator.py:1447 INFO Ensuring there is no Haswell, Broadwell mix in the same chassis for cluster test
2026-08-04 19:59:13,379Z config_validator.py:1541 INFO Running RDMA validations
2026-08-04 19:59:13,380Z foundation_tools.py:1317 WARNING tmap was called <function read_hardware_config_from_any at 0x7f641f284e50> with empty args and kwargs, ignoring
2026-08-04 19:59:13,381Z config_validator.py:499 INFO Running one and two node validations
2026-08-04 19:59:19,553Z config_validator.py:1613 INFO Checking whether hypervisor-specific drivers are present inside Foundation
2026-08-04 19:59:19,556Z config_validator.py:276 INFO Running redundancy factor validations
2026-08-04 19:59:19,557Z config_validator.py:1740 INFO Validating whether the HCI and Compute with External storage nodes are part of the same cluster test
2026-08-04 19:59:19,558Z config_validator.py:1475 INFO Running validations on AOS capabilites
2026-08-04 19:59:19,558Z cache_manager.py:142 DEBUG Cache HIT: key(fetch_capabilities_from_aos_tarball_('/home/nutanix/foundation/nos/nutanix_installer_package-release-ganges-7.0-stable-2b780c6331a28149892d8df46287b7827617d906-x86_64.tar',)_{})
2026-08-04 19:59:19,559Z config_validator.py:1161 INFO Running validations on cluster placement policy
2026-08-04 19:59:19,560Z cache_manager.py:142 DEBUG Cache HIT: key(fetch_capabilities_from_aos_tarball_('/home/nutanix/foundation/nos/nutanix_installer_package-release-ganges-7.0-stable-2b780c6331a28149892d8df46287b7827617d906-x86_64.tar',)_{})
2026-08-04 19:59:19,560Z config_validator.py:1185 INFO Using placement policy rf1_default for the cluster
2026-08-04 19:59:19,561Z config_validator.py:1094 INFO Running validations on cluster quorum configuration
2026-08-04 19:59:19,561Z cache_manager.py:142 DEBUG Cache HIT: key(fetch_capabilities_from_aos_tarball_('/home/nutanix/foundation/nos/nutanix_installer_package-release-ganges-7.0-stable-2b780c6331a28149892d8df46287b7827617d906-x86_64.tar',)_{})
2026-08-04 19:59:19,562Z config_validator.py:1121 INFO Cluster size requirements for placement policy rf1_default: {'min_nodes': 1, 'max_nodes': 1}
2026-08-04 19:59:19,563Z config_validator.py:442 INFO Running validations on lockdown modes with CO nodes
2026-08-04 19:59:19,564Z imaging_step.py:123 DEBUG Setting state of <ImagingStepValidation(<NodeConfig(10.253.163.9) @65e0>) @68e0> from RUNNING to FINISHED
2026-08-04 19:59:19,565Z imaging_step.py:162 INFO Completed <ImagingStepValidation(<NodeConfig(10.253.163.9) @65e0>) @68e0>
2026-08-04 19:59:19,570Z imaging_step.py:123 DEBUG Setting state of <GetNosVersion(<NodeConfig(10.253.163.9) @65e0>) @6790> from PENDING to RUNNING
2026-08-04 19:59:19,572Z imaging_step.py:159 INFO Running <GetNosVersion(<NodeConfig(10.253.163.9) @65e0>) @6790>
2026-08-04 19:59:19,573Z imaging_step_prepare_nos.py:18 INFO Node IP: CVM(10.253.163.9) HOST(10.253.163.8) IPMI(10.253.163.7)
2026-08-04 19:59:19,574Z cache_manager.py:142 DEBUG Cache HIT: key(get_nos_version_from_tarball_()_{'nos_package_path': '/home/nutanix/foundation/nos/nutanix_installer_package-release-ganges-7.0-stable-2b780c6331a28149892d8df46287b7827617d906-x86_64.tar'})
2026-08-04 19:59:19,575Z imaging_step_prepare_nos.py:32 INFO NOS Version is: 7.0
2026-08-04 19:59:19,575Z foundation_tools.py:796 INFO metadata update: {"nos_version": "7.0"}
2026-08-04 19:59:19,576Z imaging_step.py:123 DEBUG Setting state of <GetNosVersion(<NodeConfig(10.253.163.9) @65e0>) @6790> from RUNNING to FINISHED
2026-08-04 19:59:19,576Z imaging_step.py:162 INFO Completed <GetNosVersion(<NodeConfig(10.253.163.9) @65e0>) @6790>
2026-08-04 19:59:19,579Z imaging_step.py:123 DEBUG Setting state of <ImagingStepTypeDetection(<NodeConfig(10.253.163.9) @65e0>) @6c40> from PENDING to RUNNING
2026-08-04 19:59:19,580Z imaging_step.py:159 INFO Running <ImagingStepTypeDetection(<NodeConfig(10.253.163.9) @65e0>) @6c40>
2026-08-04 19:59:19,581Z detect_node_type.py:745 INFO Attempting to detect device type on 10.253.163.7
2026-08-04 19:59:19,582Z detect_node_type.py:746 INFO Factory mode is False
2026-08-04 19:59:19,901Z core.py:125 INFO Registering hypervisor if applicable
2026-08-04 19:59:19,981Z core.py:133 WARNING Failed to register hypervisor: <Left ("Unable to satisfy required capability 'HYPERV_VERSION' for <ExportedObjectDescriptor "command##.BindAnyHypervisor-1.0.0">") at 0x7f63d520a2c0>
2026-08-04 19:59:19,984Z core.py:137 INFO Tartarus initialization complete
2026-08-04 19:59:20,306Z remote_boot.py:193 DEBUG Failed to load all plugins:
Skipping command##.GenericIPMI_Pyghmi-1.0.0, entity is disabled Skipping command##.GenericRedfish_Pyghmi-1.0.0, entity is disabled
2026-08-04 19:59:20,310Z remote_boot.py:200 INFO Tartarus platforms: ['inspur', 'intel', 'ktnf', 'idrac9', 'irmc', 'ilo', 'lenovo_asu', 'pacstar', 'smc_cgi', 'Yadro']
2026-08-04 19:59:20,310Z detect_node_type.py:221 INFO tartarus platforms: ['inspur', 'intel', 'ktnf', 'idrac9', 'irmc', 'ilo', 'lenovo_asu', 'pacstar', 'smc_cgi', 'Yadro']
2026-08-04 19:59:20,313Z environment.py:541 INFO Registered new credentials with alias '10.253.163.7-admin'
2026-08-04 19:59:20,314Z environment.py:541 INFO Registered new host with alias '10.253.163.7'
2026-08-04 19:59:31,844Z environment.py:536 INFO Skipping re-registration of credentials with alias 10.253.163.7-admin
2026-08-04 19:59:31,846Z environment.py:536 INFO Skipping re-registration of host with alias 10.253.163.7
2026-08-04 19:59:38,596Z environment.py:536 INFO Skipping re-registration of credentials with alias 10.253.163.7-admin
2026-08-04 19:59:38,598Z environment.py:536 INFO Skipping re-registration of host with alias 10.253.163.7
2026-08-04 19:59:44,595Z environment.py:536 INFO Skipping re-registration of credentials with alias 10.253.163.7-admin
2026-08-04 19:59:44,597Z environment.py:536 INFO Skipping re-registration of host with alias 10.253.163.7
2026-08-04 19:59:51,221Z environment.py:536 INFO Skipping re-registration of credentials with alias 10.253.163.7-admin
2026-08-04 19:59:51,223Z environment.py:536 INFO Skipping re-registration of host with alias 10.253.163.7
2026-08-04 19:59:59,059Z environment.py:536 INFO Skipping re-registration of credentials with alias 10.253.163.7-admin
2026-08-04 19:59:59,060Z environment.py:536 INFO Skipping re-registration of host with alias 10.253.163.7
2026-08-04 20:00:04,556Z environment.py:536 INFO Skipping re-registration of credentials with alias 10.253.163.7-admin
2026-08-04 20:00:04,558Z environment.py:536 INFO Skipping re-registration of host with alias 10.253.163.7
2026-08-04 20:00:14,360Z environment.py:536 INFO Skipping re-registration of credentials with alias 10.253.163.7-admin
2026-08-04 20:00:14,361Z environment.py:536 INFO Skipping re-registration of host with alias 10.253.163.7
2026-08-04 20:00:20,149Z environment.py:536 INFO Skipping re-registration of credentials with alias 10.253.163.7-admin
2026-08-04 20:00:20,152Z environment.py:536 INFO Skipping re-registration of host with alias 10.253.163.7
2026-08-04 20:00:28,254Z environment.py:536 INFO Skipping re-registration of credentials with alias 10.253.163.7-admin
2026-08-04 20:00:28,255Z environment.py:536 INFO Skipping re-registration of host with alias 10.253.163.7
2026-08-04 20:00:33,500Z detect_node_type.py:255 INFO Fallback to legacy bmc detection
2026-08-04 20:00:33,501Z detect_node_type.py:258 INFO Selected legacy bmc detection: <function check_for_ciscoCIMC at 0x7f641e3a5700>
2026-08-04 20:00:33,504Z connectionpool.py:1001 DEBUG Starting new HTTPS connection (1): 10.253.163.7:443
2026-08-04 20:00:35,680Z connectionpool.py:456 DEBUG https://10.253.163.7:443 "POST /nuova HTTP/1.1" 200 None
2026-08-04 20:00:35,687Z connectionpool.py:1001 DEBUG Starting new HTTPS connection (1): 10.253.163.7:443
2026-08-04 20:00:35,946Z connectionpool.py:456 DEBUG https://10.253.163.7:443 "POST /nuova HTTP/1.1" 200 None
2026-08-04 20:00:35,991Z imaging_step_type_detection.py:76 INFO Detected class cimc for node with IPMI IP 10.253.163.7
2026-08-04 20:00:38,311Z tools.py:114 ERROR Command 'ipmitool -I lanplus -H 10.253.163.7 -U admin -P <obfuscated> fru' returned error code 1
stdout:
FRU Device Description : Builtin FRU Device (ID 0)
Chassis Type : Rack Mount Chassis
Chassis Part Number : 74-122877-01
Chassis Serial : WZP273405WV
Chassis Extra : Cisco Systems Inc
Board Mfg Date : Sat Nov 14 04:58:00 1998
Board Mfg : Cisco Systems Inc
Board Product : UCSC-C240-M6SN
Board Serial : WZP2733Z0MA
Board Part Number : 74-122880-01
Board Extra : C04V01
Board Extra : 0000000000
Product Manufacturer : Cisco Systems Inc
Product Name : UCSC-C240-M6SN
Product Part Number : 74-122877-01
Product Version : A0
Product Serial : WZP273405WV
Product Asset Tag : Unknown
Product Extra : E0V01
FRU Device Description : FRU_FP (ID 1)
Board Mfg Date : Mon Nov 16 03:51:00 1998
Board Mfg : Cisco Systems Inc
Board Product : UCSC-FPNL-C240M6
Board Serial : 3290026DJ0A
Board Part Number : FPNLC240M6
Board Extra : A03V01
Board Extra : 0000000000
FRU Device Description : FRU_MB (ID 2)
Board Mfg Date : Sat Nov 14 04:58:00 1998
Board Mfg : Cisco Systems Inc
Board Product : UCSC-C240-M6SN
Board Serial : WZP2733Z0MA
Board Part Number : 74-122880-01
Board Extra : C04V01
Board Extra : 0000000000
Product Manufacturer : Cisco Systems Inc
Product Name : UCSC-C240-M6SN
Product Part Number : 74-122877-01
Product Version : A0
Product Serial : WZP273405WV
Product Extra : E0V01
FRU Device Description : FRU_TPM (ID 3)
Board Mfg Date : Sat Nov 14 22:01:00 1998
Board Mfg : Cisco Systems Inc
Board Product : UCSX-TPM-002C
Board Serial : FCH2736784W
Board Part Number : 73-20179-01
Board Extra : A03V01
Board Extra : 0000000000
FRU Device Description : FRU_PSU1 (ID 4)
Board Mfg Date : Sat Nov 14 00:40:00 1998
Board Mfg : Cisco Systems Inc
Board Product : UCSC-PSU1-1600W
Board Serial : LIT2732A4FC
Board Part Number : 341-0732-04
Board Extra : A01V04
Board Extra : 0000000000
Product Manufacturer : Cisco Systems Inc
Product Name : UCSC-PSU1-1600W
Product Part Number : 341-0732-04
Product Version : A
Product Serial : LIT2732A4FC
Product Extra : A0V04
FRU Device Description : FRU_PSU2 (ID 5)
Board Mfg Date : Sat Nov 14 00:40:00 1998
Board Mfg : Cisco Systems Inc
Board Product : UCSC-PSU1-1600W
Board Serial : LIT2732A42F
Board Part Number : 341-0732-04
Board Extra : A01V04
Board Extra : 0000000000
Product Manufacturer : Cisco Systems Inc
Product Name : UCSC-PSU1-1600W
Product Part Number : 341-0732-04
Product Version : A
Product Serial : LIT2732A42F
Product Extra : A0V04
FRU Device Description : FRU_VIC_SLOT1 (ID 6)
Device not present (Requested sensor, data, or record not found)
FRU Device Description : FRU_VIC_SLOT2 (ID 7)
Device not present (Requested sensor, data, or record not found)
FRU Device Description : FRU_VIC_SLOT4 (ID 8)
Device not present (Requested sensor, data, or record not found)
FRU Device Description : FRU_VIC_SLOT5 (ID 9)
Device not present (Requested sensor, data, or record not found)
FRU Device Description : FRU_MLOM (ID 10)
Device not present (Requested sensor, data, or record not found)
FRU Device Description : FRU_HD_BP (ID 11)
Board Mfg Date : Tue Nov 17 01:11:00 1998
Board Mfg : Cisco Systems Inc
Board Product : UCSC-HDBP-240M6SN
Board Serial : 32900014J0A
Board Part Number : 2U24NVMEBP
Board Extra : A03V01
Board Extra : 0000000000
FRU Device Description : FRU_MINI_STORAGE (ID 12)
Board Mfg Date : Tue Nov 17 01:12:00 1998
Board Mfg : Cisco Systems Inc
Board Product : UCS-M2-HWRAID
Board Serial : FCH27337B42
Board Part Number : 73-19532-07
Board Extra : A05V02
Board Extra : 0000000000
FRU Device Description : FRU_PCIE_SWITCH (ID 13)
Board Mfg Date : Sun Nov 15 15:04:00 1998
Board Mfg : Cisco Systems Inc
Board Product : UCSC-M6SWITCH-C240
Board Serial : 33300032J0B
Board Part Number : 2UM6MSWITCH
Board Extra : A03V01
Board Extra : 0000000000
FRU Device Description : FRU_MID_BP (ID 14)
Device not present (Requested sensor, data, or record not found)
stderr:
2026-08-04 20:00:38,312Z imaging_step.py:123 DEBUG Setting state of <ImagingStepTypeDetection(<NodeConfig(10.253.163.9) @65e0>) @6c40> from RUNNING to FINISHED
2026-08-04 20:00:38,313Z imaging_step.py:162 INFO Completed <ImagingStepTypeDetection(<NodeConfig(10.253.163.9) @65e0>) @6c40>
2026-08-04 20:00:38,318Z imaging_step.py:123 DEBUG Setting state of <ImagingStepPrepareVendor(<NodeConfig(10.253.163.9) @65e0>) @6df0> from PENDING to RUNNING
2026-08-04 20:00:38,321Z imaging_step.py:159 INFO Running <ImagingStepPrepareVendor(<NodeConfig(10.253.163.9) @65e0>) @6df0>
2026-08-04 20:00:38,322Z imaging_step.py:123 DEBUG Setting state of <ImagingStepPrepareVendor(<NodeConfig(10.253.163.9) @65e0>) @6df0> from RUNNING to FINISHED
2026-08-04 20:00:38,323Z imaging_step.py:162 INFO Completed <ImagingStepPrepareVendor(<NodeConfig(10.253.163.9) @65e0>) @6df0>
2026-08-04 20:00:38,328Z imaging_step.py:123 DEBUG Setting state of <ImagingStepInitIPMI(<NodeConfig(10.253.163.9) @65e0>) @6340> from PENDING to RUNNING
2026-08-04 20:00:38,343Z imaging_step.py:159 INFO Running <ImagingStepInitIPMI(<NodeConfig(10.253.163.9) @65e0>) @6340>
2026-08-04 20:00:38,336Z imaging_step.py:123 DEBUG Setting state of <ImagingStepInitCVM(<NodeConfig(10.253.163.9) @65e0>) @6b80> from PENDING to RUNNING
2026-08-04 20:00:38,346Z imaging_step_init_ipmi.py:96 INFO Making node specific Phoenix image
2026-08-04 20:00:38,352Z imaging_step.py:159 INFO Running <ImagingStepInitCVM(<NodeConfig(10.253.163.9) @65e0>) @6b80>
2026-08-04 20:00:38,363Z imaging_step_init_cvm.py:151 DEBUG skipped, this node will be imaged via IPMI
2026-08-04 20:00:38,365Z imaging_step.py:123 DEBUG Setting state of <ImagingStepInitCVM(<NodeConfig(10.253.163.9) @65e0>) @6b80> from RUNNING to FINISHED
2026-08-04 20:00:38,366Z imaging_step.py:162 INFO Completed <ImagingStepInitCVM(<NodeConfig(10.253.163.9) @65e0>) @6b80>
2026-08-04 20:00:38,635Z foundation_tools.py:2822 INFO Enabling NFS share
2026-08-04 20:00:39,329Z phoenix_prep.py:717 INFO Using /home/nutanix/foundation/lib/foundation-platforms/tartarus-1.20.0-2a2040b0-py2.7.tar.gz
2026-08-04 20:00:39,330Z cache_manager.py:142 DEBUG Cache HIT: key(get_md5sum_('/home/nutanix/foundation/lib/foundation-platforms/tartarus-1.20.0-2a2040b0-py2.7.tar.gz',)_{})
2026-08-04 20:00:39,330Z phoenix_prep.py:717 INFO Using /home/nutanix/foundation/lib/foundation-platforms/phorest-phoenix-1.1.2-2617d9e.tgz
2026-08-04 20:00:39,330Z cache_manager.py:142 DEBUG Cache HIT: key(get_md5sum_('/home/nutanix/foundation/lib/foundation-platforms/phorest-phoenix-1.1.2-2617d9e.tgz',)_{})
2026-08-04 20:00:39,330Z phoenix_prep.py:717 INFO Using /home/nutanix/foundation/tmp/sessions/20260804-125908-8/files/features_node_10.253.163.9.json
2026-08-04 20:00:39,331Z cache_manager.py:133 DEBUG Cache MISS: key(get_md5sum_('/home/nutanix/foundation/tmp/sessions/20260804-125908-8/files/features_node_10.253.163.9.json',)_{})
2026-08-04 20:00:39,331Z phoenix_prep.py:717 INFO Using /home/nutanix/foundation/lib/foundation-platforms/hcl.json
2026-08-04 20:00:39,331Z cache_manager.py:142 DEBUG Cache HIT: key(get_md5sum_('/home/nutanix/foundation/lib/foundation-platforms/hcl.json',)_{})
2026-08-04 20:00:39,331Z phoenix_prep.py:717 INFO Using /home/nutanix/foundation/config/config_parameters.json
2026-08-04 20:00:39,332Z cache_manager.py:142 DEBUG Cache HIT: key(get_md5sum_('/home/nutanix/foundation/config/config_parameters.json',)_{})
2026-08-04 20:00:39,332Z phoenix_prep.py:717 INFO Using /home/nutanix/foundation/lib/foundation-platforms/foundation_layout-2.18.0.2+r.2201.58bfaaf7-py2.7.egg
2026-08-04 20:00:39,332Z cache_manager.py:142 DEBUG Cache HIT: key(get_md5sum_('/home/nutanix/foundation/lib/foundation-platforms/foundation_layout-2.18.0.2+r.2201.58bfaaf7-py2.7.egg',)_{})
2026-08-04 20:00:39,332Z phoenix_prep.py:717 INFO Using /home/nutanix/foundation/lib/foundation-platforms/foundation_layout-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl
2026-08-04 20:00:39,333Z cache_manager.py:142 DEBUG Cache HIT: key(get_md5sum_('/home/nutanix/foundation/lib/foundation-platforms/foundation_layout-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl',)_{})
2026-08-04 20:00:39,333Z phoenix_prep.py:717 INFO Using /home/nutanix/foundation/lib/foundation-platforms/tartarus-1.24.0+a497957f-py2.py3-none-any.whl
2026-08-04 20:00:39,333Z cache_manager.py:142 DEBUG Cache HIT: key(get_md5sum_('/home/nutanix/foundation/lib/foundation-platforms/tartarus-1.24.0+a497957f-py2.py3-none-any.whl',)_{})
2026-08-04 20:00:39,334Z phoenix_prep.py:717 INFO Using /home/nutanix/foundation/lib/foundation-platforms/tartarus_whl_dep.tar.gz
2026-08-04 20:00:39,335Z cache_manager.py:142 DEBUG Cache HIT: key(get_md5sum_('/home/nutanix/foundation/lib/foundation-platforms/tartarus_whl_dep.tar.gz',)_{})
2026-08-04 20:00:39,335Z phoenix_prep.py:722 DEBUG Generating updates config json /home/nutanix/foundation/tmp/sessions/20260804-125908-8/files/updates_config_node_10.253.163.9.json
2026-08-04 20:00:39,336Z cache_manager.py:133 DEBUG Cache MISS: key(get_md5sum_('/home/nutanix/foundation/tmp/sessions/20260804-125908-8/files/updates_config_node_10.253.163.9.json',)_{})
2026-08-04 20:00:39,337Z cache_manager.py:142 DEBUG Cache HIT: key(get_md5sum_('/home/nutanix/foundation/lib/phoenix/x86_64/squashfs.img',)_{})
2026-08-04 20:00:39,339Z cache_manager.py:142 DEBUG Cache HIT: key(get_md5sum_('/home/nutanix/foundation/lib/phoenix/x86_64/squashfs.img',)_{})
2026-08-04 20:00:39,777Z core.py:125 INFO Registering hypervisor if applicable
2026-08-04 20:00:39,848Z core.py:133 WARNING Failed to register hypervisor: <Left ("Unable to satisfy required capability 'HYPERV_VERSION' for <ExportedObjectDescriptor "command##.BindAnyHypervisor-1.0.0">") at 0x7f63d4373540>
2026-08-04 20:00:39,850Z core.py:137 INFO Tartarus initialization complete
2026-08-04 20:00:40,171Z remote_boot.py:193 DEBUG Failed to load all plugins:
Skipping command##.GenericIPMI_Pyghmi-1.0.0, entity is disabled Skipping command##.GenericRedfish_Pyghmi-1.0.0, entity is disabled
2026-08-04 20:00:40,172Z remote_boot.py:200 INFO Tartarus platforms: ['lenovo_asu', 'pacstar', 'smc_cgi', 'Yadro', 'irmc', 'idrac9', 'ktnf', 'intel', 'inspur', 'ilo']
2026-08-04 20:00:40,172Z remote_boot.py:303 INFO Selected legacy remote boot implementation cimc via <bmc_utils._remote_boot_cimc.RemoteBootCIMC object at 0x7f63d4070eb0>
2026-08-04 20:00:40,173Z imaging_step_init_ipmi.py:112 INFO Powering off node
2026-08-04 20:00:40,176Z connectionpool.py:1001 DEBUG Starting new HTTPS connection (1): 10.253.163.7:443
2026-08-04 20:00:42,020Z connectionpool.py:456 DEBUG https://10.253.163.7:443 "POST /nuova HTTP/1.1" 200 None
2026-08-04 20:00:42,026Z connectionpool.py:1001 DEBUG Starting new HTTPS connection (1): 10.253.163.7:443
2026-08-04 20:00:44,366Z connectionpool.py:456 DEBUG https://10.253.163.7:443 "POST /nuova HTTP/1.1" 200 None
2026-08-04 20:00:59,387Z connectionpool.py:1001 DEBUG Starting new HTTPS connection (1): 10.253.163.7:443
2026-08-04 20:01:01,915Z connectionpool.py:456 DEBUG https://10.253.163.7:443 "POST /nuova HTTP/1.1" 200 None
2026-08-04 20:01:01,926Z _remote_boot_cimc.py:312 ERROR Failed to set BIOS config: {'vpSataModeSelect': 'AHCI', 'vpPCIOptionROMs': 'Disabled'}. Ignoring failure
Traceback (most recent call last):
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/_remote_boot_cimc.py", line 198, in set_bios_config
for element in config.getchildren():
AttributeError: 'xml.etree.ElementTree.Element' object has no attribute 'getchildren'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/_remote_boot_cimc.py", line 310, in pre_boot_bios_settings
self.set_bios_config(bios_config=bios_config)
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/_remote_boot_cimc.py", line 207, in set_bios_config
raise Exception("Unable to configure BIOS :\n%s"
Exception: Unable to configure BIOS :
Traceback (most recent call last):
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/_remote_boot_cimc.py", line 198, in set_bios_config
for element in config.getchildren():
AttributeError: 'xml.etree.ElementTree.Element' object has no attribute 'getchildren'
2026-08-04 20:01:01,930Z connectionpool.py:1001 DEBUG Starting new HTTPS connection (1): 10.253.163.7:443
2026-08-04 20:01:03,281Z connectionpool.py:456 DEBUG https://10.253.163.7:443 "POST /nuova HTTP/1.1" 200 None
2026-08-04 20:01:03,285Z _remote_boot_cimc.py:319 ERROR Failed to enable flex flash drive and sync option. Ignoring failure
Traceback (most recent call last):
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/_remote_boot_cimc.py", line 269, in enable_flexflash_virtualdrive
cimc.set_object(
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/cisco_cimc.py", line 164, in set_object
raise Exception("BMC request failed, error %s (%s)" % (ret, error))
Exception: BMC request failed, error 2999 (Invalid request: flex flash configuration is not supported for this UCS-C server platform.)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/_remote_boot_cimc.py", line 316, in pre_boot_bios_settings
self.enable_flexflash_virtualdrive()
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/_remote_boot_cimc.py", line 273, in enable_flexflash_virtualdrive
raise Exception("Unable to enable Virtual drive:\n%s"
Exception: Unable to enable Virtual drive:
Traceback (most recent call last):
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/_remote_boot_cimc.py", line 269, in enable_flexflash_virtualdrive
cimc.set_object(
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/cisco_cimc.py", line 164, in set_object
raise Exception("BMC request failed, error %s (%s)" % (ret, error))
Exception: BMC request failed, error 2999 (Invalid request: flex flash configuration is not supported for this UCS-C server platform.)
2026-08-04 20:01:03,286Z imaging_step_init_ipmi.py:121 INFO Setting boot mode
2026-08-04 20:01:03,290Z connectionpool.py:1001 DEBUG Starting new HTTPS connection (1): 10.253.163.7:443
2026-08-04 20:01:05,738Z connectionpool.py:456 DEBUG https://10.253.163.7:443 "POST /nuova HTTP/1.1" 200 None
2026-08-04 20:01:05,741Z cisco_cimc.py:356 ERROR Failed to set boot mode to Legacy. Ignoring error
Traceback (most recent call last):
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/cisco_cimc.py", line 353, in set_boot_mode
self.set_object(dn, xml)
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/cisco_cimc.py", line 164, in set_object
raise Exception("BMC request failed, error %s (%s)" % (ret, error))
Exception: BMC request failed, error 2999 (Invalid request: bootMode can not be configured, as uefiSecureBootState is enabled.)
2026-08-04 20:01:05,742Z imaging_step_init_ipmi.py:132 INFO Mounting phoenix iso image
2026-08-04 20:01:05,750Z connectionpool.py:1001 DEBUG Starting new HTTPS connection (1): 10.253.163.7:443
2026-08-04 20:01:09,161Z connectionpool.py:456 DEBUG https://10.253.163.7:443 "POST /nuova HTTP/1.1" 200 None
2026-08-04 20:01:09,170Z connectionpool.py:1001 DEBUG Starting new HTTPS connection (1): 10.253.163.7:443
2026-08-04 20:01:12,600Z connectionpool.py:456 DEBUG https://10.253.163.7:443 "POST /nuova HTTP/1.1" 200 None
2026-08-04 20:01:12,606Z connectionpool.py:1001 DEBUG Starting new HTTPS connection (1): 10.253.163.7:443
2026-08-04 20:01:15,091Z connectionpool.py:456 DEBUG https://10.253.163.7:443 "POST /nuova HTTP/1.1" 200 None
2026-08-04 20:01:15,095Z connectionpool.py:1001 DEBUG Starting new HTTPS connection (1): 10.253.163.7:443
2026-08-04 20:01:17,801Z connectionpool.py:456 DEBUG https://10.253.163.7:443 "POST /nuova HTTP/1.1" 200 None
2026-08-04 20:01:17,809Z connectionpool.py:1001 DEBUG Starting new HTTPS connection (1): 10.253.163.7:443
2026-08-04 20:01:18,807Z connectionpool.py:456 DEBUG https://10.253.163.7:443 "POST /nuova HTTP/1.1" 200 None
2026-08-04 20:01:18,823Z connectionpool.py:1001 DEBUG Starting new HTTPS connection (1): 10.253.163.7:443
2026-08-04 20:01:19,765Z connectionpool.py:456 DEBUG https://10.253.163.7:443 "POST /nuova HTTP/1.1" 200 None
2026-08-04 20:01:19,773Z connectionpool.py:1001 DEBUG Starting new HTTPS connection (1): 10.253.163.7:443
2026-08-04 20:01:21,332Z connectionpool.py:456 DEBUG https://10.253.163.7:443 "POST /nuova HTTP/1.1" 200 None
2026-08-04 20:01:21,336Z connectionpool.py:1001 DEBUG Starting new HTTPS connection (1): 10.253.163.7:443
2026-08-04 20:01:23,529Z connectionpool.py:456 DEBUG https://10.253.163.7:443 "POST /nuova HTTP/1.1" 200 None
2026-08-04 20:01:23,873Z foundation_tools.py:2839 INFO Disabling NFS share
2026-08-04 20:01:24,031Z connectionpool.py:1001 DEBUG Starting new HTTPS connection (1): 10.253.163.7:443
2026-08-04 20:01:25,140Z connectionpool.py:456 DEBUG https://10.253.163.7:443 "POST /nuova HTTP/1.1" 200 None
2026-08-04 20:01:25,155Z connectionpool.py:1001 DEBUG Starting new HTTPS connection (1): 10.253.163.7:443
2026-08-04 20:01:26,929Z connectionpool.py:456 DEBUG https://10.253.163.7:443 "POST /nuova HTTP/1.1" 200 None
2026-08-04 20:01:26,934Z decorators.py:80 ERROR Exception in <ImagingStepInitIPMI(<NodeConfig(10.253.163.9) @65e0>) @6340>
Traceback (most recent call last):
File "foundation/decorators.py", line 78, in wrap_method
File "foundation/imaging_step_init_ipmi.py", line 301, in run
File "foundation/imaging_step_init_ipmi.py", line 139, in boot_phoenix
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/boot_media.py", line 47, in wrapped
return fn(self, iso, *args, **kwargs)
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/_remote_boot_cimc.py", line 121, in boot
cimc.set_vmedia_boot()
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/cisco_cimc.py", line 267, in set_vmedia_boot
self.set_object("sys/rack-unit-1/boot-precision", xml, hierarchical=True)
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/cisco_cimc.py", line 164, in set_object
raise Exception("BMC request failed, error %s (%s)" % (ret, error))
Exception: BMC request failed, error 2999 (Invalid request: lsbootSd is not supported for this UCS-C server platform.)
2026-08-04 20:01:26,942Z imaging_step.py:164 ERROR Exception in running <ImagingStepInitIPMI(<NodeConfig(10.253.163.9) @65e0>) @6340>
Traceback (most recent call last):
File "foundation/imaging_step.py", line 160, in _run
File "foundation/decorators.py", line 78, in wrap_method
File "foundation/imaging_step_init_ipmi.py", line 301, in run
File "foundation/imaging_step_init_ipmi.py", line 139, in boot_phoenix
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/boot_media.py", line 47, in wrapped
return fn(self, iso, *args, **kwargs)
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/_remote_boot_cimc.py", line 121, in boot
cimc.set_vmedia_boot()
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/cisco_cimc.py", line 267, in set_vmedia_boot
self.set_object("sys/rack-unit-1/boot-precision", xml, hierarchical=True)
File "/home/nutanix/foundation/lib/foundation-platforms/foundation_bmc-2.18.0.2+r.2201.58bfaaf7-py2.py3-none-any.whl/bmc_utils/cisco_cimc.py", line 164, in set_object
raise Exception("BMC request failed, error %s (%s)" % (ret, error))
Exception: BMC request failed, error 2999 (Invalid request: lsbootSd is not supported for this UCS-C server platform.)
2026-08-04 20:01:26,944Z imaging_step.py:123 DEBUG Setting state of <ImagingStepInitIPMI(<NodeConfig(10.253.163.9) @65e0>) @6340> from RUNNING to FAILED
2026-08-04 20:01:26,949Z imaging_step.py:123 DEBUG Setting state of <ImagingStepRAIDCheckPhoenix(<NodeConfig(10.253.163.9) @65e0>) @6910> from PENDING to NR
2026-08-04 20:01:26,951Z imaging_step.py:182 WARNING Skipping <ImagingStepRAIDCheckPhoenix(<NodeConfig(10.253.163.9) @65e0>) @6910> because dependencies not met, failed tasks: [<ImagingStepInitIPMI(<NodeConfig(10.253.163.9) @65e0>) @6340>]
2026-08-04 20:01:26,955Z imaging_step.py:123 DEBUG Setting state of <ImagingStepPreInstall(<NodeConfig(10.253.163.9) @65e0>) @6a30> from PENDING to NR
2026-08-04 20:01:26,959Z imaging_step.py:182 WARNING Skipping <ImagingStepPreInstall(<NodeConfig(10.253.163.9) @65e0>) @6a30> because dependencies not met
2026-08-04 20:01:26,965Z imaging_step.py:123 DEBUG Setting state of <ImagingStepPhoenix(<NodeConfig(10.253.163.9) @65e0>) @6e80> from PENDING to NR
2026-08-04 20:01:26,968Z imaging_step.py:182 WARNING Skipping <ImagingStepPhoenix(<NodeConfig(10.253.163.9) @65e0>) @6e80> because dependencies not met
2026-08-04 20:01:26,970Z imaging_step.py:123 DEBUG Setting state of <InstallHypervisorKVM(<NodeConfig(10.253.163.9) @65e0>) @6610> from PENDING to NR
2026-08-04 20:01:26,974Z imaging_step.py:182 WARNING Skipping <InstallHypervisorKVM(<NodeConfig(10.253.163.9) @65e0>) @6610> because dependencies not met