Nested CE with AOS 7.3.0.7 error upgrade AHV v.10.0.1.1

Question

Hi all,I have a nested environment with a three-node cluster and also a one-node cluster with AOS 7.3.0.7 and AHV 10.0.1.1. When I tried to update AHV to any available version, the upgrade failed. Does anyone have advice to find a solution or experience with this issue?Thanks

JeroenTielen · Accepted Answer

https://next.nutanix.com/discussion-forum-14/do-not-upgrade-ce-to-ahv-10-3-and-higher-45028Stick to lower than 10.3 ;)

GiuseppePino · Answer

Hi,I find this on ahv-upgrade.log2025-11-28T09:28:39.884148+00:00 NTNX-e19b5047-A ahv-upgraded[2364709]: Rebooting2025-11-28T09:31:32.094810+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Info: Upgrade request with UUID b75bf7af-3318-480e-7ec0-c56a8d9d708b is already registered2025-11-28T09:31:32.094904+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Info: Registered the upgrade request with the UUID b75bf7af-3318-480e-7ec0-c56a8d9d708b2025-11-28T09:31:32.095334+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Info: Returning status: queued2025-11-28T09:33:28.999771+00:00 NTNX-e19b5047-A ahv-upgraded[2306]: iscsiadm: Could not login to [iface: default, target: iqn.2010-06.com.nutanix:lcm-AHV-DVD-x86.64-10.3.0.2-21.iso-6a3e9c7332a1d2bee421fd133d3a815ea72dba7b0f188c8689b216922b7a51dc-55e042b1-7986-4cbc-9b8f-5450e7693f6d, portal: 127.0.0.1,3261].2025-11-28T09:33:28.999855+00:00 NTNX-e19b5047-A ahv-upgraded[2306]: iscsiadm: initiator reported error (8 - connection timed out)2025-11-28T09:33:28.999893+00:00 NTNX-e19b5047-A ahv-upgraded[2306]: iscsiadm: Could not log into all portals2025-11-28T09:33:29.000865+00:00 NTNX-e19b5047-A ahv-upgraded[2306]: Logging in to [iface: default, target: iqn.2010-06.com.nutanix:lcm-AHV-DVD-x86.64-10.3.0.2-21.iso-6a3e9c7332a1d2bee421fd133d3a815ea72dba7b0f188c8689b216922b7a51dc-55e042b1-7986-4cbc-9b8f-5450e7693f6d, portal: 127.0.0.1,3261]2025-11-28T09:33:29.001573+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Warning: iSCSI login failed for iscsi://127.0.0.1:3261/iqn.2010-06.com.nutanix:lcm-AHV-DVD-x86.64-10.3.0.2-21.iso-6a3e9c7332a1d2bee421fd133d3a815ea72dba7b0f188c8689b216922b7a51dc-55e042b1-7986-4cbc-9b8f-5450e7693f6d with code 8, retrying until 10:01:262025-11-28T09:35:29.151341+00:00 NTNX-e19b5047-A ahv-upgraded[4652]: iscsiadm: Could not login to [iface: default, target: iqn.2010-06.com.nutanix:lcm-AHV-DVD-x86.64-10.3.0.2-21.iso-6a3e9c7332a1d2bee421fd133d3a815ea72dba7b0f188c8689b216922b7a51dc-55e042b1-7986-4cbc-9b8f-5450e7693f6d, portal: 127.0.0.1,3261].2025-11-28T09:35:29.151391+00:00 NTNX-e19b5047-A ahv-upgraded[4652]: iscsiadm: initiator reported error (8 - connection timed out)2025-11-28T09:35:29.151433+00:00 NTNX-e19b5047-A ahv-upgraded[4652]: iscsiadm: Could not log into all portals2025-11-28T09:35:29.151478+00:00 NTNX-e19b5047-A ahv-upgraded[4652]: Logging in to [iface: default, target: iqn.2010-06.com.nutanix:lcm-AHV-DVD-x86.64-10.3.0.2-21.iso-6a3e9c7332a1d2bee421fd133d3a815ea72dba7b0f188c8689b216922b7a51dc-55e042b1-7986-4cbc-9b8f-5450e7693f6d, portal: 127.0.0.1,3261]2025-11-28T09:35:29.152128+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Warning: iSCSI login failed for iscsi://127.0.0.1:3261/iqn.2010-06.com.nutanix:lcm-AHV-DVD-x86.64-10.3.0.2-21.iso-6a3e9c7332a1d2bee421fd133d3a815ea72dba7b0f188c8689b216922b7a51dc-55e042b1-7986-4cbc-9b8f-5450e7693f6d with code 8, retrying until 10:01:262025-11-28T09:36:32.104390+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Info: Returning status: queued2025-11-28T09:37:29.310165+00:00 NTNX-e19b5047-A ahv-upgraded[1316]: iscsiadm: Could not login to [iface: default, target: iqn.2010-06.com.nutanix:lcm-AHV-DVD-x86.64-10.3.0.2-21.iso-6a3e9c7332a1d2bee421fd133d3a815ea72dba7b0f188c8689b216922b7a51dc-55e042b1-7986-4cbc-9b8f-5450e7693f6d, portal: 127.0.0.1,3261].2025-11-28T09:37:29.310246+00:00 NTNX-e19b5047-A ahv-upgraded[1316]: iscsiadm: initiator reported error (8 - connection timed out)2025-11-28T09:37:29.310273+00:00 NTNX-e19b5047-A ahv-upgraded[1316]: iscsiadm: Could not log into all portals2025-11-28T09:37:29.310306+00:00 NTNX-e19b5047-A ahv-upgraded[1316]: Logging in to [iface: default, target: iqn.2010-06.com.nutanix:lcm-AHV-DVD-x86.64-10.3.0.2-21.iso-6a3e9c7332a1d2bee421fd133d3a815ea72dba7b0f188c8689b216922b7a51dc-55e042b1-7986-4cbc-9b8f-5450e7693f6d, portal: 127.0.0.1,3261]2025-11-28T09:37:29.310493+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Warning: iSCSI login failed for iscsi://127.0.0.1:3261/iqn.2010-06.com.nutanix:lcm-AHV-DVD-x86.64-10.3.0.2-21.iso-6a3e9c7332a1d2bee421fd133d3a815ea72dba7b0f188c8689b216922b7a51dc-55e042b1-7986-4cbc-9b8f-5450e7693f6d with code 8, retrying until 10:01:262025-11-28T09:37:54.423473+00:00 NTNX-e19b5047-A ahv-upgraded[10999]: Logging in to [iface: default, target: iqn.2010-06.com.nutanix:lcm-AHV-DVD-x86.64-10.3.0.2-21.iso-6a3e9c7332a1d2bee421fd133d3a815ea72dba7b0f188c8689b216922b7a51dc-55e042b1-7986-4cbc-9b8f-5450e7693f6d, portal: 127.0.0.1,3261]2025-11-28T09:37:54.423537+00:00 NTNX-e19b5047-A ahv-upgraded[10999]: Login to [iface: default, target: iqn.2010-06.com.nutanix:lcm-AHV-DVD-x86.64-10.3.0.2-21.iso-6a3e9c7332a1d2bee421fd133d3a815ea72dba7b0f188c8689b216922b7a51dc-55e042b1-7986-4cbc-9b8f-5450e7693f6d, portal: 127.0.0.1,3261] successful.2025-11-28T09:37:54.424168+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Info: iSCSI login succeeded for iscsi://127.0.0.1:3261/iqn.2010-06.com.nutanix:lcm-AHV-DVD-x86.64-10.3.0.2-21.iso-6a3e9c7332a1d2bee421fd133d3a815ea72dba7b0f188c8689b216922b7a51dc-55e042b1-7986-4cbc-9b8f-5450e7693f6d2025-11-28T09:37:54.705011+00:00 NTNX-e19b5047-A ahv-upgraded[1316]: mount: /mnt/ahv: WARNING: device write-protected, mounted read-only.2025-11-28T09:37:54.705126+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Info: Making session scratch directory: /var/spool/upgraded/b75bf7af-3318-480e-7ec0-c56a8d9d708b2025-11-28T09:37:54.712138+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Info: Running state machine for state running and data {CurrentPluginIndex:11 CurrentPluginDesc: ProgressPercentage:72}2025-11-28T09:37:54.712285+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Info: Opening metadata from: /mnt/ahv/.upgrade/metadata_v1.json2025-11-28T09:37:54.720285+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Info: Looking for upgrade plan 'reimage'2025-11-28T09:37:54.720397+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Info: Found plan 'reimage' with 14 plugins2025-11-28T09:37:54.720447+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Info: Starting from plugin 112025-11-28T09:37:54.730053+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Info: Running plugin 11 (reboot): [./reboot.sh] {WorkDir:/mnt/ahv/.upgrade Env:[PYTHONUNBUFFERED=1] CaptureOutput:true Timeout:1m0s KillOnTimeout:true}2025-11-28T09:37:54.748206+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Marker file not present, reboot presumed complete2025-11-28T09:37:54.752877+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Info: Running plugin 12 (reimage_success_check): [./reimage_success_check.sh] {WorkDir:/mnt/ahv/.upgrade Env:[PYTHONUNBUFFERED=1] CaptureOutput:true Timeout:1m0s KillOnTimeout:true}2025-11-28T09:37:54.758423+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Reimaging failed, no further details2025-11-28T09:37:54.759539+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Error: Upgrade has failed: Unable to run upgrade plugin reimage_success_check: exit status 12025-11-28T09:37:54.759617+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Plugin stdout:2025-11-28T09:37:54.759650+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Plugin stderr:2025-11-28T09:37:54.759677+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Reimaging failed, no further details2025-11-28T09:37:54.764257+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Info: Running state machine for state cleanup and data {Success:false ErrorMessage:Unable to run upgrade plugin reimage_success_check: exit status 12025-11-28T09:37:54.764362+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Plugin stdout:2025-11-28T09:37:54.764403+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Plugin stderr:2025-11-28T09:37:54.764434+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Reimaging failed, no further details2025-11-28T09:37:54.764459+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: }2025-11-28T09:37:54.764490+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Info: Cleaning up: ahvI think this message is important2025-11-28T09:37:54.752877+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Info: Running plugin 12 (reimage_success_check): [./reimage_success_check.sh] {WorkDir:/mnt/ahv/.upgrade Env:[PYTHONUNBUFFERED=1] CaptureOutput:true Timeout:1m0s KillOnTimeout:true}2025-11-28T09:37:54.758423+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Reimaging failed, no further details2025-11-28T09:37:54.759539+00:00 NTNX-e19b5047-A ahv-upgraded[1848]: Error: Upgrade has failed: Unable to run upgrade plugin reimage_success_check: exit status 1

Sign up

Login to the community

Scanning file for viruses.

This file cannot be downloaded