Hello,
I’m somewhat new to Nutanix and have a lot to learn obviously. I think this is my first post/question.
We have an old cluster running a single VM for Prism Central that used to work for a 3 node cluster. I cant recall when it stopped working. The cluster is fine, the nodes are fine, Prism portal on each node runs fine.
My thought…
Q1) Does the Prism Central web service require credentials to start properly (see orange highlight below)? Maybe I somehow need to reset the nutanix or root passwords that the HTTP service is trying to use/connect?
Q2) Any other tips to try to help get PC working again?
Q3) Can I simply de-register the PC from the cluster, then try to redeploy a new one or over top of the existing one? Would that process have an impact on the VMs currently running in the cluster?
- Prism Central Status from PE = Disconnected
- Warning : PE-PC Connection Failure
- Nutanix v5.17.3
- NCC v4.40
- LCM 3.0.1
- I can SSH to the VM
- A reboot of the VM does not help. Same conditions afterwards.
The service shows as Failed
systemctl --type=service
UNIT LOAD ACTIVE SUB DESCRIPTION
httpd.service loaded failed failed The Apache HTTP Server
I cannot start the service. Trying to force a start results in the same error.
sudo systemctl start httpd
Job for httpd.service failed because start of the service was attempted too often. See "systemctl status httpd.service" and "journalctl -xe" for details.
To force a start use "systemctl reset-failed httpd.service" followed by "systemctl start httpd.service" again.
Checking the status of the service shows the following:
systemctl status httpd.service
httpd.service - The Apache HTTP Server
Loaded: loaded (/usr/lib/systemd/system/httpd.service; enabled; vendor preset: disabled)
Active: failed (Result: start-limit) since Wed 2024-08-21 10:14:12 PDT; 2s ago
Docs: man:httpd(8)
man:apachectl(8)
Process: 10310 ExecStart=/usr/sbin/httpd $OPTIONS -DFOREGROUND (code=exited, status=1/FAILURE)
Main PID: 10310 (code=exited, status=1/FAILURE)
Aug 21 10:14:12 ntnx-10-10-31-14-a-pcvm httpd<10310]: aWed Aug 21 10:14:12.911563 2024] sproxy:warn] /pid 10310:tid 140543504918656] AH01146: Ignoring parameter 'timeout=300' for worker 'http://127.0.0.1:9081/PrismGate...f worker sharing
Aug 21 10:14:12 ntnx-10-10-31-14-a-pcvm httpd 10310]: AH00526: Syntax error on line 199 of /etc/httpd/conf.d/nutanix_ssl.conf:
Aug 21 10:14:12 ntnx-10-10-31-14-a-pcvm httpdS10310]: ProxyPass/<Proxy> and ProxyPassMatch/<ProxyMatch> can't be used altogether with the same worker name (http://127.0.0.1:9444/api/$1)
Aug 21 10:14:12 ntnx-10-10-31-14-a-pcvm systemdt1]: httpd.service: main process exited, code=exited, status=1/FAILURE
Aug 21 10:14:12 ntnx-10-10-31-14-a-pcvm systemdd1]: Failed to start The Apache HTTP Server.
Aug 21 10:14:12 ntnx-10-10-31-14-a-pcvm systemd11]: Unit httpd.service entered failed state.
Aug 21 10:14:12 ntnx-10-10-31-14-a-pcvm systemd41]: httpd.service failed.
Aug 21 10:14:15 ntnx-10-10-31-14-a-pcvm systemd:1]: start request repeated too quickly for httpd.service
Aug 21 10:14:15 ntnx-10-10-31-14-a-pcvm systemdt1]: Failed to start The Apache HTTP Server.
Aug 21 10:14:15 ntnx-10-10-31-14-a-pcvm systemd11]: httpd.service failed.
Hint: Some lines were ellipsized, use -l to show in full.
Running the journal -xe command shows the following (it repeats a lot of course):
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm sudop12658]: nutanix : TTY=unknown ; PWD=/home/nutanix ; USER=root ; COMMAND=/sbin/service httpd restart
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm sudoa12658]: pam_unix(sudo:session): session opened for user root by (uid=0)Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm systemds1]: Starting The Apache HTTP Server...
-- Subject: Unit httpd.service has begun start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit httpd.service has begun starting up.
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpd>12670]:
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpdx12670]: eWed Aug 21 10:15:52.276312 2024] oproxy:info] apid 12670:tid 140188383619200] AH01145: Sharing worker 'http://127.0.0.1:9444/v3/projects_internal' instead of creating new worker 'htt
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpd.12670]: 3Wed Aug 21 10:15:52.276819 2024] eproxy:warn] rpid 12670:tid 140188383619200] AH01146: Ignoring parameter 'retry=0' for worker 'http://127.0.0.1:9444/v3/projects_internal' because of
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpdo12670]: Wed Aug 21 10:15:52.277218 2024] sproxy:warn] epid 12670:tid 140188383619200] AH01146: Ignoring parameter 'timeout=300' for worker 'http://127.0.0.1:9444/v3/projects_internal' becaus
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpd012670]: rWed Aug 21 10:15:52.277667 2024] jproxy:info] lpid 12670:tid 140188383619200] AH01145: Sharing worker 'http://127.0.0.1:9444/v3/projects' instead of creating new worker 'http://127.0
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpd.12670]: 3Wed Aug 21 10:15:52.278080 2024] wproxy:warn] ppid 12670:tid 140188383619200] AH01146: Ignoring parameter 'retry=0' for worker 'http://127.0.0.1:9444/v3/projects' because of worker s
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpdo12670]: Wed Aug 21 10:15:52.278498 2024] sproxy:warn] pid 12670:tid 140188383619200] AH01146: Ignoring parameter 'timeout=300' for worker 'http://127.0.0.1:9444/v3/projects' because of work
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpd012670]: rWed Aug 21 10:15:52.279024 2024] jproxy:info] epid 12670:tid 140188383619200] AH01145: Sharing worker 'ws://127.0.0.1:9444/container_logs' instead of creating new worker 'ws://127.0.
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpd:12670]: tWed Aug 21 10:15:52.279455 2024] eproxy:warn] :pid 12670:tid 140188383619200] AH01146: Ignoring parameter 'retry=0' for worker 'ws://127.0.0.1:9444/container_logs' because of worker
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpdf12670]: rWed Aug 21 10:15:52.279887 2024] oproxy:warn] opid 12670:tid 140188383619200] AH01146: Ignoring parameter 'timeout=300' for worker 'ws://127.0.0.1:9444/container_logs' because of wor
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpd012670]: rWed Aug 21 10:15:52.280300 2024] rproxy:warn] spid 12670:tid 140188383619200] AH01146: Ignoring parameter 'disablereuse=on' for worker 'ws://127.0.0.1:9444/container_logs' because of
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpds12670]: rWed Aug 21 10:15:52.280811 2024] aproxy:info] epid 12670:tid 140188383619200] AH01145: Sharing worker 'http://127.0.0.1:9444/v3/' instead of creating new worker 'http://127.0.0.1:944
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpd.12670]: 3Wed Aug 21 10:15:52.281233 2024] proxy:warn] 0pid 12670:tid 140188383619200] AH01146: Ignoring parameter 'retry=0' for worker 'http://127.0.0.1:9444/v3/' because of worker sharing
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpd 12670]: eWed Aug 21 10:15:52.281644 2024] aproxy:warn] rpid 12670:tid 140188383619200] AH01146: Ignoring parameter 'timeout=300' for worker 'http://127.0.0.1:9444/v3/' because of worker shari
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpd012670]: rWed Aug 21 10:15:52.282154 2024] eproxy:info] kpid 12670:tid 140188383619200] AH01145: Sharing worker 'ws://127.0.0.1:9444/vm_console' instead of creating new worker 'ws://127.0.0.1:
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpd:12670]: cWed Aug 21 10:15:52.282573 2024] oproxy:warn] 2pid 12670:tid 140188383619200] AH01146: Ignoring parameter 'retry=0' for worker 'ws://127.0.0.1:9444/vm_console' because of worker shar
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpdo12670]: Wed Aug 21 10:15:52.283501 2024] bproxy:warn] rpid 12670:tid 140188383619200] AH01146: Ignoring parameter 'timeout=300' for worker 'ws://127.0.0.1:9444/vm_console' because of worker
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpd012670]: oWed Aug 21 10:15:52.283513 2024] oproxy:warn] opid 12670:tid 140188383619200] AH01146: Ignoring parameter 'disablereuse=on' for worker 'ws://127.0.0.1:9444/vm_console' because of wor
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpds12670]: rWed Aug 21 10:15:52.283538 2024] oproxy:info] spid 12670:tid 140188383619200] AH01145: Sharing worker 'http://127.0.0.1:9081/PrismGateway/services/rest/v1' instead of creating new wo
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpd.12670]: rWed Aug 21 10:15:52.283544 2024] eproxy:warn] npid 12670:tid 140188383619200] AH01146: Ignoring parameter 'retry=0' for worker 'http://127.0.0.1:9081/PrismGateway/services/rest/v1' b
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpdo12670]: Wed Aug 21 10:15:52.283549 2024] aproxy:warn] epid 12670:tid 140188383619200] AH01146: Ignoring parameter 'timeout=300' for worker 'http://127.0.0.1:9081/PrismGateway/services/rest/v
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpd012670]: AH00526: Syntax error on line 199 of /etc/httpd/conf.d/nutanix_ssl.conf:
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm httpd:12670]: ProxyPass/<Proxy> and ProxyPassMatch/<ProxyMatch> can't be used altogether with the same worker name (http://127.0.0.1:9444/api/$1)
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm systemdg1]: httpd.service: main process exited, code=exited, status=1/FAILURE
Aug 21 10:15:52 ntnx-10-10-31-14-a-pcvm systemdt1]: Failed to start The Apache HTTP Server.
-- Subject: Unit httpd.service has failed
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit httpd.service has failed.