Question

Host disk space warning.

  • 6 November 2018
  • 4 replies
  • 25 views

Badge
Hi there, I cannot seem to find any suggestions or ideas for the following in any of the usual places.

I have a 3 node CE setup. I have recently started getting the following errors on all 3 nodes:

Disk 'root' space usage (93%) on host 192.168.10.75 has exceeded 92%.

Note that this is on the Host not on the CVM.

df shows me this:

code:
[root@NTNX-64e3fb77-A ~]# df -H 
Filesystem Size Used Avail Use% Mounted on
devtmpfs 17G 0 17G 0% /dev
tmpfs 17G 279k 17G 1% /dev/shm
tmpfs 17G 1.7G 16G 11% /run
tmpfs 17G 0 17G 0% /sys/fs/cgroup
/dev/sdc1 7.3G 6.4G 533M 93% /
tmpfs 3.4G 0 3.4G 0% /run/user/0
[root@NTNX-64e3fb77-A ~]#


The warning coming from the root partition where 6.4G of 7.3Gb is in use.

Further investigation shows me that most of the space is consumed here:

code:
[root@NTNX-64e3fb77-A ~]# du -s -h /home/install/phx_iso/mnt/local/images/svm/*
3.1G /home/install/phx_iso/mnt/local/images/svm/2018.05.01-stable


Anyone have any ideas here?

Thanks

This topic has been closed for comments

4 replies

Userlevel 1
Badge +3
You seem to have a 8GB USB flash drive that's used as boot disk for all your AHVs. Your servers just grew some logs to fill a mere bit of space making the alarm trigger. Your best bet would be changing the threshold for this alarm to 95%. The SVM boot image you have found is required for Nutanix to work at all.
Badge
Maxin,

Thanks for the reply.

Makes sense. The flash drive I have in each of the 3 nodes is 64Gb model. Don't suppose you are aware of anyway to increase the partition size.

Appreciate the response, Thanks for your time.

Paul
Userlevel 1
Badge +3
Oh, that thing. Well, provided that AHV is CentOS kernel with some bundled software, the "usual" way of resizing a single partition on your USB drive should do. Manuals say like this:

First call fdisk against the boot disk of your AHV, remove existing partition and create a new partition of desired size (with USB, full size). Make ***DAMN SURE*** the start of new partition equals to start of old partition, or else you ruin your filesystem. Apply changes, exit fdisk then call "kpartx -u" on the same drive to make kernel aware of your new disk sizing.

Next, call "resize2fs" against your expanded partition - it should allocate extra superblocks and do the rest of maintenance on your rootfs to make your root partition bigger.

Since image install of AHV does not use swap partitions, you can skip everything related to swap in that manual. However check if you have swap partitions in your case if you have installed from ISO (which is likely not the case here).
Badge
Thanks for that.

Pretty much same answer as here: https://next.nutanix.com/discussion-forum-14/ce-showing-disk-space-usage-for-one-or-more-disks-on-host-x-x-x-x-has-exceeded-90-25900

Which I used to increase the FS to 64Gb.

Thanks all.

Paul