Question

Karbon Nodes TimeZone

  • 10 July 2020
  • 8 replies
  • 2596 views

Badge +1

Hi all 

We have karbon clusters running in our Nutanix environment, and I noticed the timezone in the Karbon cluster is not the same as that in other VMs on the Nutanix cluster. 

The time zone set for the Nutanix cluster is SAST (UTC +2), and the Karbon VMs timezone is UTC (UTC +0). 


The UTC+0 timezone is only on the Karbon Nodes. 


It seems it doesn’t use the Nutanix Cluster’s timezone, our logs are 2 hours behind on Karbon Clusters(all 3 cluster). 

Is there a way to change the timezone for Karbon?

 


8 replies

Userlevel 5
Badge +4

Hey @KeoNaane , let me search for this and try to find any relevant document/procedure related to changing timezone of Karbon cluster.

 

In the meantime, the procedure to change the timezone on a Nutanix cluster is mentioned in this KB article KB 1050

Userlevel 5
Badge +4

So I searched for this @KeoNaane and basically we don’t recommend changing the timezone from UTC. I would recommend that let all Karbon clusters run UTC and only the display layer should translate UTC to the local time(SAST)

This will be the easiest way to sync different time sources. So I suggest you, adjust your log collection to reflect the time zone. Basically, adjust your log collector on Nutanix cluster to understand that logs coming from Karbon are in UTC and then their log display UI should adjust according to whatever timezone it is accessed from.

So basically only the display time should be shown in a specific timezone and storage/export time from a system should always be in UTC.

That way if a sysadmin in Paris and a sysadmin in Hong Kong access the same log collection system, they will always see logs according to their own local timezone, no whatever the timezone of the system that had output the logs was at that time.

 

I hope I made things clear.:sweat_smile:  Let me know fi you have any doubts.

Badge +1

So I searched for this @KeoNaane and basically we don’t recommend changing the timezone from UTC. I would recommend that let all Karbon clusters run UTC and only the display layer should translate UTC to the local time(SAST)

This will be the easiest way to sync different time sources. So I suggest you, adjust your log collection to reflect the time zone. Basically, adjust your log collector on Nutanix cluster to understand that logs coming from Karbon are in UTC and then their log display UI should adjust according to whatever timezone it is accessed from.

So basically only the display time should be shown in a specific timezone and storage/export time from a system should always be in UTC.

That way if a sysadmin in Paris and a sysadmin in Hong Kong access the same log collection system, they will always see logs according to their own local timezone, no whatever the timezone of the system that had output the logs was at that time.

 

I hope I made things clear.:sweat_smile:  Let me know fi you have any doubts.

Hi @AnishWalia20 

Thanks for that information, is there an article that guides how to do the above? 
 

Userlevel 5
Badge +4

Hey @KeoNaane so basically to do this you will have to change the timezone on the PE cluster following this KB 1050 . 

Let me know if you have any doubts.:relaxed:

Badge +1

Hey @AnishWalia20 

The CVMs (and all VMs besides Karbon Nodes) have the correct time zone as per below confirmation. 
Only the Karbon Kubernetes nodes have the UTC timezone, so the pod logs are always 2 hours behind. 


$ ncli cluster info | grep Timezone
    Timezone                  : Africa/Johannesburg

$ allssh date
================== 10.30.2.51 =================
Thu Jul 16 10:31:28 SAST 2020
================== 10.30.2.52 =================
Thu Jul 16 10:31:29 SAST 2020
================== 10.30.2.53 =================
Thu Jul 16 10:31:30 SAST 2020
================== 10.30.2.54 =================
Thu Jul 16 10:31:31 SAST 2020

is there a way to update the timezone for Karbon Cluster Nodes?

Userlevel 5
Badge +4

Hey @KeoNaane , as I mentioned we don’t support changing the time on Karbon cluster. So the only solution would be to change the time on the PE cluster to UTC to get the PE cluster and the Karbon cluster in sync.

We always recommend keeping the timezone to UTC for all systems.

Badge +1

Hey @KeoNaane , as I mentioned we don’t support changing the time on Karbon cluster. So the only solution would be to change the time on the PE cluster to UTC to get the PE cluster and the Karbon cluster in sync.

We always recommend keeping the timezone to UTC for all systems.

Noted, thanks @AnishWalia20 

Userlevel 5
Badge +4

@KeoNaane  Let me know if you need clarifications or help with anything else.:relaxed:

Reply