Erasure Coding post process | Nutanix Community
Skip to main content
Solved

Erasure Coding post process

  • March 18, 2021
  • 1 reply
  • 136 views

Forum|alt.badge.img+7

From the Nutanix Bible: “when a Curator full scan runs, it will find eligible extent groups which are available to become encoded. Eligible extent groups must be "write-cold" meaning they haven't been written to for awhile”.

I have 2 questions:

if I have some data just written in the oplog, how long takes to copy those datas in the extent store, assuming that there is not any read of it?

Once the data are in the extent store, how long it takes before the erasure coding is applied to the datas?

 

Best answer by Alona

Hi balma01,

As you can imagine, there is no set timeframe to write data between the two locations in the storage layer. Per-vDisk OpLog limit is 6GB. We can simplify it terribly and say, we are draining all 6GB (not realistic) for all vDisks at the same time (even less realistic), how long will it take?

In real life, it would be chunks of data written to the extent store from the OpLog if the vDisk is idle for some time or when the OpLog is at 85% capacity. Regular curator scans identify chunks that are old enough to be moved to the cold tier and to be processed for EC if it is enabled.

Cold data constitutes no write within the past 7 days. That is calculated from the moment the data arrives at the extent store.

Let me know if that helped or if you have more questions.

View original
Did this topic help you find an answer to your question?
This topic has been closed for comments

1 reply

Alona
Nutanix Employee
Forum|alt.badge.img+5
  • Nutanix Employee
  • 432 replies
  • Answer
  • March 19, 2021

Hi balma01,

As you can imagine, there is no set timeframe to write data between the two locations in the storage layer. Per-vDisk OpLog limit is 6GB. We can simplify it terribly and say, we are draining all 6GB (not realistic) for all vDisks at the same time (even less realistic), how long will it take?

In real life, it would be chunks of data written to the extent store from the OpLog if the vDisk is idle for some time or when the OpLog is at 85% capacity. Regular curator scans identify chunks that are old enough to be moved to the cold tier and to be processed for EC if it is enabled.

Cold data constitutes no write within the past 7 days. That is calculated from the moment the data arrives at the extent store.

Let me know if that helped or if you have more questions.