You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
For rebase and backfill scenarios, we correctly calculate input stats. However, for incremental this will only represent incremental delta stats. Due to this we are having to hack around our way to determine actual data scanned. Updating these audits to allow calculating the total data scanned easy.
For rebase, total data scanned (at rest size) is input_size_bytes - untouched_size_bytes.
For backfill, total data scanned (at rest size) is input_size_bytes - untouched_size_bytes.
For incremental, total_data_scanned (at rest size) is input_size_bytes - untouched_size_bytes.
Hence, we have a single math expression representing data scanned for all the different types of compaction.
The text was updated successfully, but these errors were encountered:
For rebase and backfill scenarios, we correctly calculate input stats. However, for incremental this will only represent incremental delta stats. Due to this we are having to hack around our way to determine actual data scanned. Updating these audits to allow calculating the total data scanned easy.
input_size_bytes - untouched_size_bytes
.input_size_bytes - untouched_size_bytes
.input_size_bytes - untouched_size_bytes
.Hence, we have a single math expression representing data scanned for all the different types of compaction.
The text was updated successfully, but these errors were encountered: