You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Given that we're batching up updates to the state store for a large number of compactions, we'd like to find out how many jobs the system can handle at once. This means putting more compactions through the system than the state store commit lambda can apply to the job tracker.
We'd like an option to disable job tracker updates for compactions in the state store commit lambda. We don't need to care how this affects the reporting since we will only use this option for testing.
Analysis
The job tracker update happens in StateStoreCommitter.
The text was updated successfully, but these errors were encountered:
Background
Split from:
Description
Given that we're batching up updates to the state store for a large number of compactions, we'd like to find out how many jobs the system can handle at once. This means putting more compactions through the system than the state store commit lambda can apply to the job tracker.
We'd like an option to disable job tracker updates for compactions in the state store commit lambda. We don't need to care how this affects the reporting since we will only use this option for testing.
Analysis
The job tracker update happens in StateStoreCommitter.
The text was updated successfully, but these errors were encountered: