Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

M3DB Index Out Of Order Writes support #16

Open
robskillington opened this issue Oct 8, 2019 · 0 comments
Open

M3DB Index Out Of Order Writes support #16

robskillington opened this issue Oct 8, 2019 · 0 comments

Comments

@robskillington
Copy link
Contributor

robskillington commented Oct 8, 2019

Implementation pending, algorithm:

  1. During cold flush, for any series added to the volume, add to an index segment the series (load existing "cold writes index segment" from disk into a new builder to update it if already present)
  2. Send the cold index block the new updated segment, along with a number of series that were just inserted
  3. For loop over all existing in memory cold block documents, checking if it is in the cold writes segment just persisted to disk, if so then write a new version of the in memory cold block segment without the ones that also exist in the cold writes segment from disk
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant