[Parse incomplete chunks 3/9] Add ChunkInfo
metadata to DS buffer to record (un)filled gap locations
#1788
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary: Adds metadata to the
always_contiguous_data_stream_buffer
to keep track of gap and filler locations. This forms the basis of tracking the number of bytes rendered unparseable due to the presence of a gap (i.e. the bytes cut off before the gap). It is also used to lazily parse as far as possible up to the gap in a future PR.A
TODO
is added to thelazy_contiguous
implementation in case we switch to that at some point in the future.Note that this PR relies on changes introduced in #1786 and #1787.
Type of change: /kind feature
Test Plan: Test cases added to
data_stream_buffer_test.cc
Additional Context: #1755