Skip to content

Commit

Permalink
Add support for merging compressed chunks
Browse files Browse the repository at this point in the history
Compressed chunks can be merged by applying the same copy+heap swap
technique to the internal compressed heaps as done for the
non-compressed heaps. However, special consideration is necessary for
cases where some chunks are compressed and some are not.

The way this is handled is to pick the first compressed chunk found
among the input chunks, and then use that as the "result" chunk. In
the next step all the chunks' non-compressed heaps are merged followed
by all the "internal" compressed heaps. In the last step, the result
chunk has its non-compressed and compressed heaps swapped with the
merged ones, respectively.

In all other regards, the merging works the same as before when merging
non-compressed chunks.
  • Loading branch information
erimatnor committed Feb 21, 2025
1 parent 69ec2c7 commit 702d543
Show file tree
Hide file tree
Showing 4 changed files with 479 additions and 190 deletions.
1 change: 1 addition & 0 deletions .unreleased/pr_7669
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
Implementes: #7669 Add support for merging compressed chunks
Loading

0 comments on commit 702d543

Please sign in to comment.