Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove the logic of memtable flush controlled by memory series size #13653

Closed
wants to merge 44 commits into from

Conversation

HTHou
Copy link
Contributor

@HTHou HTHou commented Sep 29, 2024

Description

In this PR, if the row number of a memory chunk exceeded the avgSeriesPointNumberThreshold, or the size of a binary type memory chunk exceeded the targetChunkSize, this memory chunk will split to multiple disk chunks in the TsFile.

@HTHou HTHou closed this Sep 29, 2024
Copy link

codecov bot commented Sep 29, 2024

Codecov Report

Attention: Patch coverage is 81.62162% with 34 lines in your changes missing coverage. Please review.

Project coverage is 39.47%. Comparing base (fd721d6) to head (f016492).
Report is 7 commits behind head on master.

Files with missing lines Patch % Lines
...e/dataregion/memtable/AlignedWritableMemChunk.java 83.52% 14 Missing ⚠️
...geengine/dataregion/memtable/WritableMemChunk.java 82.14% 10 Missing ⚠️
...he/iotdb/db/utils/datastructure/AlignedTVList.java 69.56% 7 Missing ⚠️
...ageengine/dataregion/memtable/TsFileProcessor.java 66.66% 2 Missing ⚠️
...pache/iotdb/db/service/metrics/WritingMetrics.java 0.00% 1 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##             master   #13653      +/-   ##
============================================
+ Coverage     39.41%   39.47%   +0.06%     
  Complexity      193      193              
============================================
  Files          4342     4342              
  Lines        275482   275504      +22     
  Branches      33637    33644       +7     
============================================
+ Hits         108580   108763     +183     
+ Misses       166902   166741     -161     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@HTHou HTHou reopened this Sep 29, 2024
@HTHou HTHou changed the title [DRAFT] Split MemChunk if row number exceeded the avgSeriesPointNumberThreshold Remove the logic of memtable flush controlled by memory chunk size Oct 10, 2024
@HTHou HTHou marked this pull request as ready for review October 12, 2024 07:08
@HTHou HTHou changed the title Remove the logic of memtable flush controlled by memory chunk size Remove the logic of memtable flush controlled by memory series size Oct 12, 2024
@HTHou HTHou closed this Dec 30, 2024
@HTHou HTHou deleted the split_text_chunk branch December 30, 2024 09:29
@HTHou
Copy link
Contributor Author

HTHou commented Dec 30, 2024

moved to #14591

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants