Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Remove old metadata files #1199

Closed
Tracked by #1065
sungwy opened this issue Sep 24, 2024 · 2 comments · Fixed by #1607
Closed
Tracked by #1065

Remove old metadata files #1199

sungwy opened this issue Sep 24, 2024 · 2 comments · Fixed by #1607
Assignees
@kaushiksrini

Comments

@sungwy
Copy link
Collaborator

sungwy commented Sep 24, 2024 •
edited
Loading

Support write.metadata.delete-after-commit.enabled and write.metadata.previous-versions-max table properties and automatically delete old metadata files on commit

Feature reference: https://iceberg.apache.org/docs/1.5.1/maintenance/#remove-old-metadata-files
@sungwy sungwy mentioned this issue Sep 24, 2024
Open
5 tasks
@sungwy sungwy added this to the PyIceberg 0.8.0 release milestone Sep 24, 2024
@kaushiksrini
Copy link
Contributor

hey @sungwy, i'd be interested in implementing this feature!

@sungwy
Copy link
Collaborator Author

sungwy commented Oct 16, 2024

Awesome! Just assigned this to you @kaushiksrini

@kevinjqliu kevinjqliu removed this from the PyIceberg 0.9.0 release milestone Feb 1, 2025
@kaushiksrini kaushiksrini mentioned this issue Feb 4, 2025
Merged
kevinjqliu added a commit that referenced this issue Feb 12, 2025
@kaushiksrini @kevinjqliu
Clean up old metadata (#1607)
d6dce6d 
Implements property `write.metadata.delete-after-commit.enabled` from
https://iceberg.apache.org/docs/1.5.1/maintenance/#remove-old-metadata-files.

Closes #1199

---------

Co-authored-by: Kevin Liu <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@kaushiksrini kaushiksrini

Labels
None yet
Projects
None yet
Milestone
No milestone
3 participants
@kevinjqliu @kaushiksrini @sungwy