Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test the effectiveness of partial partition pruning #24740

Conversation

findinpath
Copy link
Contributor

@findinpath findinpath commented Jan 19, 2025

Description

This test showcases that there is partition pruning done at the Iceberg metadata layer even though EXPLAIN showcases that a filter that does not fully match the partition transform is not being pushed down.

Additional context and related issues

Fixes #19266
Cosmetic changes applied on #24483

Release notes

(x) This is not user-visible or is docs only, and no release notes are required.
( ) Release notes are required. Please propose a release note for me.
( ) Release notes are required, with the following suggested text:

## Section
* Fix some things. ({issue}`issuenumber`)

@cla-bot cla-bot bot added the cla-signed label Jan 19, 2025
@findinpath findinpath added iceberg Iceberg connector and removed cla-signed labels Jan 19, 2025
This test showcases that there is partition pruning done
at the Iceberg metadata layer even though EXPLAIN showcases
that a filter that does not fully match the partition transform
is not being pushed down.

Co-authored-by: Michiel De Smet <[email protected]>
@findinpath findinpath force-pushed the findinpath/iceberg-partition-transform-testing branch from cc74887 to 8ce9836 Compare January 20, 2025 13:45
@cla-bot cla-bot bot added the cla-signed label Jan 20, 2025
@ebyhr ebyhr merged commit 5b576a3 into trinodb:master Jan 20, 2025
32 of 41 checks passed
@github-actions github-actions bot added this to the 469 milestone Jan 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-signed iceberg Iceberg connector
Development

Successfully merging this pull request may close these issues.

Iceberg Push down partition pruning in connector when the filter doesn't fully match the partition transform
2 participants