Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add multi-partition Join support to cuDF-Polars #17518

Open
wants to merge 10 commits into
base: branch-25.02
Choose a base branch
from
Open

Add multi-partition Join support to cuDF-Polars #17518

wants to merge 10 commits into from

Conversation

rjzamora
Copy link
Member

@rjzamora rjzamora commented Dec 4, 2024

Description

Adds multi-partition Join support following the same design as #17441

In order to support parallel joins, this PR also introduces a special Shuffle node.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@rjzamora rjzamora added feature request New feature or request 2 - In Progress Currently a work in progress non-breaking Non-breaking change labels Dec 4, 2024
@rjzamora rjzamora self-assigned this Dec 4, 2024
@copy-pr-bot copy-pr-bot
Copy link

copy-pr-bot bot commented Dec 4, 2024

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@github-actions github-actions bot added Python Affects Python cuDF API. cudf.polars Issues specific to cudf.polars labels Dec 4, 2024
@rjzamora
Copy link
Member Author

rjzamora commented Dec 4, 2024

/ok to test

@rjzamora rjzamora marked this pull request as ready for review December 6, 2024 14:16
@rjzamora rjzamora requested a review from a team as a code owner December 6, 2024 14:16
@rjzamora rjzamora requested review from bdice and Matt711 December 6, 2024 14:16
@rjzamora rjzamora changed the title [WIP] Add multi-partition Join support to cuDF-Polars Add multi-partition Join support to cuDF-Polars Jan 11, 2025
@rjzamora rjzamora mentioned this pull request Jan 15, 2025
Open
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@bdice bdice Awaiting requested review from bdice bdice is a code owner automatically assigned from rapidsai/cudf-python-codeowners

@Matt711 Matt711 Awaiting requested review from Matt711 Matt711 is a code owner automatically assigned from rapidsai/cudf-python-codeowners

At least 1 approving review is required to merge this pull request.

Assignees

@rjzamora rjzamora

Labels
2 - In Progress Currently a work in progress cudf.polars Issues specific to cudf.polars feature request New feature or request non-breaking Non-breaking change Python Affects Python cuDF API.
Projects
cuDF Python
Status: In Progress
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@rjzamora