New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Switch Modin's support from full to lazy? #1823

Open

MarcoGorelli opened this issue Jan 18, 2025 · 0 comments

Labels

needs discussion

Member

MarcoGorelli commented Jan 18, 2025

We've observed some cases when doing operations natively in Modin is slower than just converting to pandas upfront and then carrying on in pandas

This is the opposite of what we see for other libraries (pyarrow, Polars) where doing operations natively is typically many times faster than converting to pandas and operating in pandas (see https://plotly.com/blog/chart-smarter-not-harder-universal-dataframe-support/ for some examples)

Should we only support Modin at the lazy level? cc @sfc-gh-mvashishtha

MarcoGorelli added the needs discussion label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment