Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Polars support #111

Open
axelwas opened this issue Feb 2, 2023 · 6 comments
Open

Polars support #111

axelwas opened this issue Feb 2, 2023 · 6 comments
Labels
enhancement New feature or request

Comments

@axelwas
Copy link

axelwas commented Feb 2, 2023

Hello, thank you for this great library!
Is it planned to support Polars library at some point ?

@genzgd genzgd added the enhancement New feature or request label Feb 2, 2023
@genzgd
Copy link
Collaborator

genzgd commented Feb 2, 2023

Polars is not currently on the roadmap, but we do look at the community interest in new features on a regular basis and adjust our priorities accordingly. Of course we'd welcome a pull request from someone who is familiar with Polars.

@qqletter
Copy link

Yes, I do hope this client will support polars.

@NotSimone
Copy link
Contributor

You can query to get pyarrow tables, which can then zero-copy into Polars with something like this:

df = pl.from_arrow(client.query_arrow(query))

@genzgd
Copy link
Collaborator

genzgd commented Mar 25, 2024

Feedback based on @NotSimone's comment would be appreciated -- is using PyArrow enough of a solution or does Polars use some other internal data format?

@axelwas
Copy link
Author

axelwas commented Mar 27, 2024

Polars does use Pyarrow under the hood so I think this would work.

Since my question, we ended up sticking with Pandas. Would it be possible to optionally make query_df return a Pyarrow backed Pandas DataFrame instead of Numpy backed ? I see use_numpy param is hardcoded to true here.

@genzgd
Copy link
Collaborator

genzgd commented Mar 27, 2024

Agreed that PyArrow DataFrames would be useful - #326. However I'm not sure when it will it will be prioritized.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants