Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Check for expected benchmark results in integration test #474

Merged
merged 7 commits into from
Oct 28, 2022

Conversation

andygrove
Copy link
Member

@andygrove andygrove commented Oct 28, 2022

Which issue does this PR close?

Related to #330

Rationale for this change

The integration test has little value if it does not check that query results are correct.

This is implemented now but disabled for most queries because we do not produce the correct results because of issues with decimal precision and also because the test relies on casting the expected results (in csv format) to decimal and we do not support casting utf8 to decimal yet.

What changes are included in this PR?

check query results

Are there any user-facing changes?

No

@andygrove andygrove changed the title Check for expected benchmark results in integration test Prep work for ability to check for expected benchmark results in integration test Oct 28, 2022
@andygrove andygrove requested a review from Dandandan October 28, 2022 15:25
@andygrove andygrove marked this pull request as ready for review October 28, 2022 15:25
@andygrove
Copy link
Member Author

I cannot fully implement this until apache/datafusion#3478 is fixed

@andygrove andygrove changed the title Prep work for ability to check for expected benchmark results in integration test Check for expected benchmark results in integration test Oct 28, 2022
Copy link
Contributor

@Dandandan Dandandan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Super to have those. I think we should get them in even without the decimal setup 👍

Would be nice to have something similar for DataFusion as well to catch regressions there sooner.

@andygrove
Copy link
Member Author

Would be nice to have something similar for DataFusion as well to catch regressions there sooner.

Agreed. It would also be nice if I didn't have to keep making the same changes in both repos 🙄 but I don't have a good plan for how to do that

@andygrove andygrove merged commit 6ba7c7b into apache:master Oct 28, 2022
@andygrove andygrove deleted the it-check-results branch October 28, 2022 21:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants