New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature: Consider adding batching #83

Open

clevijoki opened this issue Jan 21, 2022 · 0 comments

clevijoki commented Jan 21, 2022

When tests have a large amount of overhead, and the test itself is fast, it would be nice to use batching to run multiple tests for each task.

In my use case it takes about 2+ seconds to start testing, and we have ~400 tests, each taking .4 seconds to run.

Running with 1 test per task it only results in a 2x speed up. Being able to batch to 8 tasks should give an approx 10x speedup.

I would just implement it as a parameter like --batch_size=8

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment