You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
To rerun certain randomized tests, we introduced a seed, to be set for our random making a test suite reproducible. However, this seed is valid for all test runs per thread.
This has the downside, that we can only rerun the whole suite and if some behavior in another test changes, we are not able to rerun specific tests.
Tasks
Reset the Random after every test to the configured seed, to make sure we
Actual Behaviour
When I configure a seed and run a test suite the steps for a test might be different compared to running the test alone.
Expected Behaviour
When I configure a seed and get a result for a complete test suite, and rerun a single test I expect it to pull the same random values as in the suite.
The text was updated successfully, but these errors were encountered:
Quick Description
To rerun certain randomized tests, we introduced a seed, to be set for our random making a test suite reproducible. However, this seed is valid for all test runs per thread.
This has the downside, that we can only rerun the whole suite and if some behavior in another test changes, we are not able to rerun specific tests.
Tasks
Actual Behaviour
When I configure a seed and run a test suite the steps for a test might be different compared to running the test alone.
Expected Behaviour
When I configure a seed and get a result for a complete test suite, and rerun a single test I expect it to pull the same random values as in the suite.
The text was updated successfully, but these errors were encountered: