Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug: Neodymoum Random is not Fixed for each test #355

Open
1 task
wurzelkuchen opened this issue Feb 11, 2025 · 0 comments
Open
1 task

Bug: Neodymoum Random is not Fixed for each test #355

wurzelkuchen opened this issue Feb 11, 2025 · 0 comments
Labels
bug codeImplementationNeeded This issue requires a change in the code of Neodymium

Comments

@wurzelkuchen
Copy link
Contributor

Quick Description

To rerun certain randomized tests, we introduced a seed, to be set for our random making a test suite reproducible. However, this seed is valid for all test runs per thread.

This has the downside, that we can only rerun the whole suite and if some behavior in another test changes, we are not able to rerun specific tests.

Tasks

  • Reset the Random after every test to the configured seed, to make sure we

Actual Behaviour

When I configure a seed and run a test suite the steps for a test might be different compared to running the test alone.

Expected Behaviour

When I configure a seed and get a result for a complete test suite, and rerun a single test I expect it to pull the same random values as in the suite.

@wurzelkuchen wurzelkuchen added bug codeImplementationNeeded This issue requires a change in the code of Neodymium labels Feb 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug codeImplementationNeeded This issue requires a change in the code of Neodymium
Projects
None yet
Development

No branches or pull requests

1 participant