Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make XFAIL actually assert failure #455

Closed
tgross35 opened this issue Jan 22, 2025 · 0 comments · Fixed by #460
Closed

Make XFAIL actually assert failure #455

tgross35 opened this issue Jan 22, 2025 · 0 comments · Fixed by #460

Comments

@tgross35
Copy link
Contributor

Probably return a custom enum rather than Option<TestResult> that says to assert success, assert failure, or skip.

tgross35 added a commit to tgross35/rust-libm that referenced this issue Jan 23, 2025
Currently our XFAILs are open ended; we do not check that it actually
fails, so we have no easy way of knowing that a previously-failing test
starts passing. Introduce a new enum that we return from overrides to
give us more flexibility here, including the ability to assert that
expected failures happen.

This includes refactoring of `precision.rs` to be more accurate about
where errors come from, if possible.

Fixes: rust-lang#455
tgross35 added a commit to tgross35/rust-libm that referenced this issue Jan 23, 2025
Currently our XFAILs are open ended; we do not check that it actually
fails, so we have no easy way of knowing that a previously-failing test
starts passing. Introduce a new enum that we return from overrides to
give us more flexibility here, including the ability to assert that
expected failures happen.

With the new enum, it is also possible to specify ULP via return value
rather than passing a `&mut u32` parameter.

This includes refactoring of `precision.rs` to be more accurate about
where errors come from, if possible.

Fixes: rust-lang#455
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant