Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
ExecutionTest::UnaryHalfOpTest#AcosHalf: Update tolerance (microsoft#…
…6690) Update tolerance for ExecutionTest::UnaryHalfOpTest#AcosHalf test. Enables implementations to calculate `acos` for fp16 type by converting to fp32, doing fp32 math, and then converting back to fp16 using round-to-nearest-even conversing (RTNE) per D3D11 spec. For more details please see issue microsoft#6179. As mentioned in the linked issue, for these floating point tests a fixed point tolerance does not really make sense. It should vary based on the magnitude of the expected value. But we are already using this approach in many similar test cases and the simplest fix now is to update the tolerance to accommodate the fp32-to-ft16 conversion. Fixes microsoft#6179
- Loading branch information