2.0.1-pre.18

[2.0.1] - 2022-01-05

• Reverted "All tests are now run inside a InitTestScene, regardless of filter".
• Modify the RequiresPlayMode feature in order to be opt-in.
• Refactored documentation for 2.0.
• Fixed an issue where Oculus Quest headsets might timeout before the test run starts (DSTR-404).
• Fixed an issue where Explicit tests were included in the run if the assembly or namespace was selected (DSTR-405).
• Added stack traces for exceptions thrown in other threads while a test is running (DSTR-38).
• Fixed "Open source code" on tests when located inside a package.
• Added editor analytics.

2.0.1-pre.12

[2.0.1] - 2022-01-05

• Reverted "All tests are now run inside a InitTestScene, regardless of filter".
• Modify the RequiresPlayMode feature in order to be opt-in.
• Refactored documentation for 2.0.
• Fixed an issue where Oculus Quest headsets might timeout before the test run starts (DSTR-404).
• Fixed an issue where Explicit tests were included in the run if the assembly or namespace was selected (DSTR-405).
• Added stack traces for exceptions thrown in other threads while a test is running (DSTR-38).
• Fixed "Open source code" on tests when located inside a package.
• Added editor analytics.

[2.0.0] - 2021-07-21

• API improvements:
  • Made the TestRunnerWindow public, allowing other windows to reference it.
  • Added api for canceling test runs.
  • Added api for saving test results to a file.
  • Made test method/fixture arguments available in the ITestAdaptor as the Arguments property.
  • Extend playmode tests to support Build Configurations from com.unity.platforms package.
  • Added UNITY_TEST_FRAMEWORK define constraint to filter out test framework assemblies from platform build without tests (case 1210156)
  • Added new [ParameterizedIgnore] attribute which allows ignoring tests based on arguments which were passed to the test method.
• Performance improvements:
  • Reduce time taken by filtering operations when only a subset of tests is run
  • Reduce the per-test overhead of running tests in the editor
  • Added profiler markers around test setup, teardown, and execution.
  • Added a cache for assembly test suites, this reduces the time it takes to run tests
  • Reduced the time it takes to rebuild the test tree, to scan for assets a test created but did not delete
• UI improvements:
  • Overhauled UI
  • Progress bar actually showing the correct status of the test run
  • Added a button for saving the test results of the latest run.
  • Applied filtering to the ITestAdaptor argument of ICallbacks.RunStarted so that it corresponds to the actual test tree being run.
  • Improving the status icon for test suites to reselect the combined test result (DSTR-239).
• Better Logs:
  • Running tests in batchmode now displays a summary of the execution settings being used.
  • Improved the logging when exiting after a test run from the command line.
• Bug fixes:
  • Fixes that are breaking changes:
    • Fixed problem of setup getting rerunned after a new scene gets created (DSTR-159).
    • Fixed setup is being rerun when multiple Domain Reloads are triggered by a Test (DSTR-68).
  • Other fixes:
    • Fixed an issue where if the first test enters PlayMode from UnitySetup then the test body will not run on consecutive runs (case 1260901).
    • Fixed TestRunnerApi memory leaks by making obsolete the TestRunnerApi methods and replacing them with static versions (case DSTR-50).
    • Moved the targetPlatform specified when running tests in the TestRunnerApi from the Filter to the ExecutionSettings.
    • Added a new PreservedValuesAttribute to allow for using the nunit ValuesAttribute at players with a high stripping level (case DSTR-33).
    • Changed the style of the category dropdown, fixing an issue where more than 32 categories did not work correctly (DSTR-11).
    • Fixed issue regarding playmode tests execution status staying running even after the test finished if domain reload was disabled (DSTR-5).
    • Internal: Remove ##utp message AssemblyCompilationErrors (ds-1277)
    • Delay command line test run execution until the first editor update to allow InitializeOnLoad methods to execute first (DSTR-151)
    • Improve player connection timeout problem : don't use a queue to send messages through the player connection (DSTR-100).
    • Refactored the test runner core system, resulting in multiple smaller bug fixes and stability improvements.
    • Fixed uncategorized UI tests filtering for parameterized tests (DSTR-219).
    • Fixed issue when . suffix was applied to BuildTargets without extension.
    • Added support for GameCoreXboxOne and GameCoreXboxSeries reduced location path length.
    • Added validation of IEnumerator return type for parameterized tests with UnityTest attribute (DSTP-743).

1.1.30

[1.1.30] - 2021-10-15

• Added validation of IEnumerator return type for parameterized tests with UnityTest attribute (DSTP-743).
• Fixed runInBackground reset to original value after finishing to run playmode tests (DSTR-248).
• Fixed issue with circular assembly references when constructing the test tree (DSTR-300).

1.1.29

[1.1.29] - 2021-08-12

• Nested enumerator execution order fix (DSTR-227).
• Fix UI not running any tests if run select on a nested namespaces (DSTR-256).

[1.1.28] - 2021-06-25

• Fix CountDownEvent reference due to com.unity.ext.nunit update.
• Various performance optimization to fix "Test execution timed out. No activity received from the player in 600 seconds."(DSTR-100).

1.1.27

[1.1.27] - 2021-06-15

• Fix empty reason on passed tests results xml (DSTR-63)
• Fix Repeat and Retry attribute for UnityTest in PlayMode (DSTR-237).
• Remove XDK Xbox One platform after Unity 2020.3
• Fixed issue when . suffix was applied to BuildTargets without extension.
• Added support for GameCoreXboxOne and GameCoreXboxSeries reduced location path length.

1.1.26

[1.1.26] - 2021-05-05

• Fix html bug in TestRunnerApi API code snippet (DS-1973).
• Fix typo bug in PreBuildSetup code example (DS-1974).
• Fix incorrect syntax in command line reference (DS-1971).

[1.1.25] - 2021-05-05

• Fixed a bug where test filter would match project or player path (DSTP-412).
• Added playerGraphicsAPI TestSettings parameter

1.1.24

[1.1.24] - 2021-03-04

• Improving UTF documentation(DSTR-120)
  • Updated "Actions outside of tests" section of user manual. Added flow charts to clarify execution order for SetUp/TearDown, TestActions, and complete flow (DSTR-121).
  • Fixed accepted values for scriptingBackend argument to be string literals instead of int values (DSTR-122).
  • Fixed possible values of ResultState to be Passed, Failed, Skipped, Inconclusive, plus labels instead of Success and Failure (DSTR-125).
  • Added NUNit version information (DSTR-130).
  • Added namespace information for LogAsset in user manual (DSTR-124).
  • Added instructions for creating additional sets of tests (DSTR-129).
  • Added information on testResults XML output format and exit codes (DSTR-131).
  • Updated description of testPlatform command line argument to clarify accepted values and their meaning (DSTR-123).
• Reduce time taken by filtering operations when only a subset of tests is run.
• Reduced the time taken to rebuild the test tree and to scan for assets a test created but did not delete.
• Reduce the per-test overhead of running tests in the editor.
• Added profiler markers around test setup, teardown, and execution.
• Fixed unstable timeout bug (DSTR-21).

[1.1.23] - 2021-01-21

• Improving UTF documentation(DSTR-120)
  • Updated "Actions outside of tests" section of user manual. Added flow charts to clarify execution order for SetUp/TearDown, TestActions, and complete flow (DSTR-121).
  • Fixed accepted values for scriptingBackend argument to be string literals instead of int values (DSTR-122).
  • Fixed possible values of ResultState to be Passed, Failed, Skipped, Inconclusive, plus labels instead of Success and Failure (DSTR-125).
  • Added NUNit version information (DSTR-130).
  • Added namespace information for LogAsset in user manual (DSTR-124).
  • Added instructions for creating additional sets of tests (DSTR-129).
  • Added information on testResults XML output format and exit codes (DSTR-131).
  • Updated description of testPlatform command line argument to clarify accepted values and their meaning (DSTR-123).

1.1.22

[1.1.22] - 2021-01-21

• Fixed issue where test result of an explicit test was set to skipped in case it was passing and running from command line with testfilter set to the explicit test (DS-1236).
• Fixed an issue where tests located in assemblies that did not directly reference any test assemblies were not included (DSTR-30).
• Fixed an issue where UnitySetup methods were incorrectly being rerun when entering playmode, rather than being skipped (DSTR-68).
• Internal: Remove ##utp message AssemblyCompilationErrors (DS-1277)
• Fixed issue where if the timeout was exceeded in SetUp the timeout exception was not thrown(DSTR-21).
• Removed ability to Enable playmode tests for all assemblies from the TestRunner UI, since it is a deprecated behavior. It enforces to use of assembly definition files (DSTR-45).
• Fixed typo in LogAssert.cs documentation.

[1.1.21] - 2021-01-14

• Fixed issue where test result of an explicit test was set to skipped in case it was passing and running from command line with testfilter set to the explicit test (DS-1236).
• Fixed an issue where tests located in assemblies that did not directly reference any test assemblies were not included (DSTR-30).
• Fixed an issue where UnitySetup methods were incorrectly being rerun when entering playmode, rather than being skipped (DSTR-68).
• Internal: Remove ##utp message AssemblyCompilationErrors (DS-1277)
• Fixed issue where if the timeout was exceeded in SetUp the timeout exception was not thrown(DSTR-21).
• Removed ability to Enable playmode tests for all assemblies from the TestRunner UI, since it is a deprecated behavior. It enforces to use of assembly definition files (DSTR-45).

1.1.20

[1.1.20] - 2020-12-04

• The logscope is now available in OneTimeTearDown.
• Fixed an issue where failing tests would not result in the correct exit code if a domain reload happens after the test has run (DS-1304).
• If a player build fails, the test specific build settings should be cleaned up and the original values restored as intended (DS-1001).
• Added better error message when using TestRunCallbackAttribute and the implementation is stripped away (DS-454).
• Fixed an issue where the test results xml would have a zero end-time for tests executed before a domain reload (DSTR-63).
• Fixed OpenSource in case of a Test in a nested class (DSTR-6)
• UnityTests with a domain reload now works correctly in combination with Retry and Repeat attributes (DS-428).
• Fixed OpenSource in case of Tests located inside a package (DS-432)
• Update com.unity.ext.nunit version to 1.0.6

1.1.19

[1.1.19] - 2020-11-17

• Command line runs with an inconclusive test result now exit with exit code 2 (case DS-951).
• Fixed timeout during UnitySetUp which caoused test to pass instead of failing due to wrong time format.
• Timeout exeption thrown when timeout time is exeded in the UnitySetup when using WaitForSeconds(n).
• Method marked with UnityTest that are not returning IEnumerator is now giving a proper error (DS-1059).
• Updating com.unity.ext.nunit version.