Skip to content
Rust

[EIM-104] [Test] Automated test refactor #425

Sign in to view logs

[EIM-104] [Test] Automated test refactor

[EIM-104] [Test] Automated test refactor #425

GitHub Actions / Tests macos-aarch64-GitHub.zip failed Jan 22, 2025 in 0s

28 passed, 2 failed and 3 skipped

Tests failed

Report Passed Failed Skipped Time
results-basic-test.json 11✅ 2❌ 2⚪ 1862s
results-extended-test.json 16✅ 1870s
results-pre-requisites-test.json 1✅ 1⚪ 2s

❌ results-basic-test.json

15 tests were completed in 1862s with 11 passed, 2 failed and 2 skipped.

Test suite Passed Failed Skipped Time
/Users/runner/work/idf-im-cli/idf-im-cli/tests/runs/testRun.test.js 11✅ 2❌ 2⚪ 1820s

❌ /Users/runner/work/idf-im-cli/idf-im-cli/tests/runs/testRun.test.js

1 - EIM command line arguments -> Basic Arguments Tests ->
  ✅ should handle invalid arguments
  ✅ should show correct version number
  ✅ should show help with --help argument
2 - Installation manager default installation -> 1 - Run Install Wizard steps ->
  ✅ Should install IDF using wizard and default values
2 - Installation manager default installation -> 2 - Post installation test (create and build project) ->
  ✅ 1 - Should create a new project based on a template
  ✅ 2 - Should set the target
  ✅ 3 - Should build project for the selected target
3 - Installation using custom settings -> non-interactive-basic -> 1 - Run custom installation using given parameters ->
  ✅ Should install IDF using specified parameters
3 - Installation using custom settings -> non-interactive-basic -> 2 - Post installation test (create and build project) ->
  ✅ 1 - Should create a new project based on a template
  ✅ 2 - Should set the target
  ✅ 3 - Should build project for the selected target
4 - Installation using custom settings -> non-interactive-full-parameters -> 1 - Run custom installation using given parameters ->
  ❌ Should install IDF using specified parameters
	Failed to complete installation, missing 'Successfully Installed IDF': expected false to be true
4 - Installation using custom settings -> non-interactive-full-parameters -> 2 - Post installation test (create and build project) ->
  ❌ 1 - Should create a new project based on a template
	sdkconfig.ci file not shown after a ls command, file copy failed: expected false to be true
  ⚪ 2 - Should set the target
  ⚪ 3 - Should build project for the selected target

✅ results-extended-test.json

16 tests were completed in 1870s with 16 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
/Users/runner/work/idf-im-cli/idf-im-cli/tests/runs/testRun.test.js 16✅ 1806s

✅ /Users/runner/work/idf-im-cli/idf-im-cli/tests/runs/testRun.test.js

1 - Installation using custom settings -> Extended 1 -> 1 - Run custom installation using given parameters ->
  ✅ Should install IDF using specified parameters
1 - Installation using custom settings -> Extended 1 -> 2 - Post installation test (create and build project) ->
  ✅ 1 - Should create a new project based on a template
  ✅ 2 - Should set the target
  ✅ 3 - Should build project for the selected target
2 - Installation using custom settings -> Extended 2 -> 1 - Run custom installation using given parameters ->
  ✅ Should install IDF using specified parameters
2 - Installation using custom settings -> Extended 2 -> 2 - Post installation test (create and build project) ->
  ✅ 1 - Should create a new project based on a template
  ✅ 2 - Should set the target
  ✅ 3 - Should build project for the selected target
3 - Installation using custom settings -> Extended 3 -> 1 - Run custom installation using given parameters ->
  ✅ Should install IDF using specified parameters
3 - Installation using custom settings -> Extended 3 -> 2 - Post installation test (create and build project) ->
  ✅ 1 - Should create a new project based on a template
  ✅ 2 - Should set the target
  ✅ 3 - Should build project for the selected target
4 - Installation using custom settings -> Extended 4 -> 1 - Run custom installation using given parameters ->
  ✅ Should install IDF using specified parameters
4 - Installation using custom settings -> Extended 4 -> 2 - Post installation test (create and build project) ->
  ✅ 1 - Should create a new project based on a template
  ✅ 2 - Should set the target
  ✅ 3 - Should build project for the selected target

✅ results-pre-requisites-test.json

2 tests were completed in 2s with 1 passed, 0 failed and 1 skipped.

Test suite Passed Failed Skipped Time
/Users/runner/work/idf-im-cli/idf-im-cli/tests/script/prerequisites.test.js 1✅ 1⚪ 207ms

✅ /Users/runner/work/idf-im-cli/idf-im-cli/tests/script/prerequisites.test.js

Check if prerequisites are installed -> Pre-Requisites test on non windows platform
  ✅ Should detect missing requirements
Check if prerequisites are installed -> Pre-requisites test on Windows
  ⚪ should offer to install prerequisites and exit upon negative answer

Annotations

Check failure on line 0 in results-basic-test.json

See this annotation in the file changed.

@github-actions github-actions / Tests macos-aarch64-GitHub.zip

/Users/runner/work/idf-im-cli/idf-im-cli/tests/runs/testRun.test.js ► 4 - Installation using custom settings -> non-interactive-full-parameters -> 1 - Run custom installation using given parameters -> ► Should install IDF using specified parameters 

Failed test found in:
  results-basic-test.json
Error:
  Failed to complete installation, missing 'Successfully Installed IDF': expected false to be true
Raw output 
AssertionError: Failed to complete installation, missing 'Successfully Installed IDF': expected false to be true
    at Context.<anonymous> (file:///Users/runner/work/idf-im-cli/idf-im-cli/tests/script/installCustom.test.js:83:20)

Check failure on line 0 in results-basic-test.json

See this annotation in the file changed.

@github-actions github-actions / Tests macos-aarch64-GitHub.zip

/Users/runner/work/idf-im-cli/idf-im-cli/tests/runs/testRun.test.js ► 4 - Installation using custom settings -> non-interactive-full-parameters -> 2 - Post installation test (create and build project) -> ► 1 - Should create a new project based on a tem... 

Failed test found in:
  results-basic-test.json
Error:
  sdkconfig.ci file not shown after a ls command, file copy failed: expected false to be true
Raw output 
AssertionError: sdkconfig.ci file not shown after a ls command, file copy failed: expected false to be true
    at Context.<anonymous> (file:///Users/runner/work/idf-im-cli/idf-im-cli/tests/script/postInstall.test.js:99:20)
View more details on GitHub Actions