Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

E2E tests are flaky in GitHub actions #4455

Open
gamesh411 opened this issue Feb 11, 2025 · 0 comments
Open

E2E tests are flaky in GitHub actions #4455

gamesh411 opened this issue Feb 11, 2025 · 0 comments
Assignees
Labels
CI 📦 test ☑️ Adding or refactoring tests web 🌍 Related to the web app

Comments

@gamesh411
Copy link
Collaborator

The Firefox GUI tests in GitHub Actions are flaky right now. On Github, the tests are not non-deterministically failing (for example, https://github.com/Ericsson/codechecker/actions/runs/12867882068/job/35873440981?pr=4427 )

I have noticed a recurring theme in the errors in the GitHub job runner: Selenium reports that the click events are intercepted by an overlay element (basically, the button to be clicked is obscured).

Error message excerpt:

Error while running .clickElement() protocol action: Element is not clickable at point (1045,507) because another element

obscures it

TimeoutError: An error occurred while running .click() command on <Section [name=removeCleanupPlanDialog],Element [name=@confirmBtn]>:
{"status":-1,"code":"","state":"element click intercepted","value":

{"additionalInformation":"\nDriver info: driver.version: unknown","localizedMessage":"Element <button class="confirm-btn v-btn v-btn--text theme--light v-size--default error--text" type="button"> is not clickable at point (1045,507) because another element <div class="v-overlay__scrim"> obscures it\nBuild info: version: '3.141.59', revision: 'e82be7d358', time: '2018-11-14T08:25:53'\nSystem info: host: 'fv-az1769-515', ip: '10.1.0.7', os.name: 'Linux', os.arch: 'amd64', os.version: '5.15.0-1074-azure', java.version: '11.0.25'\nDriver info: driver.version: unknown","systemInformation":"System info: host: 'fv-az1769-515', ip: '10.1.0.7', os.name: 'Linux', os.arch: 'amd64', os.version: '5.15.0-1074-azure', java.version: '11.0.25'","supportUrl":null,"cause":null,"suppressed":[],"message":"Element <button class="confirm-btn v-btn v-btn--text theme--light v-size--default error--text" type="button"> is not clickable at point (1045,507) because another element <div class="v-overlay__scrim"> obscures it\nBuild info: version: '3.141.59', revision: 'e82be7d358', time: '2018-11-14T08:25:53'\nSystem info: host: 'fv-az1769-515', ip: '10.1.0.7', os.name: 'Linux', os.arch: 'amd64', os.version: '5.15.0-1074-azure', java.version: '11.0.25'\nDriver info: driver.version: unknown","class":"org.openqa.selenium.ElementClickInterceptedException","buildInformation":null}
,"errorStatus":64,"error":"Element <button class="confirm-btn v-btn v-btn-text themelight v-sizedefault error-text" type="button"> is not clickable at point (1045,507) because another element <div class="v-overlay__scrim"> obscures it","httpStatusCode":500}
at Object.manage cleanup plans (/home/runner/work/codechecker/codechecker/web/server/vue-cli/e2e/specs/reports.js:669:29)
✖ Timed out while waiting for element <Section [name=cleanupPlanDialog],Element [name=@emptyTable]> to be visible for 5000 milliseconds. - expected "visible" but got: "not visible" (5161ms)
at Object.manage cleanup plans (/home/runner/work/codechecker/codechecker/web/server/vue-cli/e2e/specs/reports.js:672:8)

We could check if this is a timing issue (possibly by introducing delays before triggering the clicks) or something else causes this.

@gamesh411 gamesh411 added CI 📦 test ☑️ Adding or refactoring tests web 🌍 Related to the web app labels Feb 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI 📦 test ☑️ Adding or refactoring tests web 🌍 Related to the web app
Projects
None yet
Development

No branches or pull requests

2 participants