Introduce a custom reporter for Playwright #1683
iAmmar7unit-tests.yml
on: pull_request
Matrix: Run unit and stack tests
Matrix: Browser SDK production / Run E2E tests
Matrix: Browser SDK staging / Run E2E tests
Matrix: RealtimeAPI SDK production / Run E2E tests
Matrix: RealtimeAPI SDK staging / Run E2E tests
Browser SDK production
/
report-result
3s
Browser SDK staging
/
report-result
3s
RealtimeAPI SDK production
/
report-result
3s
RealtimeAPI SDK staging
/
report-result
4s
Annotations
7 errors, 51 warnings, and 15 notices
|
[callfabric] › callfabric/conversation.spec.ts:10:7 › Conversation Room › send message in a room conversation:
internal/e2e-js/tests/callfabric/conversation.spec.ts#L98
1) [callfabric] › callfabric/conversation.spec.ts:10:7 › Conversation Room › send message in a room conversation
Error: expect(received).toEqual(expected) // deep equality
Expected: 2
Received: 1
96 | expect(messages).not.toBeUndefined()
97 |
> 98 | expect(messages.data.length).toEqual(2)
| ^
99 | expect(messages.data[0]).toMatchObject(***
100 | conversation_id: addressId,
101 | details: ***,
at /home/runner/work/signalwire-js/signalwire-js/internal/e2e-js/tests/callfabric/conversation.spec.ts:98:34
|
|
Browser SDK production / Run E2E tests (20.x, callfabric)
Process completed with exit code 1.
|
|
RealtimeAPI SDK staging / Run E2E tests (20.x, dev:rtonly)
Process completed with exit code 1.
|
|
[default] › roomSession.spec.ts:14:7 › RoomSession › should handle joining a room:
internal/e2e-js/tests/roomSession.spec.ts#L493
1) [default] › roomSession.spec.ts:14:7 › RoomSession › should handle joining a room, perform actions and then leave the room
Error: expect(received).toStrictEqual(expected) // deep equality
- Expected - 1
+ Received + 0
Object ***
"memMeta": "xx-yy-zzz",
- "updatedMemberKey": "ii-oo",
***
491 | return roomObj.getMemberMeta()
492 | ***)
> 493 | expect(initialMeta.meta).toStrictEqual(expected)
| ^
494 | ***
495 |
496 | expectRoomMemberMeta(***)
at expectRoomMemberMeta (/home/runner/work/signalwire-js/signalwire-js/internal/e2e-js/tests/roomSession.spec.ts:493:32)
|
|
Browser SDK production / Run E2E tests (20.x, default)
Process completed with exit code 1.
|
|
[default] › video.test.ts:14:7 › Video › should join the room and listen for events:
internal/e2e-realtime-api/src/playwright/video.test.ts#L1
1) [default] › video.test.ts:14:7 › Video › should join the room and listen for events ───────────
Test timeout of 60000ms exceeded.
|
|
RealtimeAPI SDK production / Run E2E tests (20.x, dev:playwright)
Process completed with exit code 1.
|
|
Run unit and stack tests (20.x)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Browser SDK production / Run E2E tests (20.x, callfabric)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
RealtimeAPI SDK staging / Run E2E tests (20.x, dev:rtonly)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Browser SDK production / Run E2E tests (20.x, default)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Slow Test:
internal/e2e-js/[default] › roomSession.spec.ts#L1
internal/e2e-js/[default] › roomSession.spec.ts took 18.5s
|
|
RealtimeAPI SDK staging / report-result
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Browser SDK production / Run E2E tests (20.x, streaming)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Browser SDK production / Run E2E tests (20.x, videoElement)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Slow Test:
internal/e2e-js/[videoElement] › buildVideoWithFabricSdk.spec.ts#L1
internal/e2e-js/[videoElement] › buildVideoWithFabricSdk.spec.ts took 27.5s
|
|
Slow Test:
internal/e2e-js/[videoElement] › buildVideoWithVideoSdk.spec.ts#L1
internal/e2e-js/[videoElement] › buildVideoWithVideoSdk.spec.ts took 25.0s
|
|
Browser SDK production / Run E2E tests (20.x, badNetwork)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Slow Test:
internal/e2e-js/[badNetwork] › roomSessionBadNetwork.spec.ts#L1
internal/e2e-js/[badNetwork] › roomSessionBadNetwork.spec.ts took 50.1s
|
|
Browser SDK production / Run E2E tests (20.x, audience)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Slow Test:
internal/e2e-js/[audience] › roomSessionFollowLeader.spec.ts#L1
internal/e2e-js/[audience] › roomSessionFollowLeader.spec.ts took 20.9s
|
|
Slow Test:
internal/e2e-js/[audience] › roomSessionAudienceCount.spec.ts#L1
internal/e2e-js/[audience] › roomSessionAudienceCount.spec.ts took 20.5s
|
|
Browser SDK production / Run E2E tests (20.x, reattach)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Slow Test:
internal/e2e-js/[reattach] › roomSessionReattachMultiple.spec.ts#L1
internal/e2e-js/[reattach] › roomSessionReattachMultiple.spec.ts took 22.9s
|
|
Slow Test:
internal/e2e-js/[reattach] › roomSessionReattach.spec.ts#L1
internal/e2e-js/[reattach] › roomSessionReattach.spec.ts took 21.0s
|
|
Browser SDK production / Run E2E tests (20.x, demote)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Slow Test:
internal/e2e-js/[demote] › roomSessionDemote.spec.ts#L1
internal/e2e-js/[demote] › roomSessionDemote.spec.ts took 28.7s
|
|
Slow Test:
internal/e2e-js/[demote] › roomSessionDemoteReattachPromote.spec.ts#L1
internal/e2e-js/[demote] › roomSessionDemoteReattachPromote.spec.ts took 21.0s
|
|
Slow Test:
internal/e2e-js/[demote] › roomSessionDemotePromote.spec.ts#L1
internal/e2e-js/[demote] › roomSessionDemotePromote.spec.ts took 17.9s
|
|
RealtimeAPI SDK production / Run E2E tests (20.x, dev:playwright)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Browser SDK production / Run E2E tests (20.x, promote)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Slow Test:
internal/e2e-js/[promote] › roomSessionPromoteDemote.spec.ts#L1
internal/e2e-js/[promote] › roomSessionPromoteDemote.spec.ts took 36.3s
|
|
Slow Test:
internal/e2e-js/[promote] › roomSessionPromoteReattachDemote.spec.ts#L1
internal/e2e-js/[promote] › roomSessionPromoteReattachDemote.spec.ts took 35.4s
|
|
Browser SDK staging / Run E2E tests (20.x, videoElement)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Slow Test:
internal/e2e-js/[videoElement] › buildVideoWithFabricSdk.spec.ts#L1
internal/e2e-js/[videoElement] › buildVideoWithFabricSdk.spec.ts took 59.2s
|
|
Slow Test:
internal/e2e-js/[videoElement] › buildVideoWithVideoSdk.spec.ts#L1
internal/e2e-js/[videoElement] › buildVideoWithVideoSdk.spec.ts took 45.9s
|
|
Browser SDK staging / Run E2E tests (20.x, callfabric)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Slow Test:
internal/e2e-js/[callfabric] › callfabric/swml.spec.ts#L1
internal/e2e-js/[callfabric] › callfabric/swml.spec.ts took 30.7s
|
|
Slow Test:
internal/e2e-js/[callfabric] › callfabric/raiseHand.spec.ts#L1
internal/e2e-js/[callfabric] › callfabric/raiseHand.spec.ts took 23.1s
|
|
Slow Test:
internal/e2e-js/[callfabric] › callfabric/videoRoom.spec.ts#L1
internal/e2e-js/[callfabric] › callfabric/videoRoom.spec.ts took 22.4s
|
|
Slow Test:
internal/e2e-js/[callfabric] › callfabric/relayApp.spec.ts#L1
internal/e2e-js/[callfabric] › callfabric/relayApp.spec.ts took 22.2s
|
|
Slow Test:
internal/e2e-js/[callfabric] › callfabric/reattach.spec.ts#L1
internal/e2e-js/[callfabric] › callfabric/reattach.spec.ts took 19.9s
|
|
Browser SDK production / Run E2E tests (20.x, v2WebRTC)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Slow Test:
internal/e2e-js/[v2WebRTC] › v2Webrtc/v2WebrtcFromRest.spec.ts#L1
internal/e2e-js/[v2WebRTC] › v2Webrtc/v2WebrtcFromRest.spec.ts took 2.7m
|
|
Slow Test:
internal/e2e-js/[v2WebRTC] › v2Webrtc/webrtcCalling.spec.ts#L1
internal/e2e-js/[v2WebRTC] › v2Webrtc/webrtcCalling.spec.ts took 25.6s
|
|
Browser SDK staging / Run E2E tests (20.x, v2WebRTC)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Slow Test:
internal/e2e-js/[v2WebRTC] › v2Webrtc/v2WebrtcFromRest.spec.ts#L1
internal/e2e-js/[v2WebRTC] › v2Webrtc/v2WebrtcFromRest.spec.ts took 2.8m
|
|
Slow Test:
internal/e2e-js/[v2WebRTC] › v2Webrtc/webrtcCalling.spec.ts#L1
internal/e2e-js/[v2WebRTC] › v2Webrtc/webrtcCalling.spec.ts took 29.4s
|
|
Browser SDK production / report-result
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Browser SDK staging / Run E2E tests (20.x, default)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Slow Test:
internal/e2e-js/[default] › roomSessionJoinFrom.spec.ts#L1
internal/e2e-js/[default] › roomSessionJoinFrom.spec.ts took 54.6s
|
|
Slow Test:
internal/e2e-js/[default] › roomSession.spec.ts#L1
internal/e2e-js/[default] › roomSession.spec.ts took 39.8s
|
|
Slow Test:
internal/e2e-js/[default] › roomSessionRemoveAfterSecondsElapsed.spec.ts#L1
internal/e2e-js/[default] › roomSessionRemoveAfterSecondsElapsed.spec.ts took 29.5s
|
|
Slow Test:
internal/e2e-js/[default] › roomSessionRemoveAt.spec.ts#L1
internal/e2e-js/[default] › roomSessionRemoveAt.spec.ts took 29.5s
|
|
Slow Test:
internal/e2e-js/[default] › roomSessionDevices.spec.ts#L1
internal/e2e-js/[default] › roomSessionDevices.spec.ts took 25.7s
|
|
Browser SDK staging / report-result
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
RealtimeAPI SDK production / Run E2E tests (20.x, dev:rtonly)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
RealtimeAPI SDK production / report-result
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
🎭 Playwright Run Summary
1 failed
[callfabric] › callfabric/conversation.spec.ts:10:7 › Conversation Room › send message in a room conversation
16 skipped
2 passed (7.2s)
|
|
🎭 Playwright Run Summary
1 failed
[default] › roomSession.spec.ts:14:7 › RoomSession › should handle joining a room, perform actions and then leave the room
30 skipped
4 passed (24.4s)
|
|
🎭 Playwright Run Summary
5 passed (30.6s)
|
|
🎭 Playwright Run Summary
12 passed (53.1s)
|
|
🎭 Playwright Run Summary
1 passed (50.8s)
|
|
🎭 Playwright Run Summary
4 passed (1.0m)
|
|
🎭 Playwright Run Summary
8 passed (1.2m)
|
|
🎭 Playwright Run Summary
4 passed (1.3m)
|
|
🎭 Playwright Run Summary
1 failed
[default] › video.test.ts:14:7 › Video › should join the room and listen for events ────────────
5 passed (1.5m)
|
|
🎭 Playwright Run Summary
4 passed (1.5m)
|
|
🎭 Playwright Run Summary
12 passed (1.8m)
|
|
🎭 Playwright Run Summary
2 skipped
17 passed (2.4m)
|
|
🎭 Playwright Run Summary
7 passed (3.1m)
|
|
🎭 Playwright Run Summary
7 passed (3.3m)
|
|
🎭 Playwright Run Summary
2 skipped
33 passed (5.2m)
|