1) polls/polls.spec.ts:96:9 › Polls › should be creatable and votable ──────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 112 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/polls/polls.spec.ts/Polls-Timeline-tile-no-votes-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/polls-polls-Polls-should-be-creatable-and-votable/Polls-Timeline-tile-no-votes-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/polls-polls-Polls-should-be-creatable-and-votable/Polls-Timeline-tile-no-votes-diff.png Call log: - expect.toHaveScreenshot(Polls-Timeline-tile-no-votes.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile[data-scroll-tokens="$zS-SgwhHmDaiSw1XlDLIcXErXroKGg5GXpsyfErjfXA"]') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$zS-SgwhHmDaiSw1XlDLIcXErXroKGg5GXpsyfErjfXA" data-scroll-tokens="$zS-SgwhHmDaiSw1XlDLIcXErXroKGg5GXpsyfErjfXA" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection mx_EventTile_noBubble">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 112 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile[data-scroll-tokens="$zS-SgwhHmDaiSw1XlDLIcXErXroKGg5GXpsyfErjfXA"]') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$zS-SgwhHmDaiSw1XlDLIcXErXroKGg5GXpsyfErjfXA" data-scroll-tokens="$zS-SgwhHmDaiSw1XlDLIcXErXroKGg5GXpsyfErjfXA" class="mx_EventTile mx_EventTile_last mx_EventTile_lastInSection mx_EventTile_noBubble">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 112 pixels (ratio 0.01 of all image pixels) are different. 118 | .filter({ hasText: pollParams.title }) 119 | .getAttribute("data-scroll-tokens"); > 120 | await expect(getPollTile(page, pollId)).toMatchScreenshot("Polls_Timeline_tile_no_votes.png", { | ^ 121 | mask: [page.locator(".mx_MessageTimestamp")], 122 | }); 123 | at /home/runner/work/element-web/element-web/playwright/e2e/polls/polls.spec.ts:120:49

1) room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected) Locator: locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') Expected string: "mx_EditableItem_item" Received: <element(s) not found> Call log: - expect.toHaveClass with timeout 5000ms - waiting for locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') 29 | await localAddresses.getByRole("textbox").fill("gaming"); 30 | await localAddresses.getByRole("button", { name: "Add" }).click(); > 31 | await expect(localAddresses.getByText("#gaming:localhost")).toHaveClass("mx_EditableItem_item"); | ^ 32 | 33 | // Publish into the public rooms directory 34 | const publishedAddresses = page.locator(".mx_SettingsFieldset", { hasText: "Published Addresses" }); at /home/runner/work/element-web/element-web/playwright/e2e/room-directory/room-directory.spec.ts:31:69

1) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 › Threads Activity Centre › should mark all threads as read Error: locator.click: Error: strict mode violation: getByLabel('Mark all as read') resolved to 2 elements: 1) <div tabindex="0" role="button" aria-label="Mark all as read" class="mx_AccessibleButton mx_TopUnreadMessagesBar_markAsRead"></div> aka getByRole('main').getByLabel('Mark all as read') 2) <button tabindex="0" role="button" aria-labelledby=":r74:" class="_icon-button_bh2qc_17">…</button> aka locator('#thread-panel').getByLabel('Mark all as read') Call log: - waiting for getByLabel('Mark all as read') at spaces/threads-activity-centre/index.ts:379 377 | */ 378 | clickMarkAllThreadsRead() { > 379 | return this.page.getByLabel("Mark all as read").click(); | ^ 380 | } 381 | } 382 | at Helpers.clickMarkAllThreadsRead (/home/runner/work/element-web/element-web/playwright/e2e/spaces/threads-activity-centre/index.ts:379:57) at /home/runner/work/element-web/element-web/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:149:14

1) spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 › Threads Activity Centre › should mark all threads as read Error: expect(locator).toHaveScreenshot(expected) 39 pixels (ratio 0.04 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/spaces/threads-activity-centre/threadsActivityCentre.spec.ts/tac-no-indicator-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/spaces-threads-activity-ce-ffe63-ld-mark-all-threads-as-read/tac-no-indicator-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/spaces-threads-activity-ce-ffe63-ld-mark-all-threads-as-read/tac-no-indicator-diff.png Call log: - expect.toHaveScreenshot(tac-no-indicator.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('navigation', { name: 'Spaces' }).getByLabel('Threads') - locator resolved to <button tabindex="0" type="button" role="button" id="radix-:r8:" data-state="closed" aria-label="Threads" aria-haspopup="menu" aria-expanded="false" aria-disabled="false" aria-labelledby=":ra:" data-indicator="success" class="_icon-button_bh2qc_17 mx_ThreadsActivityCentreButton">…</button> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 39 pixels (ratio 0.04 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByRole('navigation', { name: 'Spaces' }).getByLabel('Threads') - locator resolved to <button tabindex="0" type="button" role="button" id="radix-:r8:" data-state="closed" aria-label="Threads" aria-haspopup="menu" aria-expanded="false" aria-disabled="false" aria-labelledby=":ra:" data-indicator="success" class="_icon-button_bh2qc_17 mx_ThreadsActivityCentreButton">…</button> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 39 pixels (ratio 0.04 of all image pixels) are different. at spaces/threads-activity-centre/index.ts:283 281 | await expect(this.getTacButton().locator("[data-indicator='success']")).not.toBeVisible(); 282 | await expect(this.getTacButton().locator("[data-indicator='critical']")).not.toBeVisible(); > 283 | await expect(this.getTacButton()).toMatchScreenshot("tac-no-indicator.png"); | ^ 284 | } 285 | 286 | /** at Helpers.assertNoTacIndicator (/home/runner/work/element-web/element-web/playwright/e2e/spaces/threads-activity-centre/index.ts:283:43) at /home/runner/work/element-web/element-web/playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts:151:9

1) read-receipts/redactions-in-threads.spec.ts:410:17 › Read receipts › redactions › in threads › A thread with a redacted unread is still read after restart Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible() Locator: getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_dot') Expected: not visible Received: visible Call log: - expect.not.toBeVisible with timeout 5000ms - waiting for getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_dot') 9 × locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" at read-receipts/index.ts:446 444 | async assertRead(room: string | { name: string }) { 445 | const tile = this.getRoomListTile(room); > 446 | await expect(tile.locator(".mx_NotificationBadge_dot")).not.toBeVisible(); | ^ 447 | await expect(tile.locator(".mx_NotificationBadge_count")).not.toBeVisible(); 448 | } 449 | at Helpers.assertRead (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:446:69) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/redactions-in-threads.spec.ts:440:28

1) oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account ─── Test timeout of 90000ms exceeded.

1) oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account ─── Error: page.waitForRequest: Test timeout of 90000ms exceeded. 21 | test("can register the oauth2 client and an account", async ({ context, page, homeserver, mailhog, mas }) => { 22 | const tokenUri = `http://localhost:${mas.port}/oauth2/token`; > 23 | const tokenApiPromise = page.waitForRequest( | ^ 24 | (request) => request.url() === tokenUri && request.postDataJSON()["grant_type"] === "authorization_code", 25 | ); 26 | at /home/runner/work/element-web/element-web/playwright/e2e/oidc/oidc-native.spec.ts:23:38

read-receipts/high-level.spec.ts took 3.3m

read-receipts/new-messages-in-threads.spec.ts took 1.8m

read-receipts/editing-messages-main-timeline.spec.ts took 1.2m

read-receipts/editing-messages-in-threads.spec.ts took 1.1m

read-receipts/editing-messages-thread-roots.spec.ts took 55.5s

read-receipts/redactions-thread-roots.spec.ts took 1.2m

spaces/spaces.spec.ts took 1.1m

right-panel/right-panel.spec.ts took 57.5s

settings/account-user-settings-tab.spec.ts took 46.4s

right-panel/file-panel.spec.ts took 40.5s

timeline/timeline.spec.ts took 2.9m

spotlight/spotlight.spec.ts took 2.3m

threads/threads.spec.ts took 36.7s

user-onboarding/user-onboarding-new.spec.ts took 35.9s

widgets/widget-pip-close.spec.ts took 23.4s

read-receipts/redactions-main-timeline.spec.ts took 2.1m

read-receipts/new-messages-main-timeline.spec.ts took 1.4m

read-receipts/read-receipts.spec.ts took 1.2m

read-receipts/reactions-in-threads.spec.ts took 1.0m

read-receipts/new-messages-thread-roots.spec.ts took 45.7s

messages/messages.spec.ts took 2.3m

pinned-messages/pinned-messages.spec.ts took 1.7m

login/login.spec.ts took 1.1m

knock/knock-into-room.spec.ts took 39.6s

integration-manager/read_events.spec.ts took 36.6s

composer/RTE.spec.ts took 1.3m

audio-player/audio-player.spec.ts took 1.3m

crypto/event-shields.spec.ts took 1.2m

crypto/crypto.spec.ts took 1.1m

crypto/decryption-failure-messages.spec.ts took 56.1s

1 flaky polls/polls.spec.ts:96:9 › Polls › should be creatable and votable ───────────────────────────── 32 skipped 45 passed (9.5m)

1 flaky room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory 10 skipped 70 passed (10.2m)

1 flaky spaces/threads-activity-centre/threadsActivityCentre.spec.ts:141:9 › Threads Activity Centre › should mark all threads as read 3 skipped 68 passed (10.6m)

1 flaky read-receipts/redactions-in-threads.spec.ts:410:17 › Read receipts › redactions › in threads › A thread with a redacted unread is still read after restart 14 skipped 61 passed (10.7m)

1 flaky oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account ──── 1 skipped 73 passed (11.9m)