Skip to content

test(Operation/Jobs): add screenshot tests [YTFRONT-3772] #2401

test(Operation/Jobs): add screenshot tests [YTFRONT-3772]

test(Operation/Jobs): add screenshot tests [YTFRONT-3772] #2401

Triggered via pull request December 22, 2024 22:47
Status Failure
Total duration 21m 31s
Artifacts 1

ci-e2e.yaml

on: pull_request
Build docker image
5m 18s
Build docker image
Install run_local_cluster.sh
4s
Install run_local_cluster.sh
E2E for 'Local'
4m 5s
E2E for 'Local'
E2E for 'Local as remote'
3m 14s
E2E for 'Local as remote'
E2E-screenshots for 'Local'
4m 47s
E2E-screenshots for 'Local'
Fit to window
Zoom out
Zoom in

Annotations

12 errors, 7 warnings, and 3 notices
[chromium] › pages/system.spec.ts:4:5 › System: check short name: packages/ui/tests/e2e/pages/system.spec.ts#L18
1) [chromium] › pages/system.spec.ts:4:5 › System: check short name ────────────────────────────── TypeError: Cannot read properties of undefined (reading 'innerText') 16 | 17 | const mastersNameElements = await page.$$('.master-group__host-name'); > 18 | const firstMasterName = await mastersNameElements[0].innerText(); | ^ 19 | expect(firstMasterName).toEqual('local'); 20 | }); 21 | at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/e2e/pages/system.spec.ts:18:58
[chromium] › pages/system.spec.ts:4:5 › System: check short name: packages/ui/tests/e2e/pages/system.spec.ts#L18
1) [chromium] › pages/system.spec.ts:4:5 › System: check short name ────────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── TypeError: Cannot read properties of undefined (reading 'innerText') 16 | 17 | const mastersNameElements = await page.$$('.master-group__host-name'); > 18 | const firstMasterName = await mastersNameElements[0].innerText(); | ^ 19 | expect(firstMasterName).toEqual('local'); 20 | }); 21 | at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/e2e/pages/system.spec.ts:18:58
[chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details: packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts#L1
1) [chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details › Details ────────────── Test timeout of 30000ms exceeded.
[chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details: packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts#L21
1) [chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details › Details ────────────── Error: page.click: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.operation-detail-jobs__id-job-link') 19 | 20 | await test.step('Details', async () => { > 21 | await page.click('.operation-detail-jobs__id-job-link'); | ^ 22 | 23 | replaceInnerHtml(page, { 24 | '.operation-detail__events-progress-percentage': 'X.X1X%', at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts:21:20 at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts:20:16
[chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details: packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts#L1
1) [chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details › Details ────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details: packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts#L21
1) [chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details › Details ────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: page.click: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.operation-detail-jobs__id-job-link') 19 | 20 | await test.step('Details', async () => { > 21 | await page.click('.operation-detail-jobs__id-job-link'); | ^ 22 | 23 | replaceInnerHtml(page, { 24 | '.operation-detail__events-progress-percentage': 'X.X1X%', at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts:21:20 at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts:20:16
[chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details: packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts#L1
1) [chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details › Details ────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details: packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts#L21
1) [chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details › Details ────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: page.click: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.operation-detail-jobs__id-job-link') 19 | 20 | await test.step('Details', async () => { > 21 | await page.click('.operation-detail-jobs__id-job-link'); | ^ 22 | 23 | replaceInnerHtml(page, { 24 | '.operation-detail__events-progress-percentage': 'X.X1X%', at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts:21:20 at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts:20:16
[chromium] › pages/operations/operations.base.screen.ts:70:5 › Operations - List: packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts#L76
2) [chromium] › pages/operations/operations.base.screen.ts:70:5 › Operations - List ────────────── Error: Screenshot comparison failed: 474 pixels (ratio 0.01 of all image pixels) are different. Expected: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts-snapshots/Operations---List-1-chromium-linux.png Received: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/test-results/pages-operations-operations.base.screen.ts-Operations---List-chromium/Operations---List-1-actual.png Diff: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/test-results/pages-operations-operations.base.screen.ts-Operations---List-chromium/Operations---List-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 474 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 474 pixels (ratio 0.01 of all image pixels) are different. 74 | await operationsPage(page).replaceListTimes(); 75 | > 76 | await expect(page).toHaveScreenshot(); | ^ 77 | }); 78 | 79 | test('Operation - Details', async ({page}) => { at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts:76:24
[chromium] › pages/operations/operations.base.screen.ts:70:5 › Operations - List: packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts#L76
2) [chromium] › pages/operations/operations.base.screen.ts:70:5 › Operations - List ────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 474 pixels (ratio 0.01 of all image pixels) are different. Expected: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts-snapshots/Operations---List-1-chromium-linux.png Received: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/test-results/pages-operations-operations.base.screen.ts-Operations---List-chromium-retry1/Operations---List-1-actual.png Diff: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/test-results/pages-operations-operations.base.screen.ts-Operations---List-chromium-retry1/Operations---List-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 474 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 474 pixels (ratio 0.01 of all image pixels) are different. 74 | await operationsPage(page).replaceListTimes(); 75 | > 76 | await expect(page).toHaveScreenshot(); | ^ 77 | }); 78 | 79 | test('Operation - Details', async ({page}) => { at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts:76:24
[chromium] › pages/operations/operations.base.screen.ts:70:5 › Operations - List: packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts#L76
2) [chromium] › pages/operations/operations.base.screen.ts:70:5 › Operations - List ────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 474 pixels (ratio 0.01 of all image pixels) are different. Expected: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts-snapshots/Operations---List-1-chromium-linux.png Received: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/test-results/pages-operations-operations.base.screen.ts-Operations---List-chromium-retry2/Operations---List-1-actual.png Diff: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/test-results/pages-operations-operations.base.screen.ts-Operations---List-chromium-retry2/Operations---List-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 474 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 474 pixels (ratio 0.01 of all image pixels) are different. 74 | await operationsPage(page).replaceListTimes(); 75 | > 76 | await expect(page).toHaveScreenshot(); | ^ 77 | }); 78 | 79 | test('Operation - Details', async ({page}) => { at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts:76:24
[chromium] › pages/operations/operations.base.screen.ts:98:5 › Operation - Jobs: packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts#L104
3) [chromium] › pages/operations/operations.base.screen.ts:98:5 › Operation - Jobs ─────────────── Error: Screenshot comparison failed: 333 pixels (ratio 0.01 of all image pixels) are different. Expected: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts-snapshots/Operation---Jobs-1-chromium-linux.png Received: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/test-results/pages-operations-operations.base.screen.ts-Operation---Jobs-chromium/Operation---Jobs-1-actual.png Diff: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/test-results/pages-operations-operations.base.screen.ts-Operation---Jobs-chromium/Operation---Jobs-1-diff.png Call log: - expect.toHaveScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 333 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 333 pixels (ratio 0.01 of all image pixels) are different. 102 | await operationsPage(page).replaceJobsData(); 103 | > 104 | await expect(page).toHaveScreenshot(); | ^ 105 | }); 106 | at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts:104:24
Start VM
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build docker image
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Build docker image
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Slow Test: packages/ui/tests/[chromium] › pages/navigation.base.spec.ts#L1
packages/ui/tests/[chromium] › pages/navigation.base.spec.ts took 23.7s
Slow Test: packages/ui/tests/[chromium] › pages/navigation.base.spec.ts#L1
packages/ui/tests/[chromium] › pages/navigation.base.spec.ts took 24.7s
Slow Test: packages/ui/tests/[chromium] › pages/navigation/navigation.table.base.screen.ts#L1
packages/ui/tests/[chromium] › pages/navigation/navigation.table.base.screen.ts took 17.0s
Stop VM
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
🎭 Playwright Run Summary
50 passed (1.9m)
🎭 Playwright Run Summary
1 flaky [chromium] › pages/system.spec.ts:4:5 › System: check short name ─────────────────────────────── 49 passed (2.0m)
🎭 Playwright Run Summary
3 failed [chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details ───────────────────────── [chromium] › pages/operations/operations.base.screen.ts:70:5 › Operations - List ─────────────── [chromium] › pages/operations/operations.base.screen.ts:98:5 › Operation - Jobs ──────────────── 36 passed (3.5m)

Artifacts

Produced during runtime
Name Size
screenshots_test-results Expired
2.47 MB