test(Operation/Jobs): add screenshot tests [YTFRONT-3772] #2401
ci-e2e.yaml
on: pull_request
Annotations
12 errors, 7 warnings, and 3 notices
[chromium] › pages/system.spec.ts:4:5 › System: check short name:
packages/ui/tests/e2e/pages/system.spec.ts#L18
1) [chromium] › pages/system.spec.ts:4:5 › System: check short name ──────────────────────────────
TypeError: Cannot read properties of undefined (reading 'innerText')
16 |
17 | const mastersNameElements = await page.$$('.master-group__host-name');
> 18 | const firstMasterName = await mastersNameElements[0].innerText();
| ^
19 | expect(firstMasterName).toEqual('local');
20 | });
21 |
at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/e2e/pages/system.spec.ts:18:58
|
[chromium] › pages/system.spec.ts:4:5 › System: check short name:
packages/ui/tests/e2e/pages/system.spec.ts#L18
1) [chromium] › pages/system.spec.ts:4:5 › System: check short name ──────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
TypeError: Cannot read properties of undefined (reading 'innerText')
16 |
17 | const mastersNameElements = await page.$$('.master-group__host-name');
> 18 | const firstMasterName = await mastersNameElements[0].innerText();
| ^
19 | expect(firstMasterName).toEqual('local');
20 | });
21 |
at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/e2e/pages/system.spec.ts:18:58
|
[chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details:
packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts#L1
1) [chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details › Details ──────────────
Test timeout of 30000ms exceeded.
|
[chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details:
packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts#L21
1) [chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details › Details ──────────────
Error: page.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('.operation-detail-jobs__id-job-link')
19 |
20 | await test.step('Details', async () => {
> 21 | await page.click('.operation-detail-jobs__id-job-link');
| ^
22 |
23 | replaceInnerHtml(page, {
24 | '.operation-detail__events-progress-percentage': 'X.X1X%',
at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts:21:20
at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts:20:16
|
[chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details:
packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts#L1
1) [chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details › Details ──────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
[chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details:
packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts#L21
1) [chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details › Details ──────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: page.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('.operation-detail-jobs__id-job-link')
19 |
20 | await test.step('Details', async () => {
> 21 | await page.click('.operation-detail-jobs__id-job-link');
| ^
22 |
23 | replaceInnerHtml(page, {
24 | '.operation-detail__events-progress-percentage': 'X.X1X%',
at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts:21:20
at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts:20:16
|
[chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details:
packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts#L1
1) [chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details › Details ──────────────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
[chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details:
packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts#L21
1) [chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details › Details ──────────────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: page.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('.operation-detail-jobs__id-job-link')
19 |
20 | await test.step('Details', async () => {
> 21 | await page.click('.operation-detail-jobs__id-job-link');
| ^
22 |
23 | replaceInnerHtml(page, {
24 | '.operation-detail__events-progress-percentage': 'X.X1X%',
at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts:21:20
at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/jobs.base.screen.ts:20:16
|
[chromium] › pages/operations/operations.base.screen.ts:70:5 › Operations - List:
packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts#L76
2) [chromium] › pages/operations/operations.base.screen.ts:70:5 › Operations - List ──────────────
Error: Screenshot comparison failed:
474 pixels (ratio 0.01 of all image pixels) are different.
Expected: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts-snapshots/Operations---List-1-chromium-linux.png
Received: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/test-results/pages-operations-operations.base.screen.ts-Operations---List-chromium/Operations---List-1-actual.png
Diff: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/test-results/pages-operations-operations.base.screen.ts-Operations---List-chromium/Operations---List-1-diff.png
Call log:
- expect.toHaveScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 474 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 474 pixels (ratio 0.01 of all image pixels) are different.
74 | await operationsPage(page).replaceListTimes();
75 |
> 76 | await expect(page).toHaveScreenshot();
| ^
77 | });
78 |
79 | test('Operation - Details', async ({page}) => {
at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts:76:24
|
[chromium] › pages/operations/operations.base.screen.ts:70:5 › Operations - List:
packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts#L76
2) [chromium] › pages/operations/operations.base.screen.ts:70:5 › Operations - List ──────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
474 pixels (ratio 0.01 of all image pixels) are different.
Expected: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts-snapshots/Operations---List-1-chromium-linux.png
Received: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/test-results/pages-operations-operations.base.screen.ts-Operations---List-chromium-retry1/Operations---List-1-actual.png
Diff: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/test-results/pages-operations-operations.base.screen.ts-Operations---List-chromium-retry1/Operations---List-1-diff.png
Call log:
- expect.toHaveScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 474 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 474 pixels (ratio 0.01 of all image pixels) are different.
74 | await operationsPage(page).replaceListTimes();
75 |
> 76 | await expect(page).toHaveScreenshot();
| ^
77 | });
78 |
79 | test('Operation - Details', async ({page}) => {
at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts:76:24
|
[chromium] › pages/operations/operations.base.screen.ts:70:5 › Operations - List:
packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts#L76
2) [chromium] › pages/operations/operations.base.screen.ts:70:5 › Operations - List ──────────────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
474 pixels (ratio 0.01 of all image pixels) are different.
Expected: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts-snapshots/Operations---List-1-chromium-linux.png
Received: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/test-results/pages-operations-operations.base.screen.ts-Operations---List-chromium-retry2/Operations---List-1-actual.png
Diff: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/test-results/pages-operations-operations.base.screen.ts-Operations---List-chromium-retry2/Operations---List-1-diff.png
Call log:
- expect.toHaveScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 474 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 474 pixels (ratio 0.01 of all image pixels) are different.
74 | await operationsPage(page).replaceListTimes();
75 |
> 76 | await expect(page).toHaveScreenshot();
| ^
77 | });
78 |
79 | test('Operation - Details', async ({page}) => {
at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts:76:24
|
[chromium] › pages/operations/operations.base.screen.ts:98:5 › Operation - Jobs:
packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts#L104
3) [chromium] › pages/operations/operations.base.screen.ts:98:5 › Operation - Jobs ───────────────
Error: Screenshot comparison failed:
333 pixels (ratio 0.01 of all image pixels) are different.
Expected: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts-snapshots/Operation---Jobs-1-chromium-linux.png
Received: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/test-results/pages-operations-operations.base.screen.ts-Operation---Jobs-chromium/Operation---Jobs-1-actual.png
Diff: /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/test-results/pages-operations-operations.base.screen.ts-Operation---Jobs-chromium/Operation---Jobs-1-diff.png
Call log:
- expect.toHaveScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 333 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 333 pixels (ratio 0.01 of all image pixels) are different.
102 | await operationsPage(page).replaceJobsData();
103 |
> 104 | await expect(page).toHaveScreenshot();
| ^
105 | });
106 |
at /actions-runner/_work/ytsaurus-ui/ytsaurus-ui/packages/ui/tests/screenshots/pages/operations/operations.base.screen.ts:104:24
|
Start VM
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Build docker image
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
|
Build docker image
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
Slow Test:
packages/ui/tests/[chromium] › pages/navigation.base.spec.ts#L1
packages/ui/tests/[chromium] › pages/navigation.base.spec.ts took 23.7s
|
Slow Test:
packages/ui/tests/[chromium] › pages/navigation.base.spec.ts#L1
packages/ui/tests/[chromium] › pages/navigation.base.spec.ts took 24.7s
|
Slow Test:
packages/ui/tests/[chromium] › pages/navigation/navigation.table.base.screen.ts#L1
packages/ui/tests/[chromium] › pages/navigation/navigation.table.base.screen.ts took 17.0s
|
Stop VM
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
🎭 Playwright Run Summary
50 passed (1.9m)
|
🎭 Playwright Run Summary
1 flaky
[chromium] › pages/system.spec.ts:4:5 › System: check short name ───────────────────────────────
49 passed (2.0m)
|
🎭 Playwright Run Summary
3 failed
[chromium] › pages/operations/jobs.base.screen.ts:15:5 › Job - Details ─────────────────────────
[chromium] › pages/operations/operations.base.screen.ts:70:5 › Operations - List ───────────────
[chromium] › pages/operations/operations.base.screen.ts:98:5 › Operation - Jobs ────────────────
36 passed (3.5m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
screenshots_test-results
Expired
|
2.47 MB |
|