Skip to content

Dev: Fix flaky and broken E2E tests #1704

Dev: Fix flaky and broken E2E tests

Dev: Fix flaky and broken E2E tests #1704

Triggered via pull request July 29, 2024 20:57
Status Success
Total duration 5m 30s
Artifacts 1

e2e-pw-pull-request.yml

on: pull_request
Fit to window
Zoom out
Zoom in

Annotations

2 errors, 3 warnings, and 1 notice
[shopper] › shopper/shopper-checkout-purchase.spec.ts:24:6 › Successful purchase › using a basic card: tests/e2e-pw/specs/shopper/shopper-checkout-purchase.spec.ts#L30
1) [shopper] › shopper/shopper-checkout-purchase.spec.ts:24:6 › Successful purchase › using a basic card Error: Timed out 10000ms waiting for expect(locator).toBeVisible() Locator: getByText('Order received').first() Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 10000ms - waiting for getByText('Order received').first() 28 | await expect( 29 | page.getByText( 'Order received' ).first() > 30 | ).toBeVisible(); | ^ 31 | } ); 32 | 33 | test( 'using a 3DS card', async ( { page } ) => { at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/shopper/shopper-checkout-purchase.spec.ts:30:5
[shopper] › shopper/shopper-checkout-purchase.spec.ts:33:6 › Successful purchase › using a 3DS card: tests/e2e-pw/specs/shopper/shopper-checkout-purchase.spec.ts#L40
2) [shopper] › shopper/shopper-checkout-purchase.spec.ts:33:6 › Successful purchase › using a 3DS card Error: Timed out 10000ms waiting for expect(locator).toBeVisible() Locator: getByText('Order received').first() Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 10000ms - waiting for getByText('Order received').first() 38 | await expect( 39 | page.getByText( 'Order received' ).first() > 40 | ).toBeVisible(); | ^ 41 | } ); 42 | } ); 43 | at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/shopper/shopper-checkout-purchase.spec.ts:40:5
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "playwright-report". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
Slow Test: [merchant] › merchant/merchant-disputes-view-details-via-order-notice.spec.ts#L1
[merchant] › merchant/merchant-disputes-view-details-via-order-notice.spec.ts took 17.3s
WC - latest
The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
🎭 Playwright Run Summary
2 flaky [shopper] › shopper/shopper-checkout-purchase.spec.ts:24:6 › Successful purchase › using a basic card [shopper] › shopper/shopper-checkout-purchase.spec.ts:33:6 › Successful purchase › using a 3DS card 1 skipped 8 passed (1.6m)

Artifacts

Produced during runtime
Name Size
playwright-report Expired
10.8 MB