Report test webhook errors in the live environment as warnings #2478
nbloomfAnnotations
20 errors, 10 warnings, and 2 notices
|
[default] › checkout/shortcode/subscription-product.spec.js:32:5 › customer can purchase a subscription product @smoke @subscriptions:
tests/e2e/tests/checkout/shortcode/subscription-product.spec.js#L1
1) [default] › checkout/shortcode/subscription-product.spec.js:32:5 › customer can purchase a subscription product @smoke @subscriptions
Test timeout of 90000ms exceeded.
|
|
[default] › checkout/shortcode/subscription-product.spec.js:32:5 › customer can purchase a subscription product @smoke @subscriptions:
tests/e2e/tests/checkout/shortcode/subscription-product.spec.js#L49
1) [default] › checkout/shortcode/subscription-product.spec.js:32:5 › customer can purchase a subscription product @smoke @subscriptions
Error: page.waitForNavigation: Test timeout of 90000ms exceeded.
=========================== logs ===========================
waiting for navigation until "load"
============================================================
47 |
48 | await page.locator( 'text=Sign up now' ).click();
> 49 | await page.waitForNavigation();
| ^
50 |
51 | await expect( page.locator( 'h1.entry-title' ) ).toHaveText(
52 | 'Order received'
at /home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/tests/checkout/shortcode/subscription-product.spec.js:49:13
|
|
[default] › checkout/shortcode/subscription-product.spec.js:32:5 › customer can purchase a subscription product @smoke @subscriptions:
tests/e2e/tests/checkout/shortcode/subscription-product.spec.js#L1
1) [default] › checkout/shortcode/subscription-product.spec.js:32:5 › customer can purchase a subscription product @smoke @subscriptions
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 90000ms exceeded.
|
|
[default] › checkout/shortcode/subscription-product.spec.js:32:5 › customer can purchase a subscription product @smoke @subscriptions:
tests/e2e/tests/checkout/shortcode/subscription-product.spec.js#L49
1) [default] › checkout/shortcode/subscription-product.spec.js:32:5 › customer can purchase a subscription product @smoke @subscriptions
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: page.waitForNavigation: Test timeout of 90000ms exceeded.
=========================== logs ===========================
waiting for navigation until "load"
============================================================
47 |
48 | await page.locator( 'text=Sign up now' ).click();
> 49 | await page.waitForNavigation();
| ^
50 |
51 | await expect( page.locator( 'h1.entry-title' ) ).toHaveText(
52 | 'Order received'
at /home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/tests/checkout/shortcode/subscription-product.spec.js:49:13
|
|
[default] › checkout/shortcode/subscription-product.spec.js:32:5 › customer can purchase a subscription product @smoke @subscriptions:
tests/e2e/tests/checkout/shortcode/subscription-product.spec.js#L1
1) [default] › checkout/shortcode/subscription-product.spec.js:32:5 › customer can purchase a subscription product @smoke @subscriptions
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 90000ms exceeded.
|
|
[default] › checkout/shortcode/subscription-product.spec.js:32:5 › customer can purchase a subscription product @smoke @subscriptions:
tests/e2e/tests/checkout/shortcode/subscription-product.spec.js#L49
1) [default] › checkout/shortcode/subscription-product.spec.js:32:5 › customer can purchase a subscription product @smoke @subscriptions
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: page.waitForNavigation: Test timeout of 90000ms exceeded.
=========================== logs ===========================
waiting for navigation until "load"
============================================================
47 |
48 | await page.locator( 'text=Sign up now' ).click();
> 49 | await page.waitForNavigation();
| ^
50 |
51 | await expect( page.locator( 'h1.entry-title' ) ).toHaveText(
52 | 'Order received'
at /home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/tests/checkout/shortcode/subscription-product.spec.js:49:13
|
|
[default] › checkout/shortcode/subscription-product.spec.js:32:5 › customer can purchase a subscription product @smoke @subscriptions:
tests/e2e/tests/checkout/shortcode/subscription-product.spec.js#L1
1) [default] › checkout/shortcode/subscription-product.spec.js:32:5 › customer can purchase a subscription product @smoke @subscriptions
Retry #3 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 90000ms exceeded.
|
|
[default] › checkout/shortcode/subscription-product.spec.js:32:5 › customer can purchase a subscription product @smoke @subscriptions:
tests/e2e/tests/checkout/shortcode/subscription-product.spec.js#L49
1) [default] › checkout/shortcode/subscription-product.spec.js:32:5 › customer can purchase a subscription product @smoke @subscriptions
Retry #3 ───────────────────────────────────────────────────────────────────────────────────────
Error: page.waitForNavigation: Test timeout of 90000ms exceeded.
=========================== logs ===========================
waiting for navigation until "load"
============================================================
47 |
48 | await page.locator( 'text=Sign up now' ).click();
> 49 | await page.waitForNavigation();
| ^
50 |
51 | await expect( page.locator( 'h1.entry-title' ) ).toHaveText(
52 | 'Order received'
at /home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/tests/checkout/shortcode/subscription-product.spec.js:49:13
|
|
[default] › orders/full-refund.spec.js:13:5 › merchant can issue a full refund @smoke:
tests/e2e/tests/orders/full-refund.spec.js#L1
2) [default] › orders/full-refund.spec.js:13:5 › merchant can issue a full refund @smoke › customer checkout with Stripe
Test timeout of 90000ms exceeded.
|
|
[default] › orders/full-refund.spec.js:13:5 › merchant can issue a full refund @smoke:
tests/e2e/tests/orders/full-refund.spec.js#L37
2) [default] › orders/full-refund.spec.js:13:5 › merchant can issue a full refund @smoke › customer checkout with Stripe
Error: page.waitForURL: Test ended.
=========================== logs ===========================
waiting for navigation to "**/checkout/order-received/**" until "load"
============================================================
35 | );
36 | await userPage.locator( 'text=Place order' ).click();
> 37 | await userPage.waitForURL( '**/checkout/order-received/**' );
| ^
38 |
39 | await expect( userPage.locator( 'h1.entry-title' ) ).toHaveText(
40 | 'Order received'
at /home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/tests/orders/full-refund.spec.js:37:18
at /home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/tests/orders/full-refund.spec.js:24:2
|
|
[legacy] › _legacy-experience/checkout/card-failures.spec.js:49:6 › customer cannot checkout with invalid cards › a declined card shows the correct error message @smoke:
tests/e2e/tests/_legacy-experience/checkout/card-failures.spec.js#L1
1) [legacy] › _legacy-experience/checkout/card-failures.spec.js:49:6 › customer cannot checkout with invalid cards › a declined card shows the correct error message @smoke
Test timeout of 90000ms exceeded.
|
|
[legacy] › _legacy-experience/checkout/card-failures.spec.js:49:6 › customer cannot checkout with invalid cards › a declined card shows the correct error message @smoke:
tests/e2e/utils/payments.js#L155
1) [legacy] › _legacy-experience/checkout/card-failures.spec.js:49:6 › customer cannot checkout with invalid cards › a declined card shows the correct error message @smoke
Error: locator.fill: Test timeout of 90000ms exceeded.
Call log:
- waiting for frameLocator('#stripe-card-element iframe[name^="__privateStripeFrame"]').locator('[name="cardnumber"]')
at ../utils/payments.js:155
153 | )
154 | .locator( '[name="cardnumber"]' )
> 155 | .fill( card.number );
| ^
156 | await page
157 | .frameLocator(
158 | '#stripe-exp-element iframe[name^="__privateStripeFrame"]'
at fillCreditCardDetailsShortcodeLegacy (/home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/utils/payments.js:155:4)
at testCard (/home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/tests/_legacy-experience/checkout/card-failures.spec.js:24:8)
at /home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/tests/_legacy-experience/checkout/card-failures.spec.js:51:9
|
|
[legacy] › _legacy-experience/checkout/card-failures.spec.js:49:6 › customer cannot checkout with invalid cards › a declined card shows the correct error message @smoke:
tests/e2e/tests/_legacy-experience/checkout/card-failures.spec.js#L1
1) [legacy] › _legacy-experience/checkout/card-failures.spec.js:49:6 › customer cannot checkout with invalid cards › a declined card shows the correct error message @smoke
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 90000ms exceeded.
|
|
[legacy] › _legacy-experience/checkout/card-failures.spec.js:49:6 › customer cannot checkout with invalid cards › a declined card shows the correct error message @smoke:
tests/e2e/utils/payments.js#L155
1) [legacy] › _legacy-experience/checkout/card-failures.spec.js:49:6 › customer cannot checkout with invalid cards › a declined card shows the correct error message @smoke
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.fill: Test timeout of 90000ms exceeded.
Call log:
- waiting for frameLocator('#stripe-card-element iframe[name^="__privateStripeFrame"]').locator('[name="cardnumber"]')
at ../utils/payments.js:155
153 | )
154 | .locator( '[name="cardnumber"]' )
> 155 | .fill( card.number );
| ^
156 | await page
157 | .frameLocator(
158 | '#stripe-exp-element iframe[name^="__privateStripeFrame"]'
at fillCreditCardDetailsShortcodeLegacy (/home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/utils/payments.js:155:4)
at testCard (/home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/tests/_legacy-experience/checkout/card-failures.spec.js:24:8)
at /home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/tests/_legacy-experience/checkout/card-failures.spec.js:51:9
|
|
[legacy] › _legacy-experience/checkout/card-failures.spec.js:49:6 › customer cannot checkout with invalid cards › a declined card shows the correct error message @smoke:
tests/e2e/tests/_legacy-experience/checkout/card-failures.spec.js#L1
1) [legacy] › _legacy-experience/checkout/card-failures.spec.js:49:6 › customer cannot checkout with invalid cards › a declined card shows the correct error message @smoke
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 90000ms exceeded.
|
|
[legacy] › _legacy-experience/checkout/card-failures.spec.js:49:6 › customer cannot checkout with invalid cards › a declined card shows the correct error message @smoke:
tests/e2e/utils/payments.js#L155
1) [legacy] › _legacy-experience/checkout/card-failures.spec.js:49:6 › customer cannot checkout with invalid cards › a declined card shows the correct error message @smoke
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.fill: Test timeout of 90000ms exceeded.
Call log:
- waiting for frameLocator('#stripe-card-element iframe[name^="__privateStripeFrame"]').locator('[name="cardnumber"]')
at ../utils/payments.js:155
153 | )
154 | .locator( '[name="cardnumber"]' )
> 155 | .fill( card.number );
| ^
156 | await page
157 | .frameLocator(
158 | '#stripe-exp-element iframe[name^="__privateStripeFrame"]'
at fillCreditCardDetailsShortcodeLegacy (/home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/utils/payments.js:155:4)
at testCard (/home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/tests/_legacy-experience/checkout/card-failures.spec.js:24:8)
at /home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/tests/_legacy-experience/checkout/card-failures.spec.js:51:9
|
|
[legacy] › _legacy-experience/checkout/card-failures.spec.js:49:6 › customer cannot checkout with invalid cards › a declined card shows the correct error message @smoke:
tests/e2e/tests/_legacy-experience/checkout/card-failures.spec.js#L1
1) [legacy] › _legacy-experience/checkout/card-failures.spec.js:49:6 › customer cannot checkout with invalid cards › a declined card shows the correct error message @smoke
Retry #3 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 90000ms exceeded.
|
|
[legacy] › _legacy-experience/checkout/card-failures.spec.js:49:6 › customer cannot checkout with invalid cards › a declined card shows the correct error message @smoke:
tests/e2e/utils/payments.js#L155
1) [legacy] › _legacy-experience/checkout/card-failures.spec.js:49:6 › customer cannot checkout with invalid cards › a declined card shows the correct error message @smoke
Retry #3 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.fill: Test timeout of 90000ms exceeded.
Call log:
- waiting for frameLocator('#stripe-card-element iframe[name^="__privateStripeFrame"]').locator('[name="cardnumber"]')
at ../utils/payments.js:155
153 | )
154 | .locator( '[name="cardnumber"]' )
> 155 | .fill( card.number );
| ^
156 | await page
157 | .frameLocator(
158 | '#stripe-exp-element iframe[name^="__privateStripeFrame"]'
at fillCreditCardDetailsShortcodeLegacy (/home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/utils/payments.js:155:4)
at testCard (/home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/tests/_legacy-experience/checkout/card-failures.spec.js:24:8)
at /home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/tests/_legacy-experience/checkout/card-failures.spec.js:51:9
|
|
[legacy] › _legacy-experience/checkout/card-failures.spec.js:53:6 › customer cannot checkout with invalid cards › a card with insufficient funds shows the correct error message:
tests/e2e/tests/_legacy-experience/checkout/card-failures.spec.js#L1
2) [legacy] › _legacy-experience/checkout/card-failures.spec.js:53:6 › customer cannot checkout with invalid cards › a card with insufficient funds shows the correct error message
Test timeout of 90000ms exceeded.
|
|
[legacy] › _legacy-experience/checkout/card-failures.spec.js:53:6 › customer cannot checkout with invalid cards › a card with insufficient funds shows the correct error message:
tests/e2e/utils/payments.js#L155
2) [legacy] › _legacy-experience/checkout/card-failures.spec.js:53:6 › customer cannot checkout with invalid cards › a card with insufficient funds shows the correct error message
Error: locator.fill: Test timeout of 90000ms exceeded.
Call log:
- waiting for frameLocator('#stripe-card-element iframe[name^="__privateStripeFrame"]').locator('[name="cardnumber"]')
at ../utils/payments.js:155
153 | )
154 | .locator( '[name="cardnumber"]' )
> 155 | .fill( card.number );
| ^
156 | await page
157 | .frameLocator(
158 | '#stripe-exp-element iframe[name^="__privateStripeFrame"]'
at fillCreditCardDetailsShortcodeLegacy (/home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/utils/payments.js:155:4)
at testCard (/home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/tests/_legacy-experience/checkout/card-failures.spec.js:24:8)
at /home/runner/work/woocommerce-gateway-stripe/woocommerce-gateway-stripe/tests/e2e/tests/_legacy-experience/checkout/card-failures.spec.js:55:9
|
|
Default WP=latest, WC=latest, PHP=7.4
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Slow Test:
[default] › checkout/blocks/saved-card.spec.js#L1
[default] › checkout/blocks/saved-card.spec.js took 54.7s
|
|
Slow Test:
[default] › checkout/blocks/sca-card.spec.js#L1
[default] › checkout/blocks/sca-card.spec.js took 47.3s
|
|
Slow Test:
[default] › checkout/blocks/subscription-product.spec.js#L1
[default] › checkout/blocks/subscription-product.spec.js took 41.2s
|
|
Slow Test:
[default] › checkout/blocks/normal-card.spec.js#L1
[default] › checkout/blocks/normal-card.spec.js took 33.3s
|
|
Slow Test:
[default] › checkout/shortcode/saved-card.spec.js#L1
[default] › checkout/shortcode/saved-card.spec.js took 25.9s
|
|
Legacy WP=latest, WC=latest, PHP=7.4
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
Slow Test:
[legacy] › _legacy-experience/woocommerce-blocks/saved-card.spec.js#L1
[legacy] › _legacy-experience/woocommerce-blocks/saved-card.spec.js took 25.1s
|
|
Slow Test:
[legacy] › _legacy-experience/woocommerce-blocks/subscription-product.spec.js#L1
[legacy] › _legacy-experience/woocommerce-blocks/subscription-product.spec.js took 16.0s
|
|
Slow Test:
[legacy] › _legacy-experience/woocommerce-blocks/normal-card.spec.js#L1
[legacy] › _legacy-experience/woocommerce-blocks/normal-card.spec.js took 15.6s
|
|
🎭 Playwright Run Summary
2 failed
[default] › checkout/shortcode/subscription-product.spec.js:32:5 › customer can purchase a subscription product @smoke @subscriptions
[default] › orders/full-refund.spec.js:13:5 › merchant can issue a full refund @smoke ──────────
4 flaky
[default] › checkout/shortcode/card-failures.spec.js:38:6 › customer cannot checkout with invalid cards › a card with insufficient funds shows the correct error message
[default] › checkout/shortcode/card-failures.spec.js:42:6 › customer cannot checkout with invalid cards › a card with invalid number shows the correct error message
[default] › checkout/shortcode/card-failures.spec.js:54:6 › customer cannot checkout with invalid cards › an error processing the card shows the correct error message
[default] › checkout/shortcode/sca-card.spec.js:12:5 › customer can checkout with a SCA card @smoke
17 passed (9.3m)
|
|
🎭 Playwright Run Summary
13 failed
[legacy] › _legacy-experience/checkout/card-failures.spec.js:49:6 › customer cannot checkout with invalid cards › a declined card shows the correct error message @smoke
[legacy] › _legacy-experience/checkout/card-failures.spec.js:53:6 › customer cannot checkout with invalid cards › a card with insufficient funds shows the correct error message
[legacy] › _legacy-experience/checkout/card-failures.spec.js:57:6 › customer cannot checkout with invalid cards › a card with invalid number shows the correct error message
[legacy] › _legacy-experience/checkout/card-failures.spec.js:61:6 › customer cannot checkout with invalid cards › an expired card shows the correct error message
[legacy] › _legacy-experience/checkout/card-failures.spec.js:65:6 › customer cannot checkout with invalid cards › a card with incorrect CVC shows the correct error message @smoke
[legacy] › _legacy-experience/checkout/card-failures.spec.js:69:6 › customer cannot checkout with invalid cards › an error processing the card shows the correct error message
[legacy] › _legacy-experience/checkout/normal-card.spec.js:12:5 › customer can checkout with a normal credit card @smoke
[legacy] › _legacy-experience/checkout/saved-card.spec.js:30:5 › customer can checkout with a saved card @smoke
[legacy] › _legacy-experience/checkout/sca-card.spec.js:12:5 › customer can checkout with a SCA card @smoke
[legacy] › _legacy-experience/checkout/subscription-product.spec.js:35:5 › customer can purchase a subscription product @smoke @subscriptions
[legacy] › _legacy-experience/order/full-refund.spec.js:13:5 › merchant can issue a full refund @smoke
[legacy] › _legacy-experience/subscriptions/subscription-renewal.spec.js:50:5 › customer can renew a subscription @smoke @subscriptions
[legacy] › _legacy-experience/woocommerce-blocks/sca-card.spec.js:12:5 › customer can checkout with a SCA card @smoke @blocks
10 passed (19.8m)
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
Default-WP_latest-WC_latest-results
Expired
|
187 MB |
|
|
Legacy-WP_latest-WC_latest-results
Expired
|
474 MB |
|