1.9.1 (2024-12-27)
- Only warn on coverage errors (7ff08c4)
1.9.0 (2024-12-16)
1.9.0-beta.0 (2024-12-06)
- Output discovery errors in orchestration (52cc209)
- Add a git info fixture that can be used in rules matching (c186f54)
- Standardize rules annotations (a6c93de)
- Rename Rules to Actions (#298) (a5778ba)
1.8.0 (2024-11-25)
- collect coverage when coverage.projects is an empty array (c7066c2)
1.7.1 (2024-11-21)
- Move msw back to being a dev package (25ef14d)
- Use proper skip in quarantine so retires skip (4980282)
1.7.0 (2024-11-19)
- add coverage options to pwc-p program (ef0c5e3)
- tests (b81a0a0)
- typo (e2aee5d)
- update config example (b848e29)
- Add support for automation rules (dfdf8e8)
- Add support for coverage
1.6.2 (2024-10-19)
1.6.1 (2024-10-15)
1.6.0 (2024-09-20)
- patch path-to-regexp (9cf3d77)
1.5.12 (2024-10-07)
- retry on 500 (124085f)
1.5.11 (2024-09-09)
- added support for only changed flag (005347c)
- moved cli only changed parsing to pwc-scanner (3ba387a)
1.5.10 (2024-09-02)
1.5.9 (2024-08-28)
- add --pwc-skip-reporter-injection (31edb4d)
1.5.8 (2024-08-27)
- Report flaky skipped tests rather than listing them as failed (9d18b29)
1.5.7 (2024-08-26)
- compress requests gt 1MB (#184) (e5acd9d)
- limit error message and stack to 2048 chars (#185) (4055a1d)
- retry network requests on ENOTFOUND and EAI_AGAIN (#186) (87a4df2)
1.5.6 (2024-08-12)
1.5.5 (2024-08-09)
- clean up package.json before publishing (dbb77df)
1.5.4 (2024-08-09)
- change author filed to object (1ddca8f)
1.5.3 (2024-08-08)
- added script to update changelog (a08dc02)
- addressed feedback (1272a5d)
- run changelog update on release and publish scripts (f1ef130)
1.5.2 (2024-08-01)
- fix: retry failed request if path is /runs/v1 (#177) (c6b334bd)
- fix: include apigw-requestid in error messages (#177) (c6b334bd)
1.5.1 (2024-08-01)
1.5.0 (2024-07-31)
- Support the last-failed flag (988c27a)
- detect cancellation in or8n createTask (644d8cf)
1.4.6 (2024-07-26)
- show correct count of failed flaky tests (2f26bd2)
1.4.5 (2024-07-10)
- add CURRENTS_PWCP_DRY_RUN (c2b6777)
1.4.4 (2024-06-25)
- pwc: Auto generate ciBuildId when not detected
1.4.3 (2024-06-25)
- update dependencies to patch vulnerabilities
1.4.3-beta.1 (2024-06-24)
- use proxy for uploads (75aa154)
1.4.3-beta.0 (2024-06-24)
- use https-proxy-agent (3da0e47)
1.4.2 (2024-06-21)
1.4.1 (2024-06-18)
- move to config function and set in onBegin (60bbe2a)
- remove warning from discovery reporter and add it to orchestration reporter (18a9030)
1.4.0 (2024-06-10)
- Allow pwc-p to read config from the environment (#160) (47effc3)
- drop sourcemaps-support register for reporters (#165) (70174bf)
1.3.3 (2024-06-03)
- fullConfig finding failed in playwright v1.32 and below (d09e946)
1.3.2 (2024-05-29)
- filter playwright options from undesired arguments (e6e412d)
1.3.1 (2024-05-17)
- pwc-p - don't allow task groupId to be overridden by cli args (e727f5b)
- use -- to separate the playwright command cli options and arguments (8ea7078)
1.3.0 (2024-05-16)
- add --repeat-each to scanner args (2ad9d16)
1.2.0 (2024-05-03)
1.2.0-beta.0 (2024-05-03)
1.1.9 (2024-04-30)
1.1.9-alpha.0 (2024-04-30)
- add lodash as a dep for scanner [skip ci] (c7ec06b)
1.1.8 (2024-04-26)
1.1.7 (2024-04-18)
- Use the correct spec file location (9dbefcb)
1.1.6 (2024-04-09)
- use [email protected] [skip ci] (1918036)
- generate name for projects with an empty name or undefined name
- forbid orchestration for unnamed projects
1.1.5 (2024-04-05)
- don't throw when there is missing instanceId (767eb45)
1.1.4 (2024-04-03)
1.1.3 (2024-04-03)
- fix widnows paths for fullTestSuite (9d3e56e)
1.1.2 (2024-04-01)
- @currents/[email protected] (9d2fef1)
1.1.1 (2024-04-01)
- fix a bug with explicit projects for the same ci-build-id (92cb0db)
- fix a bug with ignoring --grep-invert for discovering full testing suite, add context for debug (1766c01)
- consider .only for discovering full testing suite (1ac74fe)
1.1.0 (2024-03-27)
1.0.1 (2024-03-26)
This is a major revamp of the reporter. There are no breaking changes in terms of API and configuration, but there are significant changes in the underlying reporting mechanism and the produced output.
-
Full parallel mode support: set
fullyParallel: trueto enable running individual tests from the same spec file on different workers. Playwright supports multiple levels of concurrency - a test suite can be split between different machines using sharding, and on each individual machine Playwright will spawn parallel workers (according to CPU performance or explicit configuration). The workers will run in parallel, executing the tests (or more precisely, test attempts). By default, Playwright runs the tests of the same spec file serially one after another, but, if the tests are isolated, enablingfullyParallel: truewill allow running tests from the same spec file in parallel on different workers (or sometimes even on different shards / machines). The most recent version of the reporter is compatible with full parallel mode and will collect the results of concurrent parallel executions. -
Step-level reporting: playwright organizes tests executions according to the following hierarchy: Run > Project > Spec File > Test > Attempt > Step. Traditionally, reporters send the results after Run completion (sometimes after Spec File completion). It works well in most cases, but.... imagine running a spec file with 10 tests on a CI machine. 9 tests can be completed successfully, but the last test can cause a crash. If we report after spec completion, no results will be reported at all, even for 9 completed test. Currents reporter sends the results for each individual step (with some batching applied for better performance). That allows capturing as much information as possible as soon as it's ready. It is super-valuable for debugging failed CI executions, which are often unique and are not easy to reproduce locally.
-
Reporter output and results: we have refactored the look and the feel of the reporter's console output for more precise and accurate presentation of the execution workflow. A test execution consists of one or more attempts, each attempt can have its own status, errors, stdout and stderr output. Determining a test's "status" and flakiness requires considering the outcome of all the attempts, the expected status and the execution mode (e.g. "serial" mode can generate extra attempts). The new format makes it easier to track the logic behind determining test status, displays individual attempts errors. Additionally, we split the captured output, that can have mixed items from concurrent parallel workers and assign them to the corresponding spec files.
-
Playwright orchestration: the new CLI tool
pwc-pimproves Playwright CI executions by automatically balancing spec files between CI machines. The balancing uses the data from the previously recorded executions to optimally assign spec files between machines, which allows up to 40% decrease in CI E2E Playwright tests. Please refer to our documentation for more details and instructions.
0.12.2 (2024-03-06)
- handle teamcity git params (56ad8fc)
0.12.1 (2024-02-05)
- use proper debug fn for cancellation (a5cc5c1)
0.12.0 (2024-01-30)
- Collect GitHub Actions PR information (7229ac)
- add scanner package, wip (3195de4)
0.11.5 (2023-12-17)
- report non-run tests and attempts as skipped (dc22305)
0.11.4 (2023-12-11)
0.11.3 (2023-12-11)
- add remote debugging (6db1329)
0.11.2 (2023-12-05)
- exit with zero when no tests detected (459af9e)
0.11.1 (2023-12-01)
- fix cli description (a8b95b7)
0.11.0 (2023-12-01)
- implement cancelAfterFailures and disableTitleTags (452e666)
0.10.9 (2023-11-23)
- change doc link (6d4aacc)
0.10.8 (2023-11-22)
0.10.7 (2023-11-20)
- add commander as a dependency (f00191b)
0.10.6 (2023-11-07)
- use @currents/commit-info (b737211)
0.10.5 (2023-11-07)
- remove _pwc-parallel because of pnpm error (6f9c785)
0.10.4 (2023-11-04)
- remove log message (8dea731)
0.10.3 (2023-11-04)
- make reporterOptions optional (b497249)
0.10.2 (2023-11-02)
- report tests for single project (de6448e)
0.10.1 (2023-10-31)
- add missing deps (9c9e875)
0.10.0 (2023-10-31)
- add --pwc-remove-title-tags (e842bdb)
- refactor CLI processing (c5f4977)
- support tags in project metadata (b11ee9c)
0.9.0 (2023-10-20)
- implement cancellations (f9bcad0)
0.8.1 (2023-09-07)
- redact attachments body (cf6c757)
0.8.0 (2023-09-07)
- test-level report (9797b7a)
0.7.2 (2023-08-23)
- capture error details (7fbcacd)
0.7.1 (2023-08-16)
0.7.0 (2023-08-16)
- implement tags (3ac3bf1)
0.6.4 (2023-08-09)
0.6.4-beta.0 (2023-07-29)
- add execa (4158356)
0.6.3 (2023-07-12)
- report errors for hooks and internal steps (1ce1d89)
0.6.2 (2023-06-30)
- set pw version (89468b2)
- specify content-type and disposition (d9ba3e3)
- support multiple videos (10d10f9)
0.6.1 (2023-06-30)
- set pw version (89468b2)
- specify content-type and disposition (d9ba3e3)
- support multiple videos (10d10f9)
0.6.0 (2023-06-15)
- send workerIndex and parallelIndex (c392a41)
0.5.0 (2023-06-11)
0.5.0-beta.2 (2023-06-08)
- remove playwright from peer deps (755148e)
0.5.0-beta.1 (2023-06-08)
0.5.0-beta.0 (2023-06-08)
- support image buffers
- upload console output directly to remote storage
- better error messages (f87a5a9)
- show warning received from cloud service
- handle screenshot buffers (d24b9ab)
- reduce payload size ([a7b3ed7](https://github.com/currents-dev/currents-playwright/commit/
0.4.2 (2023-05-12)
- fix npm dependencies (608cd53)
0.4.1 (2023-05-09)
- fallback to _id for testCase (923e7e9)
0.4.0 (2023-05-05)
- allow debugging extensions (17b5a5f)
- send ciBuildId when creating a run (d47a2c1)
- show upload warnings at the end of execution (63c91f3)
- upload stdout and artifacts in parallel (10a0d2d)
- use debug extensions (0512596)
0.3.8-beta.0 (2023-04-20)
- use network retries, enhance debugging (f996250)
0.3.7 (2023-04-11)
- send raw results for troubleshooting (712cf7e)
0.3.6 (2023-04-10)
- handle expected vs actual tests status (6d3c5cb)
0.3.5 (2023-03-31)
- use execa to support windows (b20b746)
0.3.4 (2023-02-20)
- wait for flaky test to complete (95fffef)
0.3.3 (2023-02-08)
0.3.2 (2023-02-08)
- handle empty results (ac09874)
0.3.1 (2023-02-06)
- remove requiring pw+pwc version (9481736)
0.3.0 (2023-02-06)
- exist with pw's exit status (983bb0c)
- handle expired run case (5d008cf)
- use claimedCount > 1 (ee40f1e)
- use dedicated pw stdout endpoint (62f4a48)
- use PR ref for clear message (3c7e6a6)
0.2.2 (2023-01-31)
- skip uploading results for errors (dd0d3a8)
0.2.0 (2023-01-31)
- fix counting repeated tests and their status (f24694a)
- add http errors handlers (044a93f)
- create instances in advance (830064b)
- upload results in parallel (b6f3179)
0.1.1 (2023-01-26)
0.1.0 (2023-01-26)
- add basic Playwright reporter (f50c00c)
- create run on onBegin (a30c33c)
- get git info in test reporter (845c83d)
- make initial setup call from Playwright (ac5083b)
- sent version headers with network requests (3ad1896)
0.4.0 (2023-05-05)
- allow debugging extensions (17b5a5f)
- send ciBuildId when creating a run (d47a2c1)
- show upload warnings at the end of execution (63c91f3)
- upload stdout and artifacts in parallel (10a0d2d)
- use debug extensions (0512596)
0.3.8-beta.0 (2023-04-20)
- use network retries, enhance debugging (f996250)
0.3.7 (2023-04-11)
- send raw results for troubleshooting (712cf7e)
0.3.6 (2023-04-10)
- handle expected vs actual tests status (6d3c5cb)
0.3.5 (2023-03-31)
- use execa to support windows (b20b746)
0.3.4 (2023-02-20)
- wait for flaky test to complete (95fffef)
0.3.3 (2023-02-08)
0.3.2 (2023-02-08)
- handle empty results (ac09874)
0.3.1 (2023-02-06)
- remove requiring pw+pwc version (9481736)
0.3.0 (2023-02-06)
- exist with pw's exit status (983bb0c)
- handle expired run case (5d008cf)
- use claimedCount > 1 (ee40f1e)
- use dedicated pw stdout endpoint (62f4a48)
- use PR ref for clear message (3c7e6a6)
0.2.2 (2023-01-31)
- skip uploading results for errors (dd0d3a8)
0.2.0 (2023-01-31)
- fix counting repeated tests and their status (f24694a)
- add http errors handlers (044a93f)
- create instances in advance (830064b)
- upload results in parallel (b6f3179)
0.1.1 (2023-01-26)
0.1.0 (2023-01-26)
- add basic Playwright reporter (f50c00c)
- create run on onBegin (a30c33c)
- get git info in test reporter (845c83d)
- make initial setup call from Playwright (ac5083b)
- sent version headers with network requests (3ad1896)
0.4.0 (2023-05-05)
- allow debugging extensions (17b5a5f)
- send ciBuildId when creating a run (d47a2c1)
- show upload warnings at the end of execution (63c91f3)
- upload stdout and artifacts in parallel (10a0d2d)
- use debug extensions (0512596)
0.3.8-beta.0 (2023-04-20)
- use network retries, enhance debugging (f996250)
0.3.7 (2023-04-11)
- send raw results for troubleshooting (712cf7e)
0.3.6 (2023-04-10)
- handle expected vs actual tests status (6d3c5cb)
0.3.5 (2023-03-31)
- use execa to support windows (b20b746)
0.3.4 (2023-02-20)
- wait for flaky test to complete (95fffef)
- use relative files location https://github.com/currents-dev/currents-playwright/pull/72
- add CI git and build info https://github.com/currents-dev/currents-playwright/pull/71
0.3.3 (2023-02-08)
0.3.2 (2023-02-08)
- handle empty results (ac09874)
0.3.1 (2023-02-06)
- remove requiring pw+pwc version (9481736)
0.3.0 (2023-02-06)
- exit with pw's exit status (983bb0c)
- handle expired run case (5d008cf)
- use claimedCount > 1 (ee40f1e)
- use dedicated pw stdout endpoint (62f4a48)
- use PR ref for clear message (3c7e6a6)
0.2.2 (2023-01-31)
- skip uploading results for errors (dd0d3a8)
0.2.1 (2023-01-31)
0.2.0 (2023-01-31)
- fix counting repeated tests and their status (f24694a)
- add http errors handlers (044a93f)
- create instances in advance (830064b)
- upload results in parallel (b6f3179)