v40

Code Coverage

• backend: Support ActiveData as an alternative coverage service (#1159)
• bot: Actually use the filtered task list when downloading artifacts (#1156)
• bot: Add file info for uncovered files (#1140)
• bot: Add revision in zero_coverage_report (#1153)
• bot: Add source_dir option to grcov to fix relative paths issues in zero_cov (#1173)
• bot: Add test-coverage data to chunk mapping file (#1179)
• bot: Create a context manager to run a local hgmo server and use it in notifier.py too (#1148)
• bot: Fix variable name in report_generators (#1157)
• bot: Log an error when grcov fails (#1151)
• bot: Look for debug build first and fallback on opt build if the debug build doesn't exist (#1149)
• bot: Move chunk mapping code to a separate file and write tests for it (#1163)
• bot: Move fake-repo stuff to a pytest fixture (#1146)
• bot: Remove fallback on opt build (#1184)
• bot: Remove get_last_task function from taskcluster.py (#1147)
• bot: Update backend URL (#1144)
• bot: Update grcov to version 0.1.36 and remove unused option (#1155)
• bot: Update rust to 1.26.0 and grcov to 0.1.37 (#1168)
• bot: Put hgmo.pid in cwd instead of /tmp (#1175)

Static Analysis

• Compare issues before/after commit (#861)
• Load full mercurial patch to detect files changes, fixes #1192 (#1195)
• Replace bugged revision ID parameter with an internal API call. (#1189)
• Upgrade nodejs version to 8.9.4, fixes #1193. (#1194)
• Use top of MC instead of tip to get common hg ancestor (#1196)

Shipit

• backend: Add default value for partial_updates. (#1177)
• backend: Correctly bump the version used on nightly. (#1187)
• backend: Delete large parameters (#1172)
• backend: Do not set ACTION_TASK_GROUP_ID (#1188)
• backend: Filter by build_number (#1176)
• backend: Filter releases by version (#1138)
• backend: Fix taskGroupId input (#1181)
• backend: Human release submission (#1170)

Please Command line interface

• Uncomment tooltool and treestatus on production (#1178)
• Use host networking instead of binding ports (#1171)

Documentation

• Add shipit-static-analysis doc (#1169)
• Improve shipit-static-analysis docs (#1182)

Releng frontend

• trychooser: Remove OSX 10.6 as ESR 45 is no longer a thing (#1191)

Misc

• Change author and author_email in all python projects (#1141)

v39

In this release we migrated code coverage API from shipit-uplift to a new independent project, hosted on a new domain coverage.moz.tools.

Code coverage backend

• Add shipit_code_coverage_backend to CODEOWNERS #1111
• Backend skeleton #1104
• Migrate API & tests from shipit_uplift #1105, fixes #885
• Enable deployment #1108
• git_build_changeset should be the git changeset corresponding to the hg build changeset #1110

Code coverage bot

• Don't do anything if the coverage report has already been generated and uploaded #1122
• Make hook scope depend on the branch (staging or production) #1125
• Notifier URL should depend on the channel #1131
• Remove parameters from logger.warn calls to make Sentry automatically merge issues #1132
• When retrieving coverage data, retry when the backend returns 202 #1135

Releng Frontend

• Update Spidermonkey task names in trychooser #1107
• Fix production deployment #1139

Shipit Pulse Listener

• Don't fail, but print a warning, when MH_BRANCH is not defined #1116
• Fix branch detection in the Windows build case #1133
• Remove old task check, as it's no longer required with idempotent coverage task #1123

Static Analysis

• Make sure lint issue path is always relative to repo #1120

Shipit Uplift

• Migrate code coverage API & tests to shipit-code-coverage-backend #1105, fixes #885

Shipit Workflow

• Add support for thunderbird. #1113
• filter releases API #1136
• fix TC cancelling #1130
• Add thunderbird to the list of allowed products in the api. #1124, Bug 1455407
• disable partner flag; stop populating release_partner_config #1137

v38

Code Coverage

• Make the GitHub repository a configurable secret #1100
• Stop using multiple threads to generate suite reports #1087

Shipit Pulse Listener

• Don't trigger coverage tasks if the groupResolved notification doesn't belong to a mozilla-central build #1092
• Fix unit test resolved mockup date (backport from v39 master)

Static Analysis

• Do not check clang-tidy -* is present #1102, fixes #1060
• Do not parse mach timestamps #1081, fixes #1080
• Fix lint issue building with double path variable sentry error #1101

Shipit Uplift

• Add changesets info in coverage/file endpoint #1099
• Don't use a lambda to enqueue a job with rq #1082
• Ignore errored commits #1054
• Switch to using async IO for coverage endpoints #880, fixes #856

Shipit Workflow

• Cancel phase task groups #1103
• Handle aborted releases #1096
• Enable partner repacks only for 61+ #1091
• Import partner repacks fix #1085
• Python3 iteration fix #1086

Releng Frontend

• Update Spidermonkey task names in trychooser #1107

Misc

• Import fix jose in backend_common #1083

v37

Common setup

• Deploy to Docker Hub #1062
• correcting generation of route53.tf file #979 #1028
• don't upload to S3 in PRs #1037
• multiple base docker image changes #1038
• adding multiple dependencies for linting/testing to cli_common and backend_common #995
• base-dnd- -> base- #1063
• commenting out production deployment of tooltool and treestatus #1076

Documentation

• Update deployment docs #1024

Releng frontend/trychooser

• Add test-verify jobs #1058

Code Coverage

• Fix triggering tasks from scheduler #1045
• Upload the chunk mapping as an artifact and index the coverage task on the TaskCluster index #1032

Static Analysis

• Download clang build directly from Taskcluster index #1052
• Move repo_dir management in settings #1056
• Support generic analyzers #1040
• Use Mozilla clang artifact toolchain #1007

Shipit bot uplift

• add impacted branches to report email subject, fixes #582 #1055

Shipit Uplift

• Switch to Python 3.6 #1043

Shipit Workflow

• Check supported flavors #1051
• release_eta is optional #1023
• Release workflow deps #1057
• Return action task id with phases. #1035

v36

Special thanks to the contributors: @clarammdantas @akankshanayak2111 👍

Misc.

• backend_common: Auth0 Client Credentials Flow for non-interactive API #1010
• Fix payload for scheduled hooks #1017
• nix: as with nix/default.nix we need to bootstrap nixpkgs correctly #1012
• nix: nix running in sandbox inside docker #928
• please_cli: add postgresql to the list of the projects #1018
• please_cli: new command create ./please create <template> <new-project-name> #1013
• please_cli: trivial fixes (#1033)

Code Coverage

• Add unit test for the artifacts.download function #998
• Misc improvement for low-coverage notifier #1021
• Retry retrieving latest coverage from codecov.io when it fails #1022
• Combine zero coverage files and functions into a single JSON file. #943

Static Analysis

• Add test to verify that our clang-tidy checks still exist #961

Ship-it Uplift

• Add endpoint to return revisions of the latest coverage builds #1019

Ship-it Workflow

• update the workflows #1025

v35

Special thanks to new contributors: @divyabaid16 @fiennyangeln @sprt @Sush0512 👍

Misc.

• backend_common: Use only OK Auth0 responses #900
• releng_docs: Explain how to verify shipit-code-coverage project after deployment #947

Code Coverage

• Add tests for the github module #941
• Clean artifacts tests up and make them more robust #951
• Log ActiveData errors and increase severity of codecov.io timeouts #950
• Remove utils.mkdir and use os.makedirs instead #959
• Replace utils.wait_until by utils.retry #939
• Stop using yield_fixture #940

Shipit frontend

• Remove code coverage by directory view and backend API #952 #1004

Static Analysis

• Fix mozlint line number format #955
• Run as an idempotent task #957 #954
• Update datadog version to 0.19.0 #993
• Use releng-svc-prod workers in production #946 #954 #981

Shipit uplift

• Removed get_directory_coverage function #987
• Retain changeset coverage results for 2 days instead of 1 day #945
• Remove code coverage by directory view and backend API #952

Shipit Workflow

• enable Heroku deployments #964
• Initial Ship-it API #958

v34: releng_frontned: Update Trychooser Platforms (#937)

Releng Frontend

• Update Trychooser Platforms (#937)

Shipit Pulse Listener

• Fix spacing between hook reports in monitoring emails (#923)
• Reduce notification noise (#745)
• Do not overwite latest_id to null (#903)
• Fix triggering hooks from pulse listener (#932)
• Move 'deadline', 'expires', and 'created' from the hook definition to the
  task template and use triggerHook method to trigger the hook (#919)

Shipit Static Analysis

• Support missing relative or absolute path in lint output (#929)
• Use raw patch instead of mercurial revisions. (#933)
• Fix bugs after nix update + codespell support (#917, #905)

Shipit Code Coverage

• Add source_dir parameter to files_list (#936)
• Fix tests not to hit the network (#893)
• Ignore not existing files in some cases (#924)
• Move grcov-related functions into a separate module and add unit tests for
  grcov (#909)
• Move zero coverage report generation code into a separate module and add
  tests for it (#920)
• Reenable suite generation (#935)
• Remove gecko-env as it is no longer used (#913)
• Store strings in chunk mapping file. Fixes (#891, #895)
• Use args and kwargs parameters of executor.submit instead of defining
  intermediate functions (#884)
• Use tarfile context manager (#865)

Shipit Uplift

• Add tests for some coverage functions and the extensions API endpoint (#871)
• Install Redis in the dev environment (#876)
• Make coverage shipit_uplift tests work without hitting the network (#894)
• Use .format instead of % (#868)

Misc

• Don't use 'reviewboard' mercurial extension (#907)
• Only log program name, to avoid Sentry ingoring too long messages (#899)
• Rename login scope to taskcluster-credentials (#887)
• Update robustcheckout & pin mercurial to version 4.4 (#916)
• Updating nixpkgs, nixpksg-mozilla, pypi2nix, .... and everything (#886)
• Adding testing branch and enable deployment there (#926)
• Remove shipit-risk-assessment (#925)

v33

Releng Frontend

• Remove Mac OS X Static Analysis build and clarify win32 mingw32 description (#860)

Code Coverage

• Generate chunk to tests mapping (#820)
• Make task triggered by the cron use the latest coverage build with finished tests (#850)
• Notify about patches with low coverage (#833)
• Retry artifact download if the ZIP file is invalid (#846)
• Show commit description in low coverage notifications (#852)

Static Analysis

• Lint entire files rather than modified lines only #835, fixes #834
• Misc performance optimisations (#828)
• Report number of analyzed files & lines, closes #823 (#841)
• Simpler cache (#842)

Pulse Listener

• Fixes to run Phabricator parsing on production (#857)
• Retry retrieving coverage build multiple times before failing and fail without throwing exceptions (#849)

Shipit uplift

• Retrieve modified files directly with pushes and avoid raw-rev requests (#818)
• Return 500 when coverage for a file couldn't be retrieved (#858)

Misc

• Add code owners #878 #879
• Allow defining TaskCluster secrets, client ID, access token when running 'check' (#866)

v32

Code Coverage

• Cancel unscheduled tasks when one of the tasks fails #774
• Ensure only one thread is downloading a given chunk at a time #812
• Stop building Firefox and use platform-specific chrome-map.json files to rewrite LCOV #790
• Stop rewriting LCOV files fixes #793 #801

Static Analysis

• Do not publish flake8 bad quotes issues, fixes #777 #782
• Pass in --quiet into eslint instead of --no-ignore, fixes #788 #791
• Datadog support #807 #815
• Add codespell, #797 #798
• Add shellcheck binary, #785 #787
• Add yamllint, #796 #799
• Slightly improve generated code review comments, #775 #773

v31

Code Coverage

• Miscellaneous improvements for LCOV rewriting (#746)
• Check the future for mozilla-central cloning didn't fail before trying to build. Fixes #593 (#747)
• Generate a mapping from source file to the test chunks that covered it (#756)
• Generate report of functions with no coverage. Fixes #688, #761
• Reduce timeout of the code coverage task to four hours (#505)
• Update grcov to version 0.1.31 (#732)
• Wait until test task is finished running before downloading its artifacts. Fixes #758, #518, #760
• When there are multiple tasks running the same chunk (e.g. retries), only use the task with the best status (e.g. 'completed' vs 'failed') #770
• shipit_uplift: Add prototype API to retrieve chunks given a patch (#762)

Static Analysis

• MozLint support #753
• Fix bugs detection #763 #767

Others

• please_cli: Docker tool to build dev/test images (#754)
• shipit_workflow: use correct heroku app (#751)