Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix checkout caches on shared trust domains #21

Merged
merged 2 commits into from
Nov 21, 2023

fix(python): scope checkout caches to the specific project

e090c1c
Select commit
Loading
Failed to load commit list.
Merged

Fix checkout caches on shared trust domains #21

fix(python): scope checkout caches to the specific project
e090c1c
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / Decision Task succeeded Nov 15, 2023 in 22s

FirefoxCI (pull_request)

The task that creates all of the other tasks in the task graph

Details

View task in Taskcluster
View logs in Taskcluster


[taskcluster 2023-11-15 14:52:58.392Z] Task ID: fjOsUWJ5Rp6cECuBaUw_Tw
[taskcluster 2023-11-15 14:52:58.392Z] Worker ID: 3304631820191623118
[taskcluster 2023-11-15 14:52:58.392Z] Worker Group: us-central1
[taskcluster 2023-11-15 14:52:58.392Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2023-11-15 14:52:58.392Z] Worker Pool: mozilla-1/decision-gcp
[taskcluster 2023-11-15 14:52:58.392Z] Worker Version: 38.0.5
[taskcluster 2023-11-15 14:52:58.392Z] Public IP: 34.133.121.230
[taskcluster 2023-11-15 14:52:58.392Z] Hostname: mozilla-1-decision-gcp-v6wyzqaordsh2unbiamfaq
[taskcluster 2023-11-15 14:52:58.392Z] using cache "mozilla-project-reps-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts

5544ebdc0c7b - Started downloading
6390f95da86a - Started downloading
5544ebdc0c7b - Downloaded in 0.235 seconds
6390f95da86a - Downloaded in 0.753 seconds
Digest: sha256:ddcc7348db272885e8ea32825f698bfafa4727401099531cd8239d3d458b39aa
Status: Downloaded newer image for mozillareleases/taskgraph@sha256:ddcc7348db272885e8ea32825f698bfafa4727401099531cd8239d3d458b39aa
[taskcluster 2023-11-15 14:53:06.582Z] === Task Starting ===
[setup 2023-11-15T14:53:07.640Z] run-task started in /
[vcs 2023-11-15T14:53:07.642Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2023-11-15T14:53:07.642Z] running as worker:worker
[vcs 2023-11-15T14:53:07.642Z] executing ['git', 'clone', 'https://github.com/mozilla-releng/reps', '/builds/worker/checkouts/src']
[vcs 2023-11-15T14:53:07.646Z] Cloning into '/builds/worker/checkouts/src'...
[vcs 2023-11-15T14:53:08.030Z] executing ['git', 'fetch', 'origin', 'main']
[vcs 2023-11-15T14:53:08.204Z] From https://github.com/mozilla-releng/reps
[vcs 2023-11-15T14:53:08.205Z]  * branch            main       -> FETCH_HEAD
[vcs 2023-11-15T14:53:08.209Z] executing ['git', 'checkout', 'main']
[vcs 2023-11-15T14:53:08.214Z] Already on 'main'
[vcs 2023-11-15T14:53:08.214Z] Your branch is up to date with 'origin/main'.
[vcs 2023-11-15T14:53:08.215Z] executing ['git', 'fetch', 'origin', 'a6da7aed9c8bf052badeb5d343f7238487ea9707']
[vcs 2023-11-15T14:53:08.381Z] From https://github.com/mozilla-releng/reps
[vcs 2023-11-15T14:53:08.381Z]  * branch            a6da7aed9c8bf052badeb5d343f7238487ea9707 -> FETCH_HEAD
[vcs 2023-11-15T14:53:08.385Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/ahal/reps', 'checkout_cache']
[vcs 2023-11-15T14:53:08.640Z] From https://github.com/ahal/reps
[vcs 2023-11-15T14:53:08.640Z]  * branch            checkout_cache -> FETCH_HEAD
[vcs 2023-11-15T14:53:08.645Z] executing ['git', 'checkout', '-f', '-B', 'checkout_cache', 'e090c1c1237c32052f78206003b6bb435a2705a1']
[vcs 2023-11-15T14:53:08.652Z] Switched to a new branch 'checkout_cache'
[vcs 2023-11-15T14:53:08.653Z] cleaning git checkout...
[vcs 2023-11-15T14:53:08.653Z] executing ['git', 'clean', '-nxdff']
[vcs 2023-11-15T14:53:08.655Z] removing []
[vcs 2023-11-15T14:53:08.655Z] successfully cleaned git checkout!
[vcs 2023-11-15T14:53:08.658Z] TinderboxPrint:<a href='https://github.com/ahal/reps/commit/e090c1c1237c32052f78206003b6bb435a2705a1' title='Built from reps commit e090c1c1237c32052f78206003b6bb435a2705a1'>e090c1c1237c32052f78206003b6bb435a2705a1</a>
[pip-install 2023-11-15T14:53:08.658Z] executing ['/usr/bin/python3', '-mpip', 'install', '--require-hashes', '-r', '/builds/worker/checkouts/src/taskcluster/requirements.txt']
[pip-install 2023-11-15T14:53:09.258Z] Defaulting to user installation because normal site-packages is not writeable
[pip-install 2023-11-15T14:53:09.326Z] Requirement already satisfied: appdirs==1.4.4 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 7)) (1.4.4)
[pip-install 2023-11-15T14:53:09.327Z] Requirement already satisfied: arrow==1.2.3 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 11)) (1.2.3)
[pip-install 2023-11-15T14:53:09.328Z] Requirement already satisfied: binaryornot==0.4.4 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 15)) (0.4.4)
[pip-install 2023-11-15T14:53:09.421Z] Collecting certifi==2023.7.22
[pip-install 2023-11-15T14:53:09.478Z]   Downloading certifi-2023.7.22-py3-none-any.whl (158 kB)
[pip-install 2023-11-15T14:53:09.506Z] Requirement already satisfied: chardet==5.1.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 23)) (5.1.0)
[pip-install 2023-11-15T14:53:09.791Z] Collecting charset-normalizer==3.1.0
[pip-install 2023-11-15T14:53:09.807Z]   Downloading charset_normalizer-3.1.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (195 kB)
[pip-install 2023-11-15T14:53:09.865Z] Collecting click==8.1.4
[pip-install 2023-11-15T14:53:09.880Z]   Downloading click-8.1.4-py3-none-any.whl (98 kB)
[pip-install 2023-11-15T14:53:09.917Z] Collecting cookiecutter==2.2.0
[pip-install 2023-11-15T14:53:09.933Z]   Downloading cookiecutter-2.2.0-py3-none-any.whl (38 kB)
[pip-install 2023-11-15T14:53:09.937Z] Requirement already satisfied: giturlparse==0.10.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 112)) (0.10.0)
[pip-install 2023-11-15T14:53:09.938Z] Requirement already satisfied: idna==3.4 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 116)) (3.4)
[pip-install 2023-11-15T14:53:09.939Z] Requirement already satisfied: jinja2==3.1.2 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 120)) (3.1.2)
[pip-install 2023-11-15T14:53:09.964Z] Collecting json-e==4.5.2
[pip-install 2023-11-15T14:53:09.980Z]   Downloading json_e-4.5.2-py3-none-any.whl (13 kB)
[pip-install 2023-11-15T14:53:10.124Z] Collecting markupsafe==2.1.3
[pip-install 2023-11-15T14:53:10.138Z]   Downloading MarkupSafe-2.1.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
[pip-install 2023-11-15T14:53:10.142Z] Requirement already satisfied: mozilla-repo-urls==0.1.1 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 180)) (0.1.1)
[pip-install 2023-11-15T14:53:10.143Z] Requirement already satisfied: python-dateutil==2.8.2 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 184)) (2.8.2)
[pip-install 2023-11-15T14:53:10.145Z] Requirement already satisfied: python-slugify==8.0.1 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 188)) (8.0.1)
[pip-install 2023-11-15T14:53:10.146Z] Requirement already satisfied: pyyaml==6.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 192)) (6.0)
[pip-install 2023-11-15T14:53:10.147Z] Requirement already satisfied: redo==2.0.4 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 236)) (2.0.4)
[pip-install 2023-11-15T14:53:10.215Z] Collecting requests==2.31.0
[pip-install 2023-11-15T14:53:10.229Z]   Downloading requests-2.31.0-py3-none-any.whl (62 kB)
[pip-install 2023-11-15T14:53:10.233Z] Requirement already satisfied: requests-unixsocket==0.3.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 247)) (0.3.0)
[pip-install 2023-11-15T14:53:10.234Z] Requirement already satisfied: six==1.16.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 251)) (1.16.0)
[pip-install 2023-11-15T14:53:10.235Z] Requirement already satisfied: slugid==2.0.0 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 255)) (2.0.0)
[pip-install 2023-11-15T14:53:10.277Z] Collecting taskcluster-taskgraph==5.5.0
[pip-install 2023-11-15T14:53:10.293Z]   Downloading taskcluster_taskgraph-5.5.0-py3-none-any.whl (246 kB)
[pip-install 2023-11-15T14:53:10.301Z] Requirement already satisfied: taskcluster-urls==13.0.1 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 263)) (13.0.1)
[pip-install 2023-11-15T14:53:10.302Z] Requirement already satisfied: text-unidecode==1.3 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 268)) (1.3)
[pip-install 2023-11-15T14:53:10.373Z] Collecting urllib3==2.0.7
[pip-install 2023-11-15T14:53:10.387Z]   Downloading urllib3-2.0.7-py3-none-any.whl (124 kB)
[pip-install 2023-11-15T14:53:10.391Z] Requirement already satisfied: voluptuous==0.13.1 in /usr/local/lib/python3.8/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 276)) (0.13.1)
[pip-install 2023-11-15T14:53:10.599Z] Installing collected packages: urllib3, markupsafe, charset-normalizer, certifi, requests, click, json-e, cookiecutter, taskcluster-taskgraph
[pip-install 2023-11-15T14:53:10.682Z]   WARNING: The script normalizer is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2023-11-15T14:53:10.682Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2023-11-15T14:53:10.791Z]   WARNING: The script cookiecutter is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2023-11-15T14:53:10.791Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2023-11-15T14:53:10.872Z]   WARNING: The script taskgraph is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2023-11-15T14:53:10.872Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2023-11-15T14:53:10.877Z] Successfully installed certifi-2023.7.22 charset-normalizer-3.1.0 click-8.1.4 cookiecutter-2.2.0 json-e-4.5.2 markupsafe-2.1.3 requests-2.31.0 taskcluster-taskgraph-5.5.0 urllib3-2.0.7
[pip-install 2023-11-15T14:53:11.021Z] WARNING: You are using pip version 21.1.3; however, version 23.3.1 is available.
[pip-install 2023-11-15T14:53:11.021Z] You should consider upgrading via the '/usr/bin/python3 -m pip install --upgrade pip' command.
[task 2023-11-15T14:53:11.067Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph decision --pushlog-id='0' --pushdate='0' --project='reps' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla-releng/reps' --base-ref='main' --base-rev='a6da7aed9c8bf052badeb5d343f7238487ea9707' --head-repository='https://github.com/ahal/reps' --head-ref='checkout_cache' --head-rev='e090c1c1237c32052f78206003b6bb435a2705a1' \n"]
[task 2023-11-15T14:53:11.069Z] + cd /builds/worker/checkouts/src
[task 2023-11-15T14:53:11.069Z] + ln -s /builds/worker/artifacts artifacts
[task 2023-11-15T14:53:11.070Z] + /builds/worker/.local/bin/taskgraph decision --pushlog-id=0 --pushdate=0 --project=reps [email protected] --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/mozilla-releng/reps --base-ref=main --base-rev=a6da7aed9c8bf052badeb5d343f7238487ea9707 --head-repository=https://github.com/ahal/reps --head-ref=checkout_cache --head-rev=e090c1c1237c32052f78206003b6bb435a2705a1
[task 2023-11-15T14:53:11.386Z] 2023-11-15 14:53:11,385 - INFO - Loading graph configuration.
[task 2023-11-15T14:53:11.395Z] 2023-11-15 14:53:11,395 - WARNING - using default project parameters; add reps to PER_PROJECT_PARAMETERS in /builds/worker/.local/lib/python3.8/site-packages/taskgraph/decision.py to customize behavior for this project
[task 2023-11-15T14:53:11.396Z] 2023-11-15 14:53:11,396 - INFO - Using Parameters(id=6ba261003d9a) (from defaults)
[task 2023-11-15T14:53:11.397Z] 2023-11-15 14:53:11,396 - INFO - writing artifact file `parameters.yml`
[task 2023-11-15T14:53:11.403Z] 2023-11-15 14:53:11,403 - INFO - writing artifact file `actions.json`
[task 2023-11-15T14:53:11.404Z] 2023-11-15 14:53:11,404 - INFO - Loading kinds
[task 2023-11-15T14:53:11.415Z] 2023-11-15 14:53:11,415 - INFO - Generating full task set
[task 2023-11-15T14:53:11.424Z] 2023-11-15 14:53:11,424 - INFO - Writing docker-contexts/fetch.tar.gz for docker image fetch
[task 2023-11-15T14:53:11.439Z] 2023-11-15 14:53:11,439 - INFO - Writing docker-contexts/python.tar.gz for docker image python
[task 2023-11-15T14:53:11.456Z] 2023-11-15 14:53:11,456 - INFO - Generated 2 tasks for kind docker-image
[task 2023-11-15T14:53:11.466Z] 2023-11-15 14:53:11,466 - INFO - Generated 1 tasks for kind fetch
[task 2023-11-15T14:53:11.468Z] 2023-11-15 14:53:11,468 - INFO - Generated 1 tasks for kind test
[task 2023-11-15T14:53:11.470Z] 2023-11-15 14:53:11,470 - INFO - Generated 1 tasks for kind codecov
[task 2023-11-15T14:53:11.471Z] 2023-11-15 14:53:11,470 - INFO - Generating full task graph
[task 2023-11-15T14:53:11.471Z] 2023-11-15 14:53:11,470 - INFO - Full task graph contains 5 tasks and 5 dependencies
[task 2023-11-15T14:53:11.472Z] 2023-11-15 14:53:11,470 - INFO - writing artifact file `full-task-graph.json`
[task 2023-11-15T14:53:11.473Z] 2023-11-15 14:53:11,472 - INFO - writing artifact file `runnable-jobs.json`
[task 2023-11-15T14:53:11.474Z] 2023-11-15 14:53:11,472 - INFO - Generating target task set
[task 2023-11-15T14:53:11.475Z] 2023-11-15 14:53:11,472 - INFO - Filter filter_target_tasks pruned 3 tasks (2 remain)
[task 2023-11-15T14:53:11.476Z] 2023-11-15 14:53:11,472 - INFO - writing artifact file `target-tasks.json`
[task 2023-11-15T14:53:11.476Z] 2023-11-15 14:53:11,473 - INFO - Generating target task graph
[task 2023-11-15T14:53:11.476Z] 2023-11-15 14:53:11,473 - INFO - Adding 2 tasks with `always_target` attribute
[task 2023-11-15T14:53:11.477Z] 2023-11-15 14:53:11,473 - INFO - Generating optimized task graph
[task 2023-11-15T14:53:11.477Z] 2023-11-15 14:53:11,473 - INFO - No tasks removed during optimization
[task 2023-11-15T14:53:11.602Z] 2023-11-15 14:53:11,602 - INFO - No tasks replaced during optimization
[task 2023-11-15T14:53:11.603Z] 2023-11-15 14:53:11,603 - INFO - writing artifact file `task-graph.json`
[task 2023-11-15T14:53:11.604Z] 2023-11-15 14:53:11,604 - INFO - writing artifact file `label-to-taskid.json`
[task 2023-11-15T14:53:11.606Z] 2023-11-15 14:53:11,606 - INFO - Creating task with taskId dd1xJ58JTGK2L7W_1cSQkQ for build-docker-image-fetch
[task 2023-11-15T14:53:11.608Z] 2023-11-15 14:53:11,606 - INFO - Creating task with taskId BqL4T9G5S0WixHIU0t6iUQ for build-docker-image-python
[task 2023-11-15T14:53:11.717Z] 2023-11-15 14:53:11,717 - INFO - Creating task with taskId Rc8o5OoKTC-WkX5LKU5AzQ for fetch-codecov-uploader
[task 2023-11-15T14:53:11.865Z] 2023-11-15 14:53:11,865 - INFO - Creating task with taskId SGreBRG8QIe7ruCykuBjjQ for test-unit
[task 2023-11-15T14:53:11.943Z] 2023-11-15 14:53:11,943 - INFO - Creating task with taskId J9O40RskQ3-mQFO4UTm92w for codecov-upload
[taskcluster 2023-11-15 14:53:12.248Z] === Task Finished ===
[taskcluster 2023-11-15 14:53:15.436Z] Successful task run with exit code: 0 completed in 17.046 seconds