Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Np lk pd 2726 #1360

Closed
wants to merge 30 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
7dcdf7b
Making sure temporary credentials or keys don't get pushed by accident
kevinpalis Aug 12, 2024
8f08af6
Adding a GHA that can authenticate using a service account in GCP
kevinpalis Aug 12, 2024
573e368
Plugging in the magical auth system to finally connect to Terra
kevinpalis Aug 13, 2024
4af4ee5
Adding quotes in vars. Disabling PR trigger to avoid duplicated runs …
kevinpalis Aug 13, 2024
c4b2180
Fixing newline. Adding debug lines
kevinpalis Aug 13, 2024
d0994fa
Debugging why the access token is not being accepted
kevinpalis Aug 13, 2024
61e1c54
Adding time to token validity. Maybe it expired before getting used
kevinpalis Aug 13, 2024
2dc88a6
Removing printings
kevinpalis Aug 13, 2024
a1396a5
retrigger
kevinpalis Aug 13, 2024
d75b836
Retrigger
kevinpalis Aug 14, 2024
fed5f4b
Trying out a different token
kevinpalis Aug 14, 2024
3736f83
Setting back to access token
kevinpalis Aug 14, 2024
64c880f
try setting scopes directly
jack-r-warren Aug 14, 2024
e43591d
Removing debug flag for cleaner output.
kevinpalis Aug 14, 2024
897d11a
Adding getting submission list
kevinpalis Aug 15, 2024
cb934c0
Changing to warp tests
kevinpalis Aug 15, 2024
32aa61e
Switching back
kevinpalis Aug 15, 2024
8494c33
adding new info for running a workflow
ekiernan Aug 15, 2024
689c6ad
removing old get submission list
ekiernan Aug 15, 2024
a505c30
adding branch for deployment
ekiernan Aug 16, 2024
a4a020a
fixing quotes
ekiernan Aug 16, 2024
eb2e3f8
fixed quotes
ekiernan Aug 16, 2024
e736c53
fixing url
ekiernan Aug 16, 2024
3c1d8db
hardcoding workspace path
ekiernan Aug 16, 2024
1b619e1
memory retry multiplier
ekiernan Aug 16, 2024
a48f875
Update test_illumina_genotyping_array.yml
ekiernan Aug 16, 2024
e530541
spacing in -d parameter
ekiernan Aug 16, 2024
e5ead98
Update test_illumina_genotyping_array.yml
ekiernan Aug 16, 2024
6d4c72a
add -H Content-Type:
nikellepetrillo Aug 16, 2024
e9b0638
add -H Content-Type:
nikellepetrillo Aug 16, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
77 changes: 77 additions & 0 deletions .github/workflows/test_illumina_genotyping_array.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,77 @@
name: Test Illumina Genotyping Array

# Controls when the workflow will run
on:
#run on push to feature branch "kp_GHA_Terra_auth_PD-2682" - REMOVE WHEN DONE TESTING
push:
branches:
- lk-PD-2726
#pull_request:
# branches: [ "develop" ]
# Allows you to run this workflow manually from the Actions tab
workflow_dispatch:
# inputs:
# image_tag:
# description: 'Docker Image Tag (default: branch_name)'
env:
PROJECT_NAME: WARP
# Github repo name
REPOSITORY_NAME: ${{ github.event.repository.name }}

jobs:
authenticate_sa:
runs-on: ubuntu-latest
# Add "id-token" with the intended permissions.
permissions:
contents: 'read'
id-token: 'write'

steps:
# actions/checkout MUST come before auth
- uses: 'actions/checkout@v3'

- id: 'auth'
name: 'Authenticate to Google Cloud'
uses: 'google-github-actions/auth@v2'
with:
token_format: 'access_token'
# Centralized in dsp-tools-k8s; ask in #dsp-devops-champions for help troubleshooting
workload_identity_provider: 'projects/1038484894585/locations/global/workloadIdentityPools/github-wi-pool/providers/github-wi-provider'
# This is our tester service account
service_account: '[email protected]'
access_token_lifetime: '1000s' # optional, default: '3600s' (1 hour)
access_token_scopes: 'profile, email, openid'

# ... further steps are automatically authenticated
- name: Check working directory
run: |
echo "Current directory:"
pwd
ls -lht

- name: Submit workflow
run: |
namespace="warp-pipelines"
name="WARP Tests"
# Assign the access token to a variable
ACCESS_TOKEN="${{ steps.auth.outputs.access_token }}"

printf "\nSubmitting workflow"
submissionDetails=$(curl -X 'POST' \
"https://api.firecloud.org/api/workspaces/warp-pipelines/WARP%20Tests/submissions" \
-H "accept: */*" \
-H "Authorization: Bearer ${ACCESS_TOKEN}" \
-H 'Content-Type: application/json' \
-d '{
"methodConfigurationNamespace": "warp-pipelines",
"methodConfigurationName": "IlluminaGenotypingArray",
"useCallCache": true,
"deleteIntermediateOutputFiles": true,
"useReferenceDisks": true,
"memoryRetryMultiplier": 1,
"workflowFailureMode": "NoNewCalls",
"userComment": "will this work from gha??",
"ignoreEmptyOutputs": false
}')

printf "\nDone Submitting workflows"
5 changes: 4 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,7 @@ venv/
.flake8

# Metals server logs and other files (for Scala)
.metals
.metals

# Ignore generated credentials from google-github-actions/auth
gha-creds-*.json
Loading