Skip to content

Commit

Permalink
Move tasks for consistency with HSC DRP-RC2.yaml
Browse files Browse the repository at this point in the history
After review, move some tasks for consistency with HSC DRP-RC2.yaml:  selectGoodSeeingVisits and templateGen to step3a, writeRecalibratedSourceTable and transformSourceTable to step4, consolidateSourceTable to step5.
  • Loading branch information
hlin730 authored Dec 6, 2023
1 parent b0c6f8c commit 681f25c
Showing 1 changed file with 6 additions and 8 deletions.
14 changes: 6 additions & 8 deletions pipelines/LATISS/DRP.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -135,10 +135,7 @@ subsets:
- fgcmBuildFromIsolatedStars
- fgcmFitCycle
- fgcmOutputProducts
- transformSourceTable
- consolidateSourceTable
- updateVisitSummary
- writeRecalibratedSourceTable
- makeCcdVisitTable
- makeVisitTable
description: |
Expand Down Expand Up @@ -167,6 +164,8 @@ subsets:
- forcedPhotCoadd
- writeObjectTable
- transformObjectTable
- selectGoodSeeingVisits
- templateGen
description: |
Tract-level coaddition tasks.
Allowed data query constraints: instrument, skymap, tract.
Expand All @@ -181,8 +180,6 @@ subsets:
step3b:
subset:
- consolidateObjectTable
- selectGoodSeeingVisits
- templateGen
description: |
Tract-level tasks.
Allowed data query constraints: skymap, tract.
Expand Down Expand Up @@ -224,6 +221,8 @@ subsets:
- detectAndMeasureDiaSources
- transformDiaSourceCat
- writeForcedSourceTable
- writeRecalibratedSourceTable
- transformSourceTable
description: |
Tasks that be run together, but only after the 'step1', 'step2', and
'step3' subsets.
Expand All @@ -250,15 +249,14 @@ subsets:
Tasks that can be run together, but only after the 'step1', 'step2',
'step3', and 'step4' subsets.
This step includes patch-level aggregation Tasks. These should be run
with explicit 'tract' constraints in the data query, otherwise quanta
will be created for jobs with only partial visit coverage.
This step includes patch-level aggregation Tasks.

Check failure on line 252 in pipelines/LATISS/DRP.yaml

View workflow job for this annotation

GitHub Actions / call-workflow / yamllint

252:56 [trailing-spaces] trailing spaces
'consolidateForcedSourceTable' is a tract-level task that aggregates
patches and should be rerun if any of the patches fail.
step6:
subset:
- consolidateDiaSourceTable
- consolidateSourceTable
description: |
Tasks that can be run together, but only after the 'step1', 'step2',
'step3', 'step4', and 'step5' subsets.
Expand Down

0 comments on commit 681f25c

Please sign in to comment.