-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Stacky Glue / BCLConvert InteropQC / cttsoV2 Fixes / Deprecate ICAv2 Copy Batch Utility #337
Conversation
…tabases Generated a dynamodb table with a sort key and one without a sort key
With latest changes to WRSC schema, update the icav2 handler and WRSC ready event handler Also added a SFN for generating ready events from a prior workflowrunstatechange Renamed icav2-table stack Also renamed dynamodb constructs in the bclconvert manager from the previous commit
Removed the icav2 copy batch utility stack
Removed remnants of icav2 copy batch utility stack. Use the new icav2 copy batch component inside the bssh fastq copy manager
CWL Pipeline that is triggered after the fastqs have landed in our bucket
Updated the inputs to match the new WRSC. Rely on the input glue to shrink the samplesheet and fastq list rows
Initialised stacky stateful components and stateless integration
Scotch integration for connecting the bclconvert manager success event to starting the bssh fastq event
Connect the completion of the bssh fastq copy manager to the start of the bclconvert interop qc pipeline and register the fastq list rows in the database
Now that the fastq list rows are in the database, find all samples that are tso500L samples and launch the cttso v2 analysis
Some wait steps for databases were set at the default '5' seconds
.. will take time & review today |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. Massive effort with path finding impl!
I tried my best to skim through them all. Couple of convention spotted but we can go by iteration follow up. Perhaps we shall break down smaller pieces too down track...
Let us give it spin to this far.
Happy to merge this whenever you ready, Alexis. (I will take half the pizza 🍕 , if things go south) |
Generic Constructs
Added python lambda components (810f1f1)
Added partition table constructs (9f824cc)
Added ICAv2 workflow handlers (d9b6bc4)
Added ICAv2 Copy Batch Utility Construct (1cf7f2f)
BSSH Fastq Copy Manager
BCLConvert InterOp QC PIpeline Stack
ctTSO500 Pipeline Stack
StackyMcStackFace! (The Glue bits)
Scotch (bclconvert manager to bssh fastq copy)
Selleys (bssh fastq copy to BCLConvert InterOp QC)
Super (bssh fastq copy to cttsov2)