Skip to content

Commit

Permalink
Merge pull request #489 from brucemoran/UCD_SONIC
Browse files Browse the repository at this point in the history
Ucd sonic
  • Loading branch information
jfy133 authored Aug 15, 2023
2 parents c9a2e3b + 2f45ca0 commit 93d866a
Show file tree
Hide file tree
Showing 5 changed files with 42 additions and 0 deletions.
1 change: 1 addition & 0 deletions .github/workflows/main.yml
Original file line number Diff line number Diff line change
Expand Up @@ -111,6 +111,7 @@ jobs:
- "tubingen_apg"
- "ucl_myriad"
- "uct_hpc"
- "ucd_sonic"
- "uge"
- "unibe_ibu"
- "uppmax"
Expand Down
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -164,6 +164,7 @@ Currently documentation is available for the following systems:
- [Super Computing Wales](docs/scw.md)
- [TIGEM](docs/tigem.md)
- [TUBINGEN_APG](docs/tubingen_apg.md)
- [UCD_SONIC](docs/ucd_sonic.md)
- [UCL_MYRIAD](docs/ucl_myriad.md)
- [UCT_HPC](docs/uct_hpc.md)
- [UGE](docs/uge.md)
Expand Down
22 changes: 22 additions & 0 deletions conf/ucd_sonic.config
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
params {
config_profile_name = 'UCD_SONIC'
config_profile_description = 'University College Dublin Sonic HPC profile provided by nf-core/configs.'
config_profile_contact = 'Bruce Moran (@brucemoran)'
config_profile_url = 'https://www.ucd.ie/itservices/ourservices/researchit/researchcomputing/sonichpc/'
max_cpus = 40
max_time = 12.h
}

process {
executor = 'slurm'
queue = 'shared'
queueSize = 50
submitRateLimit = '10 sec'
maxRetries = 2
beforeScript = 'export NXF_OPTS="-Xms2G -Xmx40G"; module load nextflow/22.04.5.5708 singularity/3.5.2'
clusterOptions = { "--mem 1M" }
cache = 'lenient'
memory = 1.MB
}

cleanup = true
17 changes: 17 additions & 0 deletions docs/ucd_sonic.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
# nf-core/configs: UCD Sonic Configuration

The nf-core pipeline [sarek](https://nf-co.re/sarek) has been successfully tested on [Sonic HPC] (https://www.ucd.ie/itservices/ourservices/researchit/researchcomputing/sonichpc) using this config.

This Sonic config offers very minimal options to users but should allow the use of all nf-core pipelines.

## sbatch_nxf_creator

To run a pipeline, you can optionally use the [sbatch_nxf_creator](https://github.com/brucemoran/sbatch_nxf_creator) method.

This allows you to write a YAML file including all of your sample names that you want to process individually, as well as your basic Nextflow command and where the output should be written.

There are some additional requirements on Sonic based on its use of SLURM which are resolved using this write this method.

The `sbatch_nxf_creator.sh` parses your YAML and makes an `sbatch` file that can be submitted to the scheduler via a simple `sbatch my_file.sbatch` command.

Practically, it means appending `srun` to the command and appending `-with-mpi`, as well as a few other vaguaries like specifying output and loading `Nextflow` and `Singularity`.
1 change: 1 addition & 0 deletions nfcore_custom.config
Original file line number Diff line number Diff line change
Expand Up @@ -91,6 +91,7 @@ profiles {
seg_globe { includeConfig "${params.custom_config_base}/conf/seg_globe.config"}
tigem { includeConfig "${params.custom_config_base}/conf/tigem.config"}
tubingen_apg { includeConfig "${params.custom_config_base}/conf/tubingen_apg.config" }
ucd_sonic { includeConfig "${params.custom_config_base}/conf/ucd_sonic.config"}
ucl_myriad { includeConfig "${params.custom_config_base}/conf/ucl_myriad.config"}
uct_hpc { includeConfig "${params.custom_config_base}/conf/uct_hpc.config" }
uge { includeConfig "${params.custom_config_base}/conf/uge.config" }
Expand Down

0 comments on commit 93d866a

Please sign in to comment.