Snakemake module

[FabianHofmann]

This change proposes to replace snakemake the subworkflow approach with a submodule approach. As discussed this is sill in the testing phase (CI will likely fail in the first iterations).

Closes # (if applicable).

Changes proposed in this Pull Request

Checklist

• I tested my contribution locally and it seems to work fine.
• Code and workflow changes are sufficiently documented.
• Newly introduced dependencies are added to envs/environment.yaml and envs/environment.docs.yaml.
• Changes in configuration options are added in all of config.default.yaml, config.tutorial.yaml, and test/config.test1.yaml.
• Changes in configuration options are also documented in doc/configtables/*.csv and line references are adjusted in doc/configuration.rst and doc/tutorial.rst.
• A note for the release notes doc/release_notes.rst is amended in the format of previous release notes, including reference to the requested PR.

[energyLS]

@FabianHofmann thanks for setting up the PR! Do you need any support, or is any review required yet? If so, just let me know.

[FabianHofmann]

Thank you @energyLS, I am still playing a little bit, but I am making good progress.

A short question regarding the log. Is there any way to suppress the quite verbose two outputs:

1. the progress bar like in https://github.com/pypsa-meets-earth/pypsa-earth-sec/actions/runs/10320381005/job/28570828550#step:8:199
2. the regular expression matches https://github.com/pypsa-meets-earth/pypsa-earth-sec/actions/runs/10320381005/job/28570828550#step:8:487

Looked a little but so far I could not find which rule triggers these logs.

[FabianHofmann]

@ekatef as you were having issues with the environment. In this PR, the CI for both Mac and Ubuntu is working. I think it is mainly because the CI uses micromamba which is faster and more stable as far as I experienced.

[ekatef]

@ekatef as you were having issues with the environment. In this PR, the CI for both Mac and Ubuntu is working. I think it is mainly because the CI uses micromamba which is faster and more stable as far as I experienced.

Hey @FabianHofmann, thanks for notifying! I'm still puzzled about the environment troubles for mac... We had an impression that the troubles are caused by a transition from conda 24.4 to conda 24.7 also in CI, but didn't find a way to fix it as far as having a restriction on conda version doesn't have much effect.

So, great news that the CI is working now which seems to be the case also with conda 24.7.1! Let's hope that this issue will just disappear also in other places [personally, I'd very much appreciate that! 🙃]

[FabianHofmann]

Yes, it can be a real pain sometimes... fingers crossed that this will resolve also in the long term :)