Upgrade CD pipeline

[jngrad]

Description of changes:

• update continuous delivery (CD) pipeline to download CI artifacts through the GitLab REST API
• properly document and install all required dependencies of the CD pipeline
  • the new Ubuntu 24.04 runner comes with fewer pre-installed depdendencies
• move action script to a self-contained shell script
  • simplify maintenance work with tools like shellcheck
• print fully expanded shell commands before executing them to help diagnose issues with cloud services

[RudolfWeeber]

LGTM, but could you pls add in some comments, e.g., where project id magic number comes form and what the jq calls do?

[jngrad]

project id magic number

That's the number associated with our GitLab espressomd/espresso repository. You can read this number from the project settings or in the drop-down menu that appears when clicking on the button with three black dots labeled "More actions". This is a unique number that even admins cannot modify. The uri projects/390 automatically redirects to the project.