🚀 Pre-release master -> staging_Eisbock3

[pcrespov]

What kind of pre-release?

master branch

Sprint Name

staging_Eisbock

Pre-release version

3

Commit SHA

dc0d182a0b9328cfdd992b92b75943db9701f93e

Planned date

Tue. Sep 4, 2024

Did the commit CI suceeded?

• The commit CI succeeded.

Motivation

• Weekly release to staging
• Waiting for 🐛 Fix: file uploads due to bad path encoding 🚨 #6287

What Changed

• ♻️ Maintenance: Fixes mypy in api-server #6175 by @pcrespov
• ✨dynamic-sidecar now logs into DockerHub (⚠️devops) #6081 by @GitHK
• ♻️Mypy: webserver #6193 by @sanderegg
• ✨AWS library: add start instance method #6159 by @sanderegg
• 🐛 fix services:access endpoint for product group #6213 by @matusdrobuliak66
• ♻️Mypy: webserver2 #6200 by @sanderegg
• ♻️ [Frontend] Retire PUT /study #6211 by @odeimaiz
• 🐛 [Frontend] Fix App mode: Wait until the workbench is deserialized to start #6214 by @odeimaiz
• ♻️ web-api: Updated catalog interface and drafted performance test for pagination #6189 by @pcrespov
• 🐛 fixes broken test in servicelib + code deprecation #6216 by @GitHK
• ♻️ folder_utils is now compatible with user #6148 by @GitHK
• 🎨 [Frontend] Improve blocked card's UX #6207 by @odeimaiz
• 🐛 [Frontend] Fix: reload Share with... list after updating access rights #6218 by @odeimaiz
• ⬆️ Maintenance/upgrade tools&tests requirements #6173 by @pcrespov
• ✨Autoscaling: Start using EBS-based EC2 buffers 🚨 #6143 by @sanderegg
• 🐛 [Frontend] Fix: List grouped tagged templates #6223 by @odeimaiz
• 📝 revision of release template #6226 by @matusdrobuliak66
• 🎨 Improving servicelib.logging_utils #6224 by @pcrespov
• ⬆️ Upgrade to Python 3.11 #6186 by @giancarloromeo
• ⚗️🙈 Don't gitignore the .python-version file (pyenv) #6228 by @mrnicegyu11
• 🐛Autoscaling in computational clusters could not start without SSM parameters  #6229 by @sanderegg
• 🐛 catalog: fixes access-rights to get and update services #6099 by @pcrespov
• 🐛 [Frontend] Minor fixes: File Picker Reset, Node Editor Close, Selection Management, Button Alignment #6219 by @odeimaiz
• ✨ Touch screen support #6178 by @jsaq007
• 🎨 [Frontend] Request Account form for oSPARC 🚨 ⚠️ DEVOPS #6217 by @odeimaiz
• 🎨Autoscaling: chunk prepulled image AWS EC2 tags #6232 by @sanderegg
• ♻️ Preparation of tags for both services and projects 🗃️ #6092 by @pcrespov
• 🎨 [e2e] Start from template playwright test #6225 by @odeimaiz
• ⬆️ Upgrade to traefik v3 (2nd trial) #6190 by @mrnicegyu11
• 🐛⚗️: Traefik V3 syntax fixes #6257 by @mrnicegyu11
• 🐛Autoscaling: Cluster gauges not reset correctly, too many buffer created, log improvements #6256 by @sanderegg
• 🎨 [Frontend] Logger UX improvements #6222 by @odeimaiz
• 🐛 [Frontend] Reopening running study breaks the connections #6259 by @odeimaiz
• 🐛🎨 [Frontend] UI/UX: Study updates #6262 by @odeimaiz
• 🐛 Fix wrong go-style UUID regexp - made portal links fail #6268 by @mrnicegyu11
• Revert "🐛 Fix wrong go-style UUID regexp - made portal links fail (#6268)" #6269 by @mrnicegyu11
• 🐛Traefik: partially revert changes #6270 by @sanderegg
• ✨Autoscaling: add buffer metrics #6260 by @sanderegg
• 🐛Traefik v3: adapt Go regexp (2nd trial) #6273 by @sanderegg
• ♻️ api-server: openapi docs and versioning #6264 by @pcrespov
• 🐛Traefikv3: Use v3 regexp syntax #6275 by @sanderegg
• 🐛Traefik v3: replace v2 regexp with v3 regexp #6277 by @sanderegg
• Add pylint check for Python 3.12 #6265 by @giancarloromeo
• 🐛 [Frontend] Fix: unlink port #6284 by @odeimaiz
• ✨Autoscaling monitoring tool: make compatible with non-billable deploys #6285 by @sanderegg
• 🐛Storage: Copying returns wrong size #6272 by @sanderegg
• Bump micromatch from 4.0.7 to 4.0.8 in /tests/e2e in the npm_and_yarn group across 1 directory #6271 by @dependabot
• 🐛 Fix: file uploads due to bad path encoding 🚨 #6287 by @pcrespov
• 🐛 More than 1 input port containing files can be safely pulled #6286 by @GitHK
• Favicon for 16 and 32 fix #6291 by @jsaq007
• ✨ webapi: new descriptionUI flag to render service a single page UI 🗃️ #6290 by @pcrespov
• 🐛Computational backend: if a pipeline raises, it should not prevent handling of other pipelines #6295 by @sanderegg
• 🐛Autoscaling: SSM client key error fix #6299 by @sanderegg
• 🎨 Backend part of UX improvements #6297 by @sanderegg

Devops check ⚠️ devops

e2e testing check 🧪

No response

Summary 📝

• make release-staging name=<sprint_name> version=<version> git_sha=<commit_sha>
  • https://github.com/ITISFoundation/osparc-simcore/releases/new?prerelease=1&target=<commit_sha>&tag=staging_<sprint_name><version>&title=Staging%20<sprint_name><version>
• Draft pre-release
• Announce (add redis key maintenance in every concerned deployment)

  {"start": "2024-09-04T11:30:00.000Z", "end": "2024-09-04T15:00:00.000Z", "reason": "Release staging_Eisbock3 "}

• Announce release in Mattermost

  :loud_sound:  Maintenance scheduled for **NAMED_DAY DD. MM from START_TIME - END_TIME**.
  =========================================================================
  
  @all Be aware that you will automatically be logged out and your projects stopped and saved during the maintenance time. Affected:
  *   [https://staging.osparc.io](https://staging.osparc.io/)
  *   [https://https://staging.s4l-lite.io/](https://https://staging.s4l-lite.io//)
  
  and on premises:
  *   [https://osparc-staging.speag.com](https://osparc-staging.speag.com/)
  *   [https://tip-staging.speag.com](https://tip-staging.speag.com/)
  *   [https://s4l-staging.speag.com](https://s4l-staging.speag.com/)
  *   [https://s4l-lite-staging.speag.com](https://s4l-lite-staging.speag.com/)
  
  
  Reason: Scheduled staging-release of STAGING_NAME_AND_VERSION.
  
  Thanks for your understanding and sorry for the inconveniences,
  
  Your friendly oSparc Team
  
  

Releasing

• Release (release draft)
• Check Release CI
• Check hanging sidecars. Helper command to run in director-v2 CLI simcore-service-director-v2 close-and-save-service <uuid>
• Check deployed
  • aws deploy
  • dalco deploy
• Delete announcement
• Check e2e runs
• Announce

https://github.com/ITISFoundation/osparc-simcore/releases/tag/staging_<sprint_name><version>

[YuryHrytsuk]

Issues encountered

Dalco staging:

• simcore services: traefik, rabbit and dask-scheduler has wrong middleware names (@swarm instead of@docker)
  • The reason is we still use Traefik v2 on dalco stag. After renaming middlewares mentioned from swarm to docker) it works
  • ⚠️ action required until we release Traefik v3 to PROD
  • fyi @mrnicegyu11 @matusdrobuliak66