sim4life.io - WP5: Dynamic services backend

[mguidon]

Description

Interactive services that require real-time user interaction are powered by the dynamic sidecar. Ensuring that the sidecar is both stable and efficient is paramount to providing a good user experience. With that in mind, we have devoted considerable resources to refining and optimizing the design of the sidecar, and we will continue to do so as we roll out new features and capabilities.

Handling large files is another area where we have placed a strong focus. The sidecar is designed to efficiently manage the transfer of large files, ensuring that users can work with data sets in the 100s of GBs with ease.

We will also extend the sidecar API to include features such as the injection of environment variables and files, providing greater flexibility and customizability to our users. Additionally, users will be able to select the hardware on which the sidecar runs directly from the dashboard, ensuring they have the resources they need to get the job done.

Tasks

Beta Give feedback

1. Closing new style services behaves slightly differently osparc-simcore#4909
   bug +1
   
2. Allow to cancel starting a service when there is no resource available osparc-simcore#4464
   a:frontend a:sidecar +2
   
3. Migrate projects where override service specifications are necessary osparc-simcore#4468
   2 of 4
   a:infra+ops +1
   
4. Make director-v2 scalable/restartable osparc-simcore#4524
   2 of 3
   a:director-v2 t:maintenance +2
   
5. improving dynamic-sidecar design #638
   9 of 15
   Epic PO issue +2
   
6. personalizable resource limits #618
   2 of 4
   Epic PO issue +2
   
7. Depending on selected pricing unit/service resources, a subcontainer shall scale to the available resources osparc-simcore#4960
   +0
   
8. Dynamic backend: large machine type being drained may replace buffer machine of a different type osparc-simcore#5453
   a:autoscaling +1
   
9. Ports fail to upload with the new design #1222
   Feedback type:bug +2
   

Schoggilebe

Beta Give feedback

1. Spurious premature shutdown of services osparc-simcore#5100
   High Priority a:director-v2 bug +3
   
2. Service state driven by the backend #1175
   +0
   
3. Cannot open saved project #1263
   +0
   

   
4. Sidecar cannot reach storage #1264
   +0
   

   
5. Slow starting time compared with lite #1262
   3 of 3
   +0
   
6. Fix progress report when starting sim4life on a fresh machine with pre-pulling osparc-simcore#5395
   1 of 1
   bug +1
   

This is Sparta!

Beta Give feedback

1. Dynamic services: Due to issues in docker >20.x VRAM generic resource may have to be used differently osparc-simcore#5250
   0 of 2
   High Priority a:director-v2 a:infra+ops t:enhancement +4
   

   

Kobayahsi Maru

Beta Give feedback

1. Logs are sometimes missing from autoscaled machines [DK, YH] #1221
   +0
   
2. Autoscaling based on selected machines #1055
   6 of 6
   a:sidecar +1
   
3. 🐛Hotfix: Dynamic-backend shall work even if resources were initially empty osparc-simcore#5205
   a:webserver +1
   
4. Dynamic autoscaler can go in infinite creation loop osparc-simcore#5071
   a:autoscaling bug +2
   
5. ✨Dynamic backend: Allow the use of EC2 instance types and properly fuse their resources osparc-simcore#5189
   a:director-v2 a:webserver +2
   
6. 🐛Dynamic scheduler is using the wrong information for hardware info osparc-simcore#5196
   a:director-v2 +1
   
7. ⚗️Dynamic backend: need more CPUs for dy-proxy osparc-simcore#5197
   a:webserver +1
   

Microshistory

Beta Give feedback

1. User based system wide service preferences #954
   3 of 3
   a:sidecar +1
   
2. Pass deployment variables to service containers osparc-simcore#3565
   6 of 6
   t:enhancement +1
   
3. Fuse pricing units and service resources osparc-simcore#4958
   1 of 1
   a:dask-service a:director-v2 a:dynamic-sidecar a:webserver +4
   

   
4. S3TransferError 400 BadRequest with reason RequestTimeout osparc-simcore#3531
   a:dynamic-sidecar bug t:maintenance +3
   

Quilmes

Beta Give feedback

1. expose metrics for user services #1059
   +0
   
2. custom hooks for user services cli entrypoints #1060
   +0
   

Baklava

Beta Give feedback

No tasks being tracked yet.

Sundae

Beta Give feedback

1. Sidecar: disable state zipping @GitHK osparc-simcore#4351
   6 of 6
   a:dynamic-sidecar +1
   

Watermelon

Beta Give feedback

1. Define folders in Storage osparc-simcore#3033
   a:storage t:enhancement +2
   

Pastel de Nata

Beta Give feedback

1. ✨ Add volume size limits for user services osparc-simcore#3812
   changelog:✨new-feature +1
   

[GitHK]

Update on sprint Pastel de Nata

Done:

• ✨ Add volume size limits for user services  osparc-simcore#3812

[mguidon]

Update Watermelon

Done:

• Personalized-resource-limits: User can now select desired resource requirements to run computational and dynamic services

Ongoing:

• Define folders in Storage osparc-simcore#3033
• Sidecar: disable state zipping @GitHK osparc-simcore#4351

[GitHK]

Update Sundae

Done:

• Define folders in Storage osparc-simcore#3033
• Sidecar: disable state zipping @GitHK osparc-simcore#4351

[GitHK]

Update Quilmes

Done:

• expose metrics for user services #1059
• custom hooks for user services cli entrypoints #1060

Ongoing:

• User based system wide service preferences #954
• Pass deployment variables to service containers osparc-simcore#3565

[GitHK]

Update [Microhistory]

Done and working

• replace osparc identifiers inside compose spec
• user preferences for fronted and user services are driven by the backend
• autoscaling based on selected machines (I think this should be considered done, MaG ask SAN)

should work in 3 weeks

• API keys need to be provided created and removed each time a service si started and closed
• upon reaching 0 credits services (computational and dynamic) are killed. Only part missing here is pushing the status of the dynamic services via the backend and no longer polled by the frontend

should not be available in 3 weeks

• all known bugs that are pending since long ago
• mounting filesystem(s)