You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The thawing steps is currently in its own distributed map - which waits for all thawing to finish (across all files). It then proceeds to the copy phase which is its own distributed map. This was done because the scale-out factor of the two are different (one is scaling out thousands of tiny lambdas to do thawing, the other is scaling out a limited set of fargate jobs).
We could consider refactoring this
so that objects that are already thawed can copy straight away
copies could immediately proceed after thawing without waiting for the slowest
The text was updated successfully, but these errors were encountered:
The thawing steps is currently in its own distributed map - which waits for all thawing to finish (across all files). It then proceeds to the copy phase which is its own distributed map. This was done because the scale-out factor of the two are different (one is scaling out thousands of tiny lambdas to do thawing, the other is scaling out a limited set of fargate jobs).
We could consider refactoring this
The text was updated successfully, but these errors were encountered: