S3FS slows down Docker build

[jtherrmann]

Jira: https://asfdaac.atlassian.net/browse/TOOL-3333

Note: The above link is accessible only to members of ASF.

---

The s3fs dependency adds about 15 min to the time it takes to solve the mamba environment when building the Docker container (timed on my t3.2xlarge EC2 instance). Without this dependency it builds very quickly.

This may be due to s3fs using strict version pinning for its own dependencies, and/or due to the particular combination of dependencies in our environment file. We haven't investigated to determine which part of the dependency graph is taking the longest time to solve.

A possible solution is to use a lock file tool such as conda-lock or pixi.

Another possibility is to abandon direct S3 access, but we haven't determined how much of a performance impact that would have. We're using s3fs to only load the parts of the file that we need, rather than downloading the entire file.

[jtherrmann]

No longer seeing this issue for https://github.com/ASFHyP3/OPERA-DISP-TMS/actions/workflows/test-and-build.yml or when creating the mamba env locally.