Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Dask-delayed raster subsample(), reproject() and interp_points() #537

Merged
merged 24 commits into from
May 22, 2024
Merged
Show file tree
Hide file tree
Changes from 15 commits
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
383c96b
Add delayed functions written in xDEM*
rhugonnet Apr 24, 2024
c2cdf8b
Add dask to environment
rhugonnet Apr 25, 2024
8d96c61
Fix tests
rhugonnet Apr 25, 2024
1d078a2
Linting all but mypy for now
rhugonnet Apr 25, 2024
57ad08d
Finalize tests
rhugonnet Apr 26, 2024
1dd508b
Clarify test description slightly more
rhugonnet Apr 26, 2024
03e370a
Add exceptions due to rasterio errors
rhugonnet Apr 26, 2024
fafd239
Linting
rhugonnet Apr 26, 2024
2e5b69f
The future is not here yet
rhugonnet Apr 26, 2024
7225f57
Linting
rhugonnet Apr 26, 2024
9e14160
Split output and memory tests and re-order them for speed
rhugonnet Apr 27, 2024
a635c13
Linting
rhugonnet Apr 27, 2024
a912734
Fix interp test for varying resolution by defining the coordinates
rhugonnet Apr 27, 2024
a50b9de
Linting
rhugonnet Apr 27, 2024
bd3469b
Remove small chunk memory usage check of interp_points
rhugonnet Apr 27, 2024
40b4236
Account for comments from amelie and amaury
rhugonnet Apr 30, 2024
f50083d
Linting
rhugonnet Apr 30, 2024
335f661
Merge remote-tracking branch 'upstream/main' into add_delayed_raster_…
rhugonnet May 6, 2024
a9fe770
Increase base memory usage to avoid random test failures
rhugonnet May 18, 2024
7c8e1db
feat: allowing boolean array in delayed_subsample
ameliefroessl May 21, 2024
893f46b
docs: add boolean note to delayed_subsample
ameliefroessl May 22, 2024
31c7f39
tests: add tests for boolean input array for delayed_subsample
ameliefroessl May 22, 2024
3fd3691
Merge pull request #9 from ameliefroessl/subsample_mask
rhugonnet May 22, 2024
431e8a3
Linting
rhugonnet May 22, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions dev-environment.yml
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@ dependencies:
- scipy=1.*
- tqdm
- xarray
- dask
- rioxarray=0.*

# Development-specific, to mirror manually in setup.cfg [options.extras_require].
Expand All @@ -27,6 +28,8 @@ dependencies:
- pyyaml
- flake8
- pylint
- netcdf4 # To write synthetic data with chunksizes
- dask-memusage

# Doc dependencies
- sphinx
Expand Down
1 change: 1 addition & 0 deletions environment.yml
Original file line number Diff line number Diff line change
Expand Up @@ -12,4 +12,5 @@ dependencies:
- scipy=1.*
- tqdm
- xarray
- dask
rhugonnet marked this conversation as resolved.
Show resolved Hide resolved
- rioxarray=0.*
777 changes: 777 additions & 0 deletions geoutils/raster/delayed.py

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -10,4 +10,5 @@ numpy==1.*
scipy==1.*
tqdm
xarray
dask
rioxarray==0.*
File renamed without changes.
672 changes: 672 additions & 0 deletions tests/test_raster/test_delayed.py

Large diffs are not rendered by default.

File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
Loading