Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merge unify_projection and CF cache changes to master #609

Open
wants to merge 33 commits into
base: master
Choose a base branch
from
Open

Merge unify_projection and CF cache changes to master #609

wants to merge 33 commits into from
+213 −7

Commits on Oct 29, 2024

  1. Add unify_projection option, partially hardcoded MVP impl.

    @dmannarino
    dmannarino committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    6b12cab View commit details
    Browse the repository at this point in the history

  2. Whitespace breaks bash var assignments?

    @dmannarino
    dmannarino committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    ba4a1a2 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. Run unify projection step in parallel

    @dmannarino
    dmannarino committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    a5a5c8e View commit details
    Browse the repository at this point in the history

  2. Fix expansion of CMD_ARGS

    @dmannarino
    dmannarino committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    44540cb View commit details
    Browse the repository at this point in the history

  3. Fix count/src_count mistake; insert possibly unnecessary brackets

    @dmannarino
    dmannarino committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    a8b3d34 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. Echo commands for debugging; fix ref to wrong arg in helper

    @dmannarino
    dmannarino committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    16a2cff View commit details
    Browse the repository at this point in the history

  2. Fix counting srcs

    @dmannarino
    dmannarino committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    686c871 View commit details
    Browse the repository at this point in the history

  3. Switch to GDAL2TilesJob for access to awscli (installed in that conta… 

    …iner image)
    @dmannarino
    dmannarino committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    f8cafbd View commit details
    Browse the repository at this point in the history

  4. Bump GDAL container version for gsutils

    @dmannarino
    dmannarino committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    1b4dd60 View commit details
    Browse the repository at this point in the history

  5. Fix unify script by pre-making dirs

    @dmannarino
    dmannarino committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    92b7c96 View commit details
    Browse the repository at this point in the history

  6. Fix only 1st src being used, I think

    @dmannarino
    dmannarino committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    e311629 View commit details
    Browse the repository at this point in the history

  7. Allow for AWS source URIs

    @dmannarino
    dmannarino committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    8690d5c View commit details
    Browse the repository at this point in the history

  8. Removing time commands

    @dmannarino
    dmannarino committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    6bbb9d0 View commit details
    Browse the repository at this point in the history

  9. Change 'original' prefix to 'reprojected'

    @dmannarino
    dmannarino committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    59e46d7 View commit details
    Browse the repository at this point in the history

  10. Recursively pre-dl files

    @dmannarino
    dmannarino committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    5460f38 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2024

  1. Fix gsutil command; fix aws dl command to be recursive

    @dmannarino
    dmannarino committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    3455576 View commit details
    Browse the repository at this point in the history

  2. Set unify proj job to parent of pixetl job

    @dmannarino
    dmannarino committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    6e6838a View commit details
    Browse the repository at this point in the history

  3. Remove double parens

    @dmannarino
    dmannarino committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    18fc7c8 View commit details
    Browse the repository at this point in the history

  4. Remove ./ from paths

    @dmannarino
    dmannarino committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    71a3c2a View commit details
    Browse the repository at this point in the history

  5. Replace tree (not in image) with find

    @dmannarino
    dmannarino committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    d0c56d8 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2024

  1. Fix grabbing 5 args with xargs when should have grabbed 4

    @dmannarino
    dmannarino committed Nov 2, 2024
    Configuration menu
    Copy the full SHA
    10b7765 View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2024

  1. re-center TIFFs that cross the dateline

    @dmannarino
    dmannarino committed Nov 3, 2024
    Configuration menu
    Copy the full SHA
    6634b8f View commit details
    Browse the repository at this point in the history

  2. Possibly fix running _tiff_crosses_dateline.sh

    @dmannarino
    dmannarino committed Nov 3, 2024
    Configuration menu
    Copy the full SHA
    98f4816 View commit details
    Browse the repository at this point in the history

  3. Replace bc with Python; hopefully fix gdalwarp arg complaints

    @dmannarino
    dmannarino committed Nov 3, 2024
    Configuration menu
    Copy the full SHA
    e7614ae View commit details
    Browse the repository at this point in the history

  4. Fix prefix name (epsg:4326 -> epsg-4326) to be consistent

    @dmannarino
    dmannarino committed Nov 3, 2024
    Configuration menu
    Copy the full SHA
    459d90d View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2024

  1. Improve docs in response to Dan's PR comments

    @dmannarino
    dmannarino committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    c4b4a27 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' into add_unify_projection

    @dmannarino
    dmannarino authored Nov 5, 2024
    Configuration menu
    Copy the full SHA
    989c14f View commit details
    Browse the repository at this point in the history

  3. Merge pull request #601 from wri/add_unify_projection 

    Add option to pre-warp to a common projection
    @dmannarino
    dmannarino authored Nov 5, 2024
    Configuration menu
    Copy the full SHA
    4dc4186 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2024

  1. Fix copy/paste error

    @dmannarino
    dmannarino committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    036eab5 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2024

  1. Merge pull request #604 from wri/fix_xing_dateline 

    Fix copy/paste error
    @dmannarino
    dmannarino authored Nov 8, 2024
    Configuration menu
    Copy the full SHA
    e446480 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2024

  1. clear cloudfront caches

    @solomon-negusse
    solomon-negusse committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    a009eab View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2024

  1. Merge pull request #605 from wri/clear-cog-tile-caches 

    clear cloudfront caches
    @solomon-negusse
    solomon-negusse authored Nov 12, 2024
    Configuration menu
    Copy the full SHA
    f4f0929 View commit details
    Browse the repository at this point in the history

Commits on Nov 25, 2024

  1. Merge unify_projection and CF cache changes to master 

    Merge Daniel's unify_projection change (with type fix) and
Solomon's clear cloudfront cache for COGs.
    @danscales
    danscales committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    9f57856 View commit details
    Browse the repository at this point in the history