Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove Adapt dependence, use ETOPO2022 dataset and regrid orography using SpaceVaryingInputs #3378

Merged
merged 1 commit into from
Oct 29, 2024

Conversation

akshaysridhar
Copy link
Member

No description provided.

@akshaysridhar akshaysridhar force-pushed the as/topo-spacevarutil branch 4 times, most recently from b5adf54 to 691e698 Compare October 10, 2024 17:50
@akshaysridhar
Copy link
Member Author

32x_Biharmonic_Orography 256x_Biharmonic_Orography Biharmonic_smoothing_0-256pass Laplacian_0-256pass

@Sbozzolo
Copy link
Member

Sbozzolo commented Oct 10, 2024

If is no longer needed, can also remove the gaussian_smooth, its tests, and the dependency on Distributions in test?

@szy21
Copy link
Member

szy21 commented Oct 10, 2024

Could you make the x-axis the same as the one in the NCAR paper? We can then compare the results more carefully.

@akshaysridhar akshaysridhar force-pushed the as/topo-spacevarutil branch 3 times, most recently from 9e868d3 to 2a44075 Compare October 11, 2024 16:28
@szy21 szy21 marked this pull request as ready for review October 14, 2024 18:30
@szy21 szy21 requested review from Sbozzolo and szy21 October 14, 2024 18:30
examples/topography_spectra.jl Show resolved Hide resolved
src/utils/AtmosArtifacts.jl Outdated Show resolved Hide resolved
src/utils/common_spaces.jl Outdated Show resolved Hide resolved
src/utils/common_spaces.jl Outdated Show resolved Hide resolved
src/utils/common_spaces.jl Outdated Show resolved Hide resolved
Copy link
Member

@szy21 szy21 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! Here are some comments. And I agree that some documentation would be helpful.

src/solver/type_getters.jl Outdated Show resolved Hide resolved
src/utils/common_spaces.jl Outdated Show resolved Hide resolved
examples/topography_spectra.jl Show resolved Hide resolved
@akshaysridhar akshaysridhar force-pushed the as/topo-spacevarutil branch 5 times, most recently from 8f1ea66 to 961018c Compare October 16, 2024 22:27
examples/Manifest.toml Outdated Show resolved Hide resolved
src/solver/type_getters.jl Outdated Show resolved Hide resolved
src/solver/type_getters.jl Outdated Show resolved Hide resolved
src/solver/type_getters.jl Outdated Show resolved Hide resolved
src/utils/common_spaces.jl Outdated Show resolved Hide resolved
src/solver/type_getters.jl Outdated Show resolved Hide resolved
@Sbozzolo
Copy link
Member

@akshaysridhar could also remove the ETOPO1 artifact as part of this pull request?

If it is still needed for tests, could you ensure that it is only downloaded in tests?

I think this is the only artifact left that ClimaCoupler has manually download, everything else is handled automatically.

@juliasloan25
Copy link
Member

Is this PR ready to merge?

@Sbozzolo
Copy link
Member

Thank you!

@akshaysridhar akshaysridhar force-pushed the as/topo-spacevarutil branch 5 times, most recently from 4c4b915 to 09264ed Compare October 25, 2024 17:04
@akshaysridhar
Copy link
Member Author

@Sbozzolo @szy21 compute hmax in the gravity wave parameterization is expensive with the new dataset (ci timeouts) so I added a simple downscaled array (Skip nth pt in data so array size is 3600x1800).

@szy21 szy21 requested a review from tapios October 25, 2024 17:44
@akshaysridhar akshaysridhar force-pushed the as/topo-spacevarutil branch 2 times, most recently from 15917e1 to db9f881 Compare October 25, 2024 18:31
examples/topography_spectra.jl Outdated Show resolved Hide resolved
examples/topography_spectra.jl Outdated Show resolved Hide resolved
examples/topography_spectra.jl Outdated Show resolved Hide resolved
examples/topography_spectra.jl Outdated Show resolved Hide resolved
examples/topography_spectra.jl Outdated Show resolved Hide resolved
examples/topography_spectra.jl Show resolved Hide resolved
src/utils/common_spaces.jl Outdated Show resolved Hide resolved
src/utils/common_spaces.jl Outdated Show resolved Hide resolved
@akshaysridhar akshaysridhar force-pushed the as/topo-spacevarutil branch 3 times, most recently from 832fc0b to 7c3598c Compare October 25, 2024 22:51
@Sbozzolo
Copy link
Member

Sbozzolo commented Oct 28, 2024

The failing tests are for the restart tests. integrator.p.precomputed.sfc_conditions.obukhov_length is found to be NaN.

What has changed with respect to this?

(Also, this PR can remove Adapt from the main Project.toml)

@akshaysridhar
Copy link
Member Author

akshaysridhar commented Oct 28, 2024

The failing tests are for the restart tests. integrator.p.precomputed.sfc_conditions.obukhov_length is found to be NaN.

What has changed with respect to this?

(Also, this PR can remove Adapt from the main Project.toml)

I do not expect changes in this PR to affect the surface_setup cache construction (longrun outputs are expected to vary since we are modifying topography smoothing parameters) - I've attempted to manually recreate this restart test with a longrun config setup; setting topography= "Earth", rad=nothing, turbconv=nothing to mimic the (failing) restart test config dict - this check runs successfully; perhaps we can take a look offline.

@szy21
Copy link
Member

szy21 commented Oct 28, 2024

Which one is the parameter / config that allows the user to choose damping factor? Or are you going to add it in the next PR?

@akshaysridhar
Copy link
Member Author

Which one is the parameter / config that allows the user to choose damping factor? Or are you going to add it in the next PR?

In this instance, there is a parameter n_attenuation ; the entire smoothing method should, in my opinion, be in ClimaCore which requires an additional package release + update so I want to get the artifact changes with a simple implementation into ClimaAtmos through this PR first.

@szy21
Copy link
Member

szy21 commented Oct 28, 2024

Which one is the parameter / config that allows the user to choose damping factor? Or are you going to add it in the next PR?

In this instance, there is a parameter n_attenuation ; the entire smoothing method should, in my opinion, be in ClimaCore which requires an additional package release + update so I want to get the artifact changes with a simple implementation into ClimaAtmos through this PR first.

But n_attenuation is hard coded and not in config yet? I'm fine with getting this in, just to make sure.

@akshaysridhar
Copy link
Member Author

Which one is the parameter / config that allows the user to choose damping factor? Or are you going to add it in the next PR?

In this instance, there is a parameter n_attenuation ; the entire smoothing method should, in my opinion, be in ClimaCore which requires an additional package release + update so I want to get the artifact changes with a simple implementation into ClimaAtmos through this PR first.

But n_attenuation is hard coded and not in config yet? I'm fine with getting this in, just to make sure.

Right, it is currently defined only within the common_spaces util

@akshaysridhar
Copy link
Member Author

Which one is the parameter / config that allows the user to choose damping factor? Or are you going to add it in the next PR?

In this instance, there is a parameter n_attenuation ; the entire smoothing method should, in my opinion, be in ClimaCore which requires an additional package release + update so I want to get the artifact changes with a simple implementation into ClimaAtmos through this PR first.

But n_attenuation is hard coded and not in config yet? I'm fine with getting this in, just to make sure.

Right, it is currently defined only within the common_spaces util

@szy21: With the restart check updated in this commit, I've also added the damping factor to the config arg list.

Replace interpolation op with
generalised spacevaryingutility tools.

Update orographic gravity wave file to use
new artifact. Downsample raw data for use
in parameterization (raw size 21600x10800 is too
large).

Bump ref counter and update news

Co-authored-by: Gabriele Bozzola <[email protected]>
@akshaysridhar akshaysridhar added this pull request to the merge queue Oct 29, 2024
Merged via the queue into main with commit c26e84f Oct 29, 2024
14 of 16 checks passed
@akshaysridhar akshaysridhar deleted the as/topo-spacevarutil branch October 29, 2024 23:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants