Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GPU offloading #2

Draft
wants to merge 126 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from 118 commits
Commits
Show all changes
126 commits
Select commit Hold shift + click to select a range
95a021d
Wrap from_abaqus routines.
Apr 8, 2024
178ec18
Implement geometry data transfer from t8code to Trixi.
Apr 8, 2024
0fed965
Updated examples.
Apr 8, 2024
c50b434
Fixed typos.
Apr 8, 2024
5e18656
Applied formatter.
Apr 8, 2024
c388a94
Merge branch 'main' into feature-t8code-curved-geometry
Apr 8, 2024
3bb6292
cubed sphere test case, copied from p4est
benegee Mar 13, 2024
abbf702
add baroclinic instability (copy of p4est)
benegee Mar 27, 2024
5fa48e8
add cubed sphere constructor
benegee Apr 9, 2024
cd27998
Fix indentation.
Apr 19, 2024
f6653b0
Fix indentation.
Apr 19, 2024
aa4d0d4
Switching off formatter in two files.
Apr 19, 2024
f331a87
Merge branch 'feature-t8code-curved-geometry' of github.com:trixi-fra…
Apr 19, 2024
40cbb86
Upgrading T8code.jl.
Apr 19, 2024
ff964cc
Merge branch 'main' into feature-t8code-curved-geometry
Apr 19, 2024
df77f82
Fixed examples.
Apr 19, 2024
b80f890
stress different meaning of first argument
benegee Apr 22, 2024
c46799b
use lat lon levels
benegee Apr 22, 2024
e3c2492
add t8code cubed sphere tests
benegee Apr 22, 2024
544b10d
Merge branch 'main' into feature-t8code-curved-geometry
jmark Apr 25, 2024
7af3f31
Remove TODO comments
benegee Apr 25, 2024
6d835e3
Relaxing T8code.jl version requirement.
Apr 26, 2024
fe298b5
Merge branch 'main' into feature-t8code-curved-geometry
jmark Apr 26, 2024
54a5ec3
Restricted t8code version requirement.
Apr 26, 2024
1daec4b
Removed cubed spherical shell related code.
Apr 26, 2024
5c5ccc6
Merge branch 'feature-t8code-curved-geometry' of github.com:trixi-fra…
Apr 26, 2024
120af75
Removed cubed spherical shell tests.
Apr 26, 2024
e93ebeb
Including cubed spherical shell setup.
Apr 26, 2024
ae141d5
Modified GH ci such that it uses the latest T8code.jl package.
Apr 26, 2024
1d0d3f5
Included cubed spherical shell setups and tests.
Apr 26, 2024
36e9ba9
Switching order of CI steps.
Apr 26, 2024
171a43c
Changed line in CI.
Apr 26, 2024
4317d5e
Increasing code coverage.
Apr 26, 2024
071d65c
Merge branch 'main' into feature-t8code-curved-geometry
jmark Apr 30, 2024
4b5694d
Increasing code coverage.
Apr 30, 2024
48082e6
Further increasing code coverage.
Apr 30, 2024
18d28b7
Merge branch 'feature-t8code-curved-geometry' of github.com:trixi-fra…
Apr 30, 2024
bb4793c
Merge branch 'feature-t8code-curved-geometry' into feature-t8code-cub…
Apr 30, 2024
66ee1eb
Re-introduced tests.
Apr 30, 2024
b9b79a2
Removed workaround in github workflow.
Apr 30, 2024
e3be166
Applied formatter.
Apr 30, 2024
c85c8cf
Merge branch 'main' into feature-t8code-cubed-sphere-setup
jmark May 2, 2024
8c562f0
Merge branch 'main' into feature-t8code-cubed-sphere-setup
benegee May 13, 2024
95ec84f
adapt to merged t8code PR
benegee May 13, 2024
2e92ebc
missed calling constructor
benegee May 14, 2024
6e79f51
Merge branch 'main' into feature-t8code-cubed-sphere-setup
May 28, 2024
cd441b9
Merge branch 'feature-t8code-cubed-sphere-setup' of github.com:trixi-…
May 28, 2024
8120409
Backup.
Jun 13, 2024
3ad3515
Add save callback to elixir.
Jun 14, 2024
6e90adf
Merge branch 'main' into feature-t8codemesh-checkpointing
Jun 17, 2024
23714f1
Backup.
Jun 18, 2024
3f8ded2
Refined code. Make it work in parallel.
Jun 19, 2024
2f5d224
Added support for parallelt8codemesh save solution callback.
Jun 19, 2024
d3a1b49
Applied formatter.
Jun 19, 2024
9ef91c6
Updated examples and tests.
Jun 20, 2024
7c80560
Merge branch 'main' into feature-t8codemesh-checkpointing
Jun 20, 2024
2f96869
Applied formatter.
Jun 20, 2024
df2bdf4
Minor adjustments.
Jun 21, 2024
7ee23b6
Code refinement. Enabled partitioning after mesh loading.
Jun 24, 2024
0404f3b
Applied formatter and fixed typos.
Jun 24, 2024
03d0194
Merge branch 'main' into feature-t8codemesh-checkpointing
jmark Jun 24, 2024
99972cc
Removed commented out section.
Jun 24, 2024
f59322c
Added missing union type member.
Jun 24, 2024
e9fc20f
Merge branch 'feature-t8codemesh-checkpointing' into feature-t8code-c…
benegee Jun 25, 2024
be2fcdd
Switching from UInt64 to UInt128 in global interface/mortar id comput…
Jun 26, 2024
0283428
Switching from UInt64 to UInt128 in global interface/mortar id comput…
Jun 26, 2024
db9d4c6
Adding more tests.
Jun 26, 2024
b6e1333
Applied formatter.
Jun 26, 2024
36c7517
Merge branch 'main' into feature-t8codemesh-checkpointing
jmark Jun 26, 2024
1aea5cd
Removed Printf.
Jun 26, 2024
dae7aaa
Merge branch 'main' into feature-t8codemesh-checkpointing
jmark Jun 28, 2024
b603823
Incorporated review comments and code polish.
Jun 28, 2024
6ef17a4
Applied formatter.
Jun 28, 2024
69b7ac1
Fixed typos.
Jun 28, 2024
ad0fba1
Merge branch 'main' into feature-t8codemesh-checkpointing
jmark Jul 1, 2024
e03f57d
Merge branch 'main' into feature-t8codemesh-checkpointing
jmark Jul 1, 2024
9fc72c4
Merge branch 'main' into feature-t8codemesh-checkpointing
JoshuaLampert Jul 2, 2024
f42fff1
Introduce Enum for encoding surface indexing
lchristm Jul 2, 2024
87dd7b4
Support `adapt` for SemiHyperbolic based on P4estMesh
lchristm Jul 2, 2024
a686f43
Implement basic 3D GPU kernels including MPI communication
lchristm Jul 2, 2024
e65b1a5
Merge branch 'main' into feature-t8codemesh-checkpointing
ranocha Jul 2, 2024
3bbd3a1
Update examples/t8code_2d_dgsem/elixir_advection_restart.jl
jmark Jul 2, 2024
ab9c33f
Update examples/t8code_2d_dgsem/elixir_advection_restart_amr.jl
jmark Jul 2, 2024
9e49219
Update examples/t8code_3d_dgsem/elixir_advection_restart.jl
jmark Jul 2, 2024
677236f
Update src/meshes/mesh_io.jl
jmark Jul 2, 2024
6396931
Merge branch 'main' into feature-t8codemesh-checkpointing
jmark Jul 2, 2024
404fc85
Update examples/t8code_3d_dgsem/elixir_advection_restart.jl
jmark Jul 4, 2024
611a576
Update src/meshes/t8code_mesh.jl
jmark Jul 4, 2024
c8c5c20
Merge branch 'main' into feature-t8codemesh-checkpointing
jmark Jul 4, 2024
7161d1b
Update src/meshes/t8code_mesh.jl
jmark Jul 4, 2024
15cdc0b
Removing last test in t8code 2D MPI to investigate problems in Github…
Jul 5, 2024
de00b40
Merge branch 'main' into feature-t8codemesh-checkpointing
jmark Jul 8, 2024
971d2cf
Refactored a bit.
Jul 8, 2024
a3c169c
Applied formatter.
Jul 8, 2024
6383520
Removed commented code.
Jul 8, 2024
41ebc07
Added LOG_LEVEL variable.
Jul 9, 2024
e268b33
Added t8code interface simplfication and stitched memory leak.
Jul 9, 2024
0ef1d55
Merge branch 'main' into feature-t8codemesh-checkpointing
jmark Jul 9, 2024
1e00cb6
Applied formatter.
Jul 9, 2024
8493c8e
Simplifying finailze behavior for T8codeMesh.
Jul 22, 2024
2d4bfb3
Addeing finalize call to T8codeMesh examples.
Jul 22, 2024
a102101
Merge branch 'main' into feature-t8codemesh-checkpointing
jmark Jul 22, 2024
573133a
Applied formatter.
Jul 22, 2024
9439636
Merge branch 'feature-t8codemesh-checkpointing' into feature-t8code-c…
benegee Jul 25, 2024
7adc5d4
Merge branch 'main' into lc/gpu-develop
benegee Aug 22, 2024
2393f83
use Base.min/max in MPI.Allreduce
benegee Aug 22, 2024
6607023
ParaviewCatalyst callback working except PlotData3D
s6nistam Sep 23, 2024
438e232
Merge branch 'main' into feature-t8codemesh-checkpointing
benegee Oct 14, 2024
c5cdf8a
Merge branch 'feature-t8codemesh-checkpointing' into feature-t8code-c…
benegee Oct 14, 2024
d347949
Merge /home/bene/trixi/Trixi.jl
benegee Oct 15, 2024
7266ac7
Merge branch 'main' into lc/gpu-develop
benegee Oct 15, 2024
1b9a2b1
relax compat bounds to enable current CUDA
benegee Oct 18, 2024
c8bba9b
skip failing precompile commands
benegee Oct 18, 2024
a82608f
Merge branch 'main' into lc/gpu-develop
benegee Nov 18, 2024
33903d9
Revert "ParaviewCatalyst callback working except PlotData3D"
benegee Nov 18, 2024
d942046
Merge branch 'main' into lc/gpu-develop
benegee Dec 16, 2024
9c857e4
edit folder for esiwace project
benegee Dec 17, 2024
fd5831e
current julia project
Dec 17, 2024
25eb795
new T8code version
benegee Dec 17, 2024
d6d946f
manual update for latest merge
benegee Dec 17, 2024
4a978a5
update README
benegee Dec 18, 2024
20e3174
Merge branch 'lc/gpu-develop' of github.com:benegee/Trixi.jl into lc/…
benegee Dec 18, 2024
fce3af0
same with prolong2mpimortars!
benegee Dec 18, 2024
6f3286a
output UUIDs of GPUs
benegee Dec 19, 2024
bdb8ab5
revised setup
benegee Dec 19, 2024
5629733
updated esiwace docs
benegee Dec 19, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 7 additions & 5 deletions Project.toml
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@ authors = ["Michael Schlottke-Lakemper <[email protected]>", "Gregor
version = "0.9.12-DEV"

[deps]
Adapt = "79e6a3ab-5dfb-504d-930d-738a2a938a0e"
Accessors = "7d9f7c33-5ae7-4f3b-8dc6-eff91059b697"
CodeTracking = "da1fd8a2-8d9e-5ec2-8556-3022fb5608a2"
ConstructionBase = "187b0558-2788-49d3-abe0-74a17ed4e7c9"
Expand All @@ -17,6 +18,7 @@ FillArrays = "1a297f60-69ca-5386-bcde-b61e274b549b"
ForwardDiff = "f6369f11-7733-5829-9624-2563aa707210"
HDF5 = "f67ccb44-e63f-5c2f-98bd-6dc0ccc4ba2f"
IfElse = "615f187c-cbe4-4ef1-ba3b-2fcf58d6d173"
KernelAbstractions = "63c18a36-062a-441e-b654-da1e3ab1ce7c"
LinearAlgebra = "37e2e46d-f89d-539d-b4ee-838fcccc9c8e"
LinearMaps = "7a12625a-238d-50fd-b39a-03d52299707e"
LoopVectorization = "bdcacae8-1622-11e9-2a5c-532679323890"
Expand All @@ -30,7 +32,6 @@ PrecompileTools = "aea7be01-6a6a-4083-8856-8a6e6704d82a"
Preferences = "21216c6a-2e73-6563-6e65-726566657250"
Printf = "de0858da-6303-5e67-8744-51eddeeeb8d7"
RecipesBase = "3cdcf5f2-1ef4-517c-9805-6587b60abb01"
RecursiveArrayTools = "731186ca-8d62-57ce-b412-fbd966d074cd"
Reexport = "189a3867-3050-52da-a836-e630ba90ab69"
Requires = "ae029012-a4dd-5104-9daa-d747884805df"
SciMLBase = "0bca4576-84f4-4d90-8ffe-ffa030f20462"
Expand Down Expand Up @@ -64,21 +65,23 @@ TrixiMakieExt = "Makie"
TrixiNLsolveExt = "NLsolve"

[compat]
Adapt = "3.7, 4.0"
Accessors = "0.1.12"
CodeTracking = "1.0.5"
ConstructionBase = "1.3"
Convex = "0.16"
DataStructures = "0.18.15"
DelimitedFiles = "1"
DiffEqBase = "6 - 6.143"
DiffEqCallbacks = "2.25"
DiffEqBase = "6"
DiffEqCallbacks = "2.25, 3, 4"
Downloads = "1.6"
ECOS = "1.1.2"
EllipsisNotation = "1.0"
FillArrays = "0.13.2, 1"
ForwardDiff = "0.10.24"
HDF5 = "0.16.10, 0.17"
IfElse = "0.1"
KernelAbstractions = "0.9"
LinearAlgebra = "1"
LinearMaps = "2.7, 3.0"
LoopVectorization = "0.12.151"
Expand All @@ -94,15 +97,14 @@ PrecompileTools = "1.1"
Preferences = "1.3"
Printf = "1"
RecipesBase = "1.1"
RecursiveArrayTools = "2.38.10"
Reexport = "1.0"
Requires = "1.1"
SciMLBase = "1.90, 2"
SimpleUnPack = "1.1"
SparseArrays = "1"
StableRNGs = "1.0.2"
StartUpDG = "0.17.7, 1.1.5"
Static = "0.8.7"
Static = "0.8.7, 1"
StaticArrayInterface = "1.4"
StaticArrays = "1.5"
StrideArrays = "0.1.26"
Expand Down
30 changes: 30 additions & 0 deletions esiwace/LocalPreferences.toml
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
[CUDA_Runtime_jll]
local = "true"
version = "12.6"

[HDF5]
libhdf5 = "/dss/lrzsys/sys/spack/release/22.2.1/opt/icelake/hdf5/1.10.7-gcc-dgmcmi4/lib/libhdf5.so"
libhdf5_hl = "/dss/lrzsys/sys/spack/release/22.2.1/opt/icelake/hdf5/1.10.7-gcc-dgmcmi4/lib/libhdf5_hl.so"

[HDF5_jll]
libhdf5_hl_path = "/dss/lrzsys/sys/spack/release/22.2.1/opt/icelake/hdf5/1.10.7-gcc-dgmcmi4/lib/libhdf5_hl.so"
libhdf5_path = "/dss/lrzsys/sys/spack/release/22.2.1/opt/icelake/hdf5/1.10.7-gcc-dgmcmi4/lib/libhdf5.so"

[MPIPreferences]
__clear__ = ["preloads_env_switch"]
_format = "1.0"
abi = "OpenMPI"
binary = "system"
cclibs = []
libmpi = "libmpi"
mpiexec = "srun"
preloads = []

[P4est]
libp4est = "/dss/dsstbyfs02/scratch/07/di38qiw/install/t8code/lib/libp4est.so"
libsc = "/dss/dsstbyfs02/scratch/07/di38qiw/install/t8code/lib/libsc.so"

[T8code]
libp4est = "/dss/dsstbyfs02/scratch/07/di38qiw/install/t8code/lib/libp4est.so"
libsc = "/dss/dsstbyfs02/scratch/07/di38qiw/install/t8code/lib/libsc.so"
libt8 = "/dss/dsstbyfs02/scratch/07/di38qiw/install/t8code/lib/libt8.so"
Loading
Loading