Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problem installing with spack when ROCBLAS buildable is False #2349

Open
Rombur opened this issue Sep 30, 2024 · 1 comment
Open

Problem installing with spack when ROCBLAS buildable is False #2349

Rombur opened this issue Sep 30, 2024 · 1 comment

Comments

@Rombur
Copy link
Member

Rombur commented Sep 30, 2024

I am trying to install Kokkos-Kernels 4.4.01 using spack and I want Kokkos-Kernels to use the version of ROCBLAS that's already installed on the machine. In my packages.yml, I have:

packages: 
  hip:
    externals:
      - spec: "[email protected] arch=linux-sles15-zen" 
        prefix: /opt/rocm-6.0.0
    buildable: False
  hsa-rocr-dev:
    externals: 
      - spec: "[email protected] arch=linux-sles15-zen"
        prefix: /opt/rocm-6.0.0
    buildable: False
  llvm-amdgpu:
    externals:
      - spec: "[email protected] arch=linux-sles15-zen"
        prefix: /opt/rocm-6.0.0/llvm
    buildable: False
  rocblas:
    externals:
      - spec: "[email protected] arch=linux-sles15-zen"
        prefix: /opt/rocm-6.0.0
    buildable: False

I use the following command:

spack install --reuse [email protected] +rocblas ^[email protected]+rocm amdgpu_target=gfx90a

I get the error:

     22    -- Found Kokkos version 4.4.1 at /autofs/nccs-svm1_proj/ums018/spack/opt/spack/linux-sles15-zen/gcc-7.5.0/kokkos-4.4.01-63qwbybeixbzvgmnazmfutpeb2rochuv/lib64/cmake/Kokkos
  >> 23    CMake Error at /autofs/nccs-svm1_proj/ums018/spack/opt/spack/linux-sles15-zen/gcc-7.5.0/cmake-3.27.9-svbkijtxp3hdgjsyb6gjsqbgjarnaty2/share/cmake-3.27/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
     24      Could NOT find TPLROCBLAS (missing: ROCBLAS_INCLUDE_DIRS)
     25    Call Stack (most recent call first):
     26      /autofs/nccs-svm1_proj/ums018/spack/opt/spack/linux-sles15-zen/gcc-7.5.0/cmake-3.27.9-svbkijtxp3hdgjsyb6gjsqbgjarnaty2/share/cmake-3.27/Modules/FindPackageHandleStandardArgs.cmake:600 (_FPHSA_FAILURE_MESSAGE)
     27      cmake/kokkoskernels_tpls.cmake:285 (FIND_PACKAGE_HANDLE_STANDARD_ARGS)
     28      cmake/Modules/FindTPLROCBLAS.cmake:25 (kokkoskernels_find_imported)
     29      cmake/kokkoskernels_tpls.cmake:383 (FIND_PACKAGE)

I don't know how to set ROCBLAS_INCLUDE_DIRS when using spack. I have tried to export ROCBLAS_INCLUDE_DIRS but spack ignores it. I have also tried to change the path in the packages.yml but I get the same error. Any idea how to fix this issue? I have to use spack to install Kokkos-Kernels.

@lucbv
Copy link
Contributor

lucbv commented Sep 30, 2024

Yeah, some of the logic around how the roc TPLs are detected in Kokkos Kernels was changed recently to accommodate Trilinos but I suspect it was not tested with spack leading to your problem.
Will have a look and should have someone assigned to this tomorrow at least.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants