Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Compatibility for TF>=2.11 #35

Open
weirenorweiren opened this issue Sep 8, 2024 · 5 comments
Open

Compatibility for TF>=2.11 #35

weirenorweiren opened this issue Sep 8, 2024 · 5 comments

Comments

@weirenorweiren
Copy link

weirenorweiren commented Sep 8, 2024 •
edited
Loading

Hi I am a rookie in this field and I want to run live_demo.py from https://github.com/google-deepmind/tapnet on a GPU in Windows. The requirements file involves jax and tensorflow but live_demo.py only explicitly imports jax.

I have two questions below:

  1. Is a GPU version of tensorflow implied in order to run live_demo.py or jax on a GPU?
  2. If yes for 1, I am wondering that would the wheels you provide circumvent the restriction on TF version as described in https://www.tensorflow.org/install/source_windows?

Note: GPU support on native-Windows is only available for 2.10 or earlier versions, starting in TF 2.11, CUDA build is not supported for Windows. For using TensorFlow GPU on Windows, you will need to build/install TensorFlow in WSL2 or use tensorflow-cpu with TensorFlow-DirectML-Plugin
@cloudhan
Copy link
Owner

cloudhan commented Sep 8, 2024

Better use WSL at the moment to save your time.

@weirenorweiren
Copy link
Author

I checked with the author and he said a CPU version TF would be fine in google-deepmind/tapnet#120 (comment), though he hasn't replied to my follow-ups yet. Ideally I prefer just installing one of your wheels and avoid WSL2 since I try to introduce as fewer components as possible for my application. Do you think it's worthwhile to give it a try if GPU version TF is not required? Or do you still think WSL2 is better? Appreciate any comments and suggestions!

@weirenorweiren
Copy link
Author

weirenorweiren commented Sep 15, 2024 •
edited
Loading

Hi @cloudhan, I have downloaded the Visual Studio 2022 as required in https://docs.nvidia.com/deeplearning/cudnn/latest/reference/support-matrix.html# and have done the following:

conda create -n test python=3.11 pip m2-base menpo::wget
pip install nvidia-pyindex

conda install nvidia/label/cuda-12.1.1::cuda
> F:\Wei\tapnet>if defined INCLUDE_CONDA_NVCC_BACKUP (
> set "INCLUDE="
>  set "INCLUDE_CONDA_NVCC_BACKUP="
> )
>  
> F:\Wei\tapnet>SET DISTUTILS_USE_SDK=1
>  
> F:\Wei\tapnet>SET MSSdk=1
>  
> F:\Wei\tapnet>SET "VS_VERSION=15.0"
>  
> F:\Wei\tapnet>SET "VS_MAJOR=15"
>  
> F:\Wei\tapnet>SET "VS_YEAR=2017"
>  
> F:\Wei\tapnet>set "MSYS2_ARG_CONV_EXCL=/AI;/AL;/OUT;/out"
>  
> F:\Wei\tapnet>set "MSYS2_ENV_CONV_EXCL=CL"
>  
> F:\Wei\tapnet>set "PY_VCRUNTIME_REDIST=\bin\vcruntime140.dll"
>  
> F:\Wei\tapnet>set "CXX=cl.exe"
>  
> F:\Wei\tapnet>set "CC=cl.exe"
>  
> F:\Wei\tapnet>CALL C:\Users\NOCB\anaconda3\envs\test\etc\conda\activate.d\vs2017_get_vsinstall_dir.bat
> Did not find VSINSTALLDIR
> Windows SDK version found as: "10.0.20348.0"
> The system cannot find the path specified.
> Did not find VSINSTALLDIR
>
> F:\Wei\tapnet>if defined INCLUDE (set "INCLUDE_CONDA_NVCC_BACKUP=" )
>  
> F:\Wei\tapnet>set "INCLUDE=;\targets\x64"

conda install conda-forge::cudnn=8.9
> F:\Wei\tapnet>if defined INCLUDE_CONDA_NVCC_BACKUP (
> set "INCLUDE="
>  set "INCLUDE_CONDA_NVCC_BACKUP="
> )
>  
> F:\Wei\tapnet>SET DISTUTILS_USE_SDK=1
>  
> F:\Wei\tapnet>SET MSSdk=1
>  
> F:\Wei\tapnet>SET "VS_VERSION=15.0"
>  
> F:\Wei\tapnet>SET "VS_MAJOR=15"
>  
> F:\Wei\tapnet>SET "VS_YEAR=2017"
>  
> F:\Wei\tapnet>set "MSYS2_ARG_CONV_EXCL=/AI;/AL;/OUT;/out"
>  
> F:\Wei\tapnet>set "MSYS2_ENV_CONV_EXCL=CL"
>  
> F:\Wei\tapnet>set "PY_VCRUNTIME_REDIST=\bin\vcruntime140.dll"
>  
> F:\Wei\tapnet>set "CXX=cl.exe"
>  
> F:\Wei\tapnet>set "CC=cl.exe"
>  
> F:\Wei\tapnet>CALL C:\Users\NOCB\anaconda3\envs\test\etc\conda\activate.d\vs2017_get_vsinstall_dir.bat
> Did not find VSINSTALLDIR
> Windows SDK version found as: "10.0.20348.0"
> The system cannot find the path specified.
> Did not find VSINSTALLDIR
>  
> F:\Wei\tapnet>if defined INCLUDE (set "INCLUDE_CONDA_NVCC_BACKUP=;\targets\x64" )
>  
> F:\Wei\tapnet>set "INCLUDE=;\targets\x64;\targets\x64"

pip install -r requirements_inference.txt
pip install jax==0.4.14 https://whls.blob.core.windows.net/unstable/cuda121/jaxlib-0.4.14+cuda12.cudnn89-cp311-cp311-win_amd64.whl numpy==1.26.4 dm-haiku==0.0.10 optax==0.1.7 scipy==1.11.1

And I got below messages for the 2 attempts to run live_demo.py in https://github.com/google-deepmind/tapnet/blob/main/tapnet/live_demo.py. requirements_inference.txt is in https://github.com/google-deepmind/tapnet/blob/main/requirements_inference.txt. I have tried jax.devices() and it output [gpu(id=0)]. Do you have any suggestions for me to start solving this problem?

[libprotobuf ERROR external/com_google_protobuf/src/google/protobuf/text_format.cc:337] Error parsing text-format xla.gpu.DeviceHloInstructionProfiles: 1463:15: Message type "xla.gpu.HloInstructionProfile" has no field named "entries".
2024-09-15 00:06:23.497838: F external/xla/xla/service/gpu/gpu_hlo_cost_analysis.cc:289] Check failed: tsl::protobuf::TextFormat::ParseFromString( std::string(kDeviceHloOpProfiles), &all_device_profiles)

[libprotobuf ERROR external/com_google_protobuf/src/google/protobuf/text_format.cc:337] Error parsing text-format xla.gpu.DeviceHloInstructionProfiles: 1463:15: Message type "xla.gpu.HloInstructionProfile" has no field named "entries".
2024-09-15 00:18:19.493567: F external/xla/xla/service/gpu/gpu_hlo_cost_analysis.cc:289] Check failed: tsl::protobuf::TextFormat::ParseFromString( std::string(kDeviceHloOpProfiles), &all_device_profiles)

Below are my nvidia-smi and conda list:

+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 552.86                 Driver Version: 552.86         CUDA Version: 12.4     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                     TCC/WDDM  | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  Quadro M4000                 WDDM  |   00000000:01:00.0  On |                  N/A |
| 46%   39C    P8             16W /  120W |    1318MiB /   8192MiB |      7%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|    0   N/A  N/A      1344    C+G   ...ekyb3d8bbwe\PhoneExperienceHost.exe      N/A      |
|    0   N/A  N/A      2264    C+G   ...CBS_cw5n1h2txyewy\TextInputHost.exe      N/A      |
|    0   N/A  N/A      6772    C+G   ....Search_cw5n1h2txyewy\SearchApp.exe      N/A      |
|    0   N/A  N/A      8748    C+G   C:\Windows\explorer.exe                     N/A      |
|    0   N/A  N/A     11728    C+G   ...2txyewy\StartMenuExperienceHost.exe      N/A      |
|    0   N/A  N/A     12400    C+G   ....Search_cw5n1h2txyewy\SearchApp.exe      N/A      |
|    0   N/A  N/A     12780    C+G   ...on\128.0.2739.67\msedgewebview2.exe      N/A      |
|    0   N/A  N/A     14828    C+G   ...oogle\Chrome\Application\chrome.exe      N/A      |
|    0   N/A  N/A     15708    C+G   ...es (x86)\Dropbox\Client\Dropbox.exe      N/A      |
|    0   N/A  N/A     15812    C+G   ...cal\Microsoft\OneDrive\OneDrive.exe      N/A      |
|    0   N/A  N/A     16132    C+G   ...Files (x86)\pCloud Drive\pCloud.exe      N/A      |
|    0   N/A  N/A     16516    C+G   ...on\128.0.2739.67\msedgewebview2.exe      N/A      |
|    0   N/A  N/A     17228    C+G   ...siveControlPanel\SystemSettings.exe      N/A      |
|    0   N/A  N/A     17240    C+G   ...1.0_x64__8wekyb3d8bbwe\Video.UI.exe      N/A      |
|    0   N/A  N/A     17572    C+G   ...5n1h2txyewy\ShellExperienceHost.exe      N/A      |
|    0   N/A  N/A     18208    C+G   ...es (x86)\Dropbox\Client\Dropbox.exe      N/A      |
|    0   N/A  N/A     19164    C+G   ...on\128.0.2739.67\msedgewebview2.exe      N/A      |
|    0   N/A  N/A     20512    C+G   ...crosoft\Edge\Application\msedge.exe      N/A      |
|    0   N/A  N/A     21448    C+G   ...05.0_x64__8wekyb3d8bbwe\Cortana.exe      N/A      |
|    0   N/A  N/A     22656    C+G   ...t.LockApp_cw5n1h2txyewy\LockApp.exe      N/A      |
+-----------------------------------------------------------------------------------------+

# Name                    Version                   Build  Channel
absl-py                   2.1.0                    pypi_0    pypi
asttokens                 2.4.1                    pypi_0    pypi
bzip2                     1.0.8                h2bbff1b_6
ca-certificates           2024.7.2             haa95532_0
cccl                      2.3.2                h47f531a_0
chex                      0.1.82                   pypi_0    pypi
colorama                  0.4.6                    pypi_0    pypi
comm                      0.2.2                    pypi_0    pypi
contextlib2               21.6.0                   pypi_0    pypi
contourpy                 1.3.0                    pypi_0    pypi
cuda                      12.1.1                        0    nvidia/label/cuda-12.1.1
cuda-cccl                 12.4.127             haa95532_2
cuda-cccl_win-64          12.4.127             haa95532_2
cuda-command-line-tools   12.4.1               haa95532_1
cuda-compiler             12.4.1               hd77b12b_1
cuda-crt-dev_win-64       12.4.131             haa95532_0
cuda-crt-tools            12.4.131             haa95532_0
cuda-cudart               12.4.127             hd77b12b_0
cuda-cudart-dev           12.4.127             hd77b12b_0
cuda-cudart-dev_win-64    12.4.127             hd77b12b_0
cuda-cudart-static        12.4.127             hd77b12b_0
cuda-cudart-static_win-64 12.4.127             hd77b12b_0
cuda-cudart_win-64        12.4.127             hd77b12b_0
cuda-cuobjdump            12.4.127             hd77b12b_1
cuda-cupti                12.4.127             hd77b12b_1
cuda-cupti-dev            12.4.127             hd77b12b_1
cuda-cuxxfilt             12.4.127             hd77b12b_1
cuda-demo-suite           12.1.105                      0    nvidia/label/cuda-12.1.1
cuda-libraries            12.4.1               haa95532_1
cuda-libraries-dev        12.4.1               haa95532_1
cuda-nvcc                 12.4.131             h1fd813f_0
cuda-nvcc-dev_win-64      12.4.131             haa95532_0
cuda-nvcc-impl            12.4.131             h35fed64_0
cuda-nvcc-tools           12.4.131             hd77b12b_0
cuda-nvcc_win-64          12.4.131             h1fd813f_0
cuda-nvdisasm             12.4.127             hd77b12b_1
cuda-nvml-dev             12.4.127             hd77b12b_1
cuda-nvprof               12.4.127             hd77b12b_1
cuda-nvprune              12.4.127             hd77b12b_1
cuda-nvrtc                12.4.127             hd77b12b_1
cuda-nvrtc-dev            12.4.127             hd77b12b_1
cuda-nvvm-dev_win-64      12.4.131             haa95532_0
cuda-nvvm-impl            12.4.131             hd77b12b_0
cuda-nvvm-tools           12.4.131             hd77b12b_0
cuda-nvvp                 12.4.127             hd77b12b_1
cuda-opencl               12.4.127             hd77b12b_0
cuda-opencl-dev           12.4.127             hd77b12b_0
cuda-profiler-api         12.4.127             haa95532_1
cuda-runtime              12.4.1               h382c6e5_0
cuda-sanitizer-api        12.4.127             hd77b12b_1
cuda-toolkit              12.4.1               h382c6e5_0
cuda-tools                12.4.1               haa95532_1
cuda-version              12.4                 hbda6634_3
cuda-visual-tools         12.4.1               haa95532_1
cudnn                     8.9.7.29             h3472fe1_3    conda-forge
cycler                    0.12.1                   pypi_0    pypi
decorator                 5.1.1                    pypi_0    pypi
dm-haiku                  0.0.10                   pypi_0    pypi
dm-tree                   0.1.8                    pypi_0    pypi
einshape                  1.0                      pypi_0    pypi
etils                     1.9.4                    pypi_0    pypi
executing                 2.1.0                    pypi_0    pypi
expat                     2.6.3                h5da7b33_0
flax                      0.9.0                    pypi_0    pypi
fontconfig                2.14.1               hb33846d_3
fonttools                 4.53.1                   pypi_0    pypi
freetype                  2.12.1               ha860e81_0
fsspec                    2024.9.0                 pypi_0    pypi
humanize                  4.10.0                   pypi_0    pypi
importlib-resources       6.4.5                    pypi_0    pypi
ipympl                    0.9.4                    pypi_0    pypi
ipython                   8.27.0                   pypi_0    pypi
ipython-genutils          0.2.0                    pypi_0    pypi
ipywidgets                8.1.5                    pypi_0    pypi
jax                       0.4.14                   pypi_0    pypi
jaxlib                    0.4.14                   pypi_0    pypi
jaxline                   0.0.8                    pypi_0    pypi
jedi                      0.19.1                   pypi_0    pypi
jmp                       0.0.4                    pypi_0    pypi
jupyterlab-widgets        3.0.13                   pypi_0    pypi
khronos-opencl-icd-loader 2024.05.08           h8cc25b3_0
kiwisolver                1.4.7                    pypi_0    pypi
krb5                      1.20.1               h5b6d351_0
libcublas                 12.4.5.8             hd77b12b_1
libcublas-dev             12.4.5.8             hd77b12b_1
libcufft                  11.2.1.3             hd77b12b_1
libcufft-dev              11.2.1.3             hd77b12b_1
libcurand                 10.3.5.147           hd77b12b_1
libcurand-dev             10.3.5.147           hd77b12b_1
libcusolver               11.6.1.9             hd77b12b_1
libcusolver-dev           11.6.1.9             hd77b12b_1
libcusparse               12.3.1.170           hd77b12b_1
libcusparse-dev           12.3.1.170           hd77b12b_1
libffi                    3.4.4                hd77b12b_1
libglib                   2.78.4               ha17d25a_0
libiconv                  1.16                 h2bbff1b_3
libnpp                    12.2.5.30            hd77b12b_1
libnpp-dev                12.2.5.30            hd77b12b_1
libnvfatbin               12.4.127             h20ee8b7_2
libnvfatbin-dev           12.4.127             h20ee8b7_2
libnvjitlink              12.4.127             hd77b12b_1
libnvjitlink-dev          12.4.127             hd77b12b_1
libnvjpeg                 12.3.1.117           hd77b12b_1
libnvjpeg-dev             12.3.1.117           haa95532_1
libpng                    1.6.39               h8cc25b3_0
libxml2                   2.13.1               h24da03e_2
libzlib                   1.2.13               h2466b09_6    conda-forge
libzlib-wapi              1.2.13               h2466b09_6    conda-forge
m2-base                   1.0.0                         3
m2-bash                   4.3.042                       5
m2-bash-completion        2.3                           2
m2-catgets                1.1                           3
m2-coreutils              8.25                        102
m2-dash                   0.5.8                         2
m2-file                   5.25                          2
m2-filesystem             2016.04                       4
m2-findutils              4.6.0                         2
m2-gawk                   4.1.3                         2
m2-gcc-libs               5.3.0                         4
m2-gettext                0.19.7                        4
m2-gmp                    6.1.0                         3
m2-grep                   2.22                          4
m2-gzip                   1.7                           2
m2-inetutils              1.9.2                         2
m2-info                   6.0                           2
m2-less                   481                           2
m2-libasprintf            0.19.7                        4
m2-libcatgets             1.1                           3
m2-libcrypt               1.3                           2
m2-libgettextpo           0.19.7                        4
m2-libiconv               1.14                          3
m2-libintl                0.19.7                        4
m2-liblzma                5.2.2                         2
m2-libpcre                8.38                          2
m2-libreadline            6.3.008                       8
m2-libutil-linux          2.26.2                        2
m2-libxml2                2.9.2                         3
m2-mintty                 1!2.2.3                       2
m2-mpfr                   3.1.4                         2
m2-msys2-launcher-git     0.3.28.860c495                2
m2-msys2-runtime          2.5.0.17080.65c939c               3
m2-ncurses                6.0.20160220                  2
m2-sed                    4.2.2                         3
m2-tftp-hpa               5.2                           2
m2-time                   1.7                           2
m2-ttyrec                 1.0.8                         2
m2-tzcode                 2015.e                        2
m2-util-linux             2.26.2                        2
m2-which                  2.21                          3
m2-zlib                   1.2.8                         4
markdown-it-py            3.0.0                    pypi_0    pypi
matplotlib                3.9.2                    pypi_0    pypi
matplotlib-inline         0.1.7                    pypi_0    pypi
mdurl                     0.1.2                    pypi_0    pypi
mediapy                   1.2.2                    pypi_0    pypi
ml-collections            0.1.1                    pypi_0    pypi
ml-dtypes                 0.5.0                    pypi_0    pypi
msgpack                   1.1.0                    pypi_0    pypi
msys2-conda-epoch         20160418                      1
nest-asyncio              1.6.0                    pypi_0    pypi
nsight-compute            2024.1.1.4           hb5e1e24_2
numpy                     1.26.4                   pypi_0    pypi
nvidia-pyindex            1.0.9                    pypi_0    pypi
opencv-python             4.10.0.84                pypi_0    pypi
openssl                   3.0.15               h827c3e9_0
opt-einsum                3.3.0                    pypi_0    pypi
optax                     0.1.7                    pypi_0    pypi
orbax-checkpoint          0.6.3                    pypi_0    pypi
packaging                 24.1                     pypi_0    pypi
parso                     0.8.4                    pypi_0    pypi
pcre2                     10.42                h0ff8eda_1
pillow                    10.4.0                   pypi_0    pypi
pip                       24.2            py311haa95532_0
prompt-toolkit            3.0.47                   pypi_0    pypi
protobuf                  5.28.1                   pypi_0    pypi
pure-eval                 0.2.3                    pypi_0    pypi
pygments                  2.18.0                   pypi_0    pypi
pyparsing                 3.1.4                    pypi_0    pypi
python                    3.11.9               he1021f5_0
python-dateutil           2.9.0.post0              pypi_0    pypi
pyyaml                    6.0.2                    pypi_0    pypi
rich                      13.8.1                   pypi_0    pypi
scipy                     1.11.1                   pypi_0    pypi
setuptools                72.1.0          py311haa95532_0
six                       1.16.0                   pypi_0    pypi
sqlite                    3.45.3               h2bbff1b_0
stack-data                0.6.3                    pypi_0    pypi
tabulate                  0.9.0                    pypi_0    pypi
tensorstore               0.1.65                   pypi_0    pypi
thorlabs-tsi-sdk          0.0.8                    pypi_0    pypi
tk                        8.6.14               h0416ee5_0
toolz                     0.12.1                   pypi_0    pypi
tqdm                      4.66.5                   pypi_0    pypi
traitlets                 5.14.3                   pypi_0    pypi
typing-extensions         4.12.2                   pypi_0    pypi
tzdata                    2024a                h04d1e81_0
ucrt                      10.0.20348.0         haa95532_0
vc                        14.40                h2eaa2aa_1
vc14_runtime              14.40.33810         ha82c5b3_21    conda-forge
vs2015_runtime            14.40.33810         h3bf8584_21    conda-forge
vs2017_win-64             19.16.27032.1        hb4161e2_3
vswhere                   2.8.4                haa95532_0
wcwidth                   0.2.13                   pypi_0    pypi
wget                      1.16.3                        0    menpo
wheel                     0.44.0          py311haa95532_0
widgetsnbextension        4.0.13                   pypi_0    pypi
wrapt                     1.16.0                   pypi_0    pypi
xz                        5.4.6                h8cc25b3_1
zipp                      3.20.2                   pypi_0    pypi
zlib                      1.2.13               h2466b09_6    conda-forge

@weirenorweiren
Copy link
Author

weirenorweiren commented Sep 15, 2024 •
edited
Loading

Also tried the following and fixed all dependencies issues:

(test) F:\Wei\tapnet>pip install protobuf==4.23.4
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting protobuf==4.23.4
  Downloading protobuf-4.23.4-cp310-abi3-win_amd64.whl.metadata (540 bytes)
Downloading protobuf-4.23.4-cp310-abi3-win_amd64.whl (422 kB)
Installing collected packages: protobuf
  Attempting uninstall: protobuf
    Found existing installation: protobuf 5.28.1
    Uninstalling protobuf-5.28.1:
      Successfully uninstalled protobuf-5.28.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
orbax-checkpoint 0.6.3 requires jax>=0.4.26, but you have jax 0.4.14 which is incompatible.
Successfully installed protobuf-4.23.4

But still got the following:

[libprotobuf ERROR external/com_google_protobuf/src/google/protobuf/text_format.cc:337] Error parsing text-format xla.gpu.DeviceHloInstructionProfiles: 1463:15: Message type "xla.gpu.HloInstructionProfile" has no field named "entries".
2024-09-15 00:44:08.849867: F external/xla/xla/service/gpu/gpu_hlo_cost_analysis.cc:289] Check failed: tsl::protobuf::TextFormat::ParseFromString( std::string(kDeviceHloOpProfiles), &all_device_profiles)

@weirenorweiren weirenorweiren mentioned this issue Sep 16, 2024
Open
@weirenorweiren
Copy link
Author

Hi @cloudhan, it seems that others encountered a similar issue in #33.

I am currently suspecting 3 things:

  1. In your README, you mentioned that "Currently, only CPU and CUDA 11.1 are supported. For CUDA 11.x, please install the cuda/cuda11_cudnn82 package." but I am using your cuda121/jaxlib-0.4.14+cuda12.cudnn89-cp311-cp311-win_amd64.whl. Should I only use wheels with cuda11_cudnn82?
  2. When I install CUDA with conda install nvidia/label/cuda-12.1.1::cuda, lots of packages have a version of 12.4.X. including cuda-toolkit. When I use conda install nvidia/label/cuda-12.1.1::cuda-toolkit, cuda-toolkit==12.1.1 but other packages still get a version of 12.4.X. or >12.1.1.
  3. I downloaded a Visual Studio 2022 for CUDA 12.x according to https://docs.nvidia.com/deeplearning/cudnn/latest/reference/support-matrix.html#. However, JAX official documents only mention Visual Studio 2019 in https://jax.readthedocs.io/en/latest/developer.html#additional-notes-for-building-jaxlib-from-source-on-windows and https://jax.readthedocs.io/en/latest/installation.html#.

Regarding 2, I did the following but got the same error:

conda create -n test_921 python=3.11 pip m2-base menpo::wget
pip install nvidia-pyindex
 
conda install nvidia/label/cuda-12.1.1::cuda-toolkit nvidia/label/cuda-12.1.1::cuda-nvcc conda-forge::cudnn=8.9
> F:\Wei\tapnet>SET DISTUTILS_USE_SDK=1
>  
> F:\Wei\tapnet>SET MSSdk=1
>  
> F:\Wei\tapnet>SET "VS_VERSION=16.5"
>  
> F:\Wei\tapnet>SET "VS_MAJOR=16"
>  
> F:\Wei\tapnet>SET "VS_YEAR=2019"
>  
> F:\Wei\tapnet>set "MSYS2_ARG_CONV_EXCL=/AI;/AL;/OUT;/out"
>  
> F:\Wei\tapnet>set "MSYS2_ENV_CONV_EXCL=CL"
>  
> F:\Wei\tapnet>set "PY_VCRUNTIME_REDIST=\bin\vcruntime140.dll"
>  
> F:\Wei\tapnet>set "CXX=cl.exe"
>  
> F:\Wei\tapnet>set "CC=cl.exe"
>  
> F:\Wei\tapnet>set "VSINSTALLDIR="
>  
> F:\Wei\tapnet>for /F "usebackq tokens=*" %i in (`vswhere.exe -nologo -products * -version [16.0,17.0] -property installationPath`) do (set "VSINSTALLDIR=%i\" )
>  
> F:\Wei\tapnet>if not exist "" (for /F "usebackq tokens=*" %i in (`vswhere.exe -nologo -products * -requires Microsoft.VisualStudio.Component.VC.v142.x86.x64 -property installationPath`) do (set "VSINSTALLDIR=%i\" ) )
>  
> F:\Wei\tapnet>if not exist "" (set "VSINSTALLDIR=C:\Program Files (x86)\Microsoft Visual Studio\2019\Professional\" )
>  
> F:\Wei\tapnet>if not exist "C:\Program Files (x86)\Microsoft Visual Studio\2019\Professional\" (set "VSINSTALLDIR=C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\" )
>  
> F:\Wei\tapnet>if not exist "C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\" (set "VSINSTALLDIR=C:\Program Files (x86)\Microsoft Visual Studio\2019\BuildTools\" )
>  
> F:\Wei\tapnet>if not exist "C:\Program Files (x86)\Microsoft Visual Studio\2019\BuildTools\" (set "VSINSTALLDIR=C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\" )
>  
> F:\Wei\tapnet>IF NOT "" == "" (
> set "INCLUDE=;;\targets\x64"
>  set "LIB=;"
>  set "CMAKE_PREFIX_PATH=;"
> )
>  
> F:\Wei\tapnet>call :GetWin10SdkDir
>  
> F:\Wei\tapnet>call :GetWin10SdkDirHelper HKLM\SOFTWARE\Wow6432Node  1>nul 2>&1
>  
> F:\Wei\tapnet>if errorlevel 1 call :GetWin10SdkDirHelper HKCU\SOFTWARE\Wow6432Node  1>nul 2>&1
>  
> F:\Wei\tapnet>if errorlevel 1 call :GetWin10SdkDirHelper HKLM\SOFTWARE  1>nul 2>&1
>  
> F:\Wei\tapnet>if errorlevel 1 call :GetWin10SdkDirHelper HKCU\SOFTWARE  1>nul 2>&1
>  
> F:\Wei\tapnet>if errorlevel 1 exit /B 1
>  
> F:\Wei\tapnet>exit /B 0
>  
> F:\Wei\tapnet>for /F %i in ('dir /ON /B "C:\Program Files (x86)\Windows Kits\10\\include"') DO (if NOT "%~i" == "wdf" (for /F "tokens=3 delims=." %a in ("%~i") do (if %a LSS 22621 (SET WindowsSDKVer=%~i ) ) ) )
>  
> F:\Wei\tapnet>(if NOT "10.0.20348.0" == "wdf" (for /F "tokens=3 delims=." %a in ("10.0.20348.0") do (if %a LSS 22621 (SET WindowsSDKVer=10.0.20348.0 ) ) ) )
>  
> F:\Wei\tapnet>(if 20348 LSS 22621 (SET WindowsSDKVer=10.0.20348.0 ) )
>  
> F:\Wei\tapnet>if errorlevel 1 (echo "Didn't find any windows 10 SDK. I'm not sure if things will work, but let's try..." )  else (echo Windows SDK version found as: "10.0.20348.0" )
> Windows SDK version found as: "10.0.20348.0"
>  
> F:\Wei\tapnet>IF "win-64" == "win-64" (
> set "CMAKE_GEN=Visual Studio 16 2019 Win64"
>  set "BITS=64"
> )  else (
> set "CMAKE_GEN=Visual Studio 16 2019"
>  set "BITS=32"
> )
>  
> F:\Wei\tapnet>pushd C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\
> The system cannot find the path specified.
>  
> F:\Wei\tapnet>set VSCMD_DEBUG=1
>  
> F:\Wei\tapnet>CALL "VC\Auxiliary\Build\vcvars64.bat" -vcvars_ver=14.2 10.0.20348.0
> The system cannot find the path specified.
>  
> F:\Wei\tapnet>popd
>  
> F:\Wei\tapnet>IF "Visual Studio 15 2017 Win64" == "" SET "CMAKE_GENERATOR=Visual Studio 16 2019 Win64"
>  
> F:\Wei\tapnet>call :GetWin10SdkDirHelper HKLM\SOFTWARE\Wow6432Node  1>nul 2>&1
>  
> F:\Wei\tapnet>if errorlevel 1 call :GetWin10SdkDirHelper HKCU\SOFTWARE\Wow6432Node  1>nul 2>&1
>  
> F:\Wei\tapnet>if errorlevel 1 call :GetWin10SdkDirHelper HKLM\SOFTWARE  1>nul 2>&1
>  
> F:\Wei\tapnet>if errorlevel 1 call :GetWin10SdkDirHelper HKCU\SOFTWARE  1>nul 2>&1
>  
> F:\Wei\tapnet>if errorlevel 1 exit /B 1
>  
> F:\Wei\tapnet>exit /B 0

pip install -r requirements_gpu.txt
> https://whls.blob.core.windows.net/unstable/cuda121/jaxlib-0.4.14+cuda12.cudnn89-cp311-cp311-win_amd64.whl
> jax==0.4.14
> chex
> jaxline
> optax==0.1.7
> dm-haiku==0.0.10
> dm-tree
> typing_extensions
> matplotlib
> mediapy
> opencv-python
> einshape
> ipympl
> tqdm
 
pip install numpy==1.26.4 scipy==1.11.1

My next step is to install a Visual Studio 2019 to check on 3 and see how it goes. In the meantime I appreciate it if you could offer any suggestions!

Below is the Conda list:

# Name                    Version                   Build  Channel
absl-py                   2.1.0                    pypi_0    pypi
asttokens                 2.4.1                    pypi_0    pypi
bzip2                     1.0.8                h2bbff1b_6
c-compiler                1.8.0                hcfcfb64_0    conda-forge
ca-certificates           2024.7.2             haa95532_0
cccl                      2.3.2                h47f531a_0
chex                      0.1.82                   pypi_0    pypi
colorama                  0.4.6                    pypi_0    pypi
comm                      0.2.2                    pypi_0    pypi
contextlib2               21.6.0                   pypi_0    pypi
contourpy                 1.3.0                    pypi_0    pypi
cuda-cccl                 12.4.127             haa95532_2
cuda-cccl_win-64          12.4.127             haa95532_2
cuda-command-line-tools   12.4.1               haa95532_1
cuda-compiler             12.1.1               h63438b5_0    conda-forge
cuda-cudart               12.4.127             hd77b12b_0
cuda-cudart-dev           12.4.127             hd77b12b_0
cuda-cudart-dev_win-64    12.4.127             hd77b12b_0
cuda-cudart-static        12.4.127             hd77b12b_0
cuda-cudart-static_win-64 12.4.127             hd77b12b_0
cuda-cudart_win-64        12.4.127             hd77b12b_0
cuda-cuobjdump            12.1.111                      0    nvidia/label/cuda-12.1.1
cuda-cupti                12.4.127             hd77b12b_1
cuda-cupti-dev            12.4.127             hd77b12b_1
cuda-cuxxfilt             12.1.105                      0    nvidia/label/cuda-12.1.1
cuda-documentation        12.1.105                      0    nvidia/label/cuda-12.1.1
cuda-libraries            12.4.1               haa95532_1
cuda-libraries-dev        12.4.1               haa95532_1
cuda-nvcc                 12.1.105                      0    nvidia/label/cuda-12.1.1
cuda-nvdisasm             12.4.127             hd77b12b_1
cuda-nvml-dev             12.4.127             hd77b12b_1
cuda-nvprof               12.4.127             hd77b12b_1
cuda-nvprune              12.1.105                      0    nvidia/label/cuda-12.1.1
cuda-nvrtc                12.4.127             hd77b12b_1
cuda-nvrtc-dev            12.4.127             hd77b12b_1
cuda-nvvp                 12.4.127             hd77b12b_1
cuda-opencl               12.4.127             hd77b12b_0
cuda-opencl-dev           12.4.127             hd77b12b_0
cuda-profiler-api         12.4.127             haa95532_1
cuda-sanitizer-api        12.4.127             hd77b12b_1
cuda-toolkit              12.1.1                        0    nvidia/label/cuda-12.1.1
cuda-tools                12.4.1               haa95532_1
cuda-version              12.4                 hbda6634_3
cuda-visual-tools         12.4.1               haa95532_1
cudnn                     8.9.7.29             h3472fe1_3    conda-forge
cxx-compiler              1.8.0                h91493d7_0    conda-forge
cycler                    0.12.1                   pypi_0    pypi
decorator                 5.1.1                    pypi_0    pypi
dm-haiku                  0.0.10                   pypi_0    pypi
dm-tree                   0.1.8                    pypi_0    pypi
einshape                  1.0                      pypi_0    pypi
executing                 2.1.0                    pypi_0    pypi
expat                     2.6.3                h5da7b33_0
fontconfig                2.14.1               hb33846d_3
fonttools                 4.53.1                   pypi_0    pypi
freetype                  2.12.1               ha860e81_0
ipympl                    0.9.4                    pypi_0    pypi
ipython                   8.27.0                   pypi_0    pypi
ipython-genutils          0.2.0                    pypi_0    pypi
ipywidgets                8.1.5                    pypi_0    pypi
jax                       0.4.14                   pypi_0    pypi
jaxlib                    0.4.14                   pypi_0    pypi
jaxline                   0.0.8                    pypi_0    pypi
jedi                      0.19.1                   pypi_0    pypi
jmp                       0.0.4                    pypi_0    pypi
jupyterlab-widgets        3.0.13                   pypi_0    pypi
khronos-opencl-icd-loader 2024.05.08           h8cc25b3_0
kiwisolver                1.4.7                    pypi_0    pypi
krb5                      1.20.1               h5b6d351_0
libcublas                 12.4.5.8             hd77b12b_1
libcublas-dev             12.4.5.8             hd77b12b_1
libcufft                  11.2.1.3             hd77b12b_1
libcufft-dev              11.2.1.3             hd77b12b_1
libcurand                 10.3.5.147           hd77b12b_1
libcurand-dev             10.3.5.147           hd77b12b_1
libcusolver               11.6.1.9             hd77b12b_1
libcusolver-dev           11.6.1.9             hd77b12b_1
libcusparse               12.3.1.170           hd77b12b_1
libcusparse-dev           12.3.1.170           hd77b12b_1
libffi                    3.4.4                hd77b12b_1
libglib                   2.78.4               ha17d25a_0
libiconv                  1.16                 h2bbff1b_3
libnpp                    12.2.5.30            hd77b12b_1
libnpp-dev                12.2.5.30            hd77b12b_1
libnvfatbin               12.4.127             h20ee8b7_2
libnvfatbin-dev           12.4.127             h20ee8b7_2
libnvjitlink              12.4.127             hd77b12b_1
libnvjitlink-dev          12.4.127             hd77b12b_1
libnvjpeg                 12.3.1.117           hd77b12b_1
libnvjpeg-dev             12.3.1.117           haa95532_1
libnvvm-samples           12.1.105                      0    nvidia/label/cuda-12.1.1
libpng                    1.6.39               h8cc25b3_0
libxml2                   2.13.1               h24da03e_2
libzlib                   1.2.13               h2466b09_6    conda-forge
libzlib-wapi              1.2.13               h2466b09_6    conda-forge
m2-base                   1.0.0                         3
m2-bash                   4.3.042                       5
m2-bash-completion        2.3                           2
m2-catgets                1.1                           3
m2-coreutils              8.25                        102
m2-dash                   0.5.8                         2
m2-file                   5.25                          2
m2-filesystem             2016.04                       4
m2-findutils              4.6.0                         2
m2-gawk                   4.1.3                         2
m2-gcc-libs               5.3.0                         4
m2-gettext                0.19.7                        4
m2-gmp                    6.1.0                         3
m2-grep                   2.22                          4
m2-gzip                   1.7                           2
m2-inetutils              1.9.2                         2
m2-info                   6.0                           2
m2-less                   481                           2
m2-libasprintf            0.19.7                        4
m2-libcatgets             1.1                           3
m2-libcrypt               1.3                           2
m2-libgettextpo           0.19.7                        4
m2-libiconv               1.14                          3
m2-libintl                0.19.7                        4
m2-liblzma                5.2.2                         2
m2-libpcre                8.38                          2
m2-libreadline            6.3.008                       8
m2-libutil-linux          2.26.2                        2
m2-libxml2                2.9.2                         3
m2-mintty                 1!2.2.3                       2
m2-mpfr                   3.1.4                         2
m2-msys2-launcher-git     0.3.28.860c495                2
m2-msys2-runtime          2.5.0.17080.65c939c               3
m2-ncurses                6.0.20160220                  2
m2-sed                    4.2.2                         3
m2-tftp-hpa               5.2                           2
m2-time                   1.7                           2
m2-ttyrec                 1.0.8                         2
m2-tzcode                 2015.e                        2
m2-util-linux             2.26.2                        2
m2-which                  2.21                          3
m2-zlib                   1.2.8                         4
matplotlib                3.9.2                    pypi_0    pypi
matplotlib-inline         0.1.7                    pypi_0    pypi
mediapy                   1.2.2                    pypi_0    pypi
ml-collections            0.1.1                    pypi_0    pypi
ml-dtypes                 0.5.0                    pypi_0    pypi
msys2-conda-epoch         20160418                      1
nsight-compute            2024.1.1.4           hb5e1e24_2
numpy                     1.26.4                   pypi_0    pypi
nvidia-pyindex            1.0.9                    pypi_0    pypi
opencv-python             4.10.0.84                pypi_0    pypi
openssl                   3.0.15               h827c3e9_0
opt-einsum                3.3.0                    pypi_0    pypi
optax                     0.1.7                    pypi_0    pypi
packaging                 24.1                     pypi_0    pypi
parso                     0.8.4                    pypi_0    pypi
pcre2                     10.42                h0ff8eda_1
pillow                    10.4.0                   pypi_0    pypi
pip                       24.2            py311haa95532_0
prompt-toolkit            3.0.47                   pypi_0    pypi
pure-eval                 0.2.3                    pypi_0    pypi
pygments                  2.18.0                   pypi_0    pypi
pyparsing                 3.1.4                    pypi_0    pypi
python                    3.11.9               he1021f5_0
python-dateutil           2.9.0.post0              pypi_0    pypi
pyyaml                    6.0.2                    pypi_0    pypi
scipy                     1.11.1                   pypi_0    pypi
setuptools                75.1.0          py311haa95532_0
six                       1.16.0                   pypi_0    pypi
sqlite                    3.45.3               h2bbff1b_0
stack-data                0.6.3                    pypi_0    pypi
tabulate                  0.9.0                    pypi_0    pypi
thorlabs-tsi-sdk          0.0.8                    pypi_0    pypi
tk                        8.6.14               h0416ee5_0
toolz                     0.12.1                   pypi_0    pypi
tqdm                      4.66.5                   pypi_0    pypi
traitlets                 5.14.3                   pypi_0    pypi
typing-extensions         4.12.2                   pypi_0    pypi
tzdata                    2024a                h04d1e81_0
ucrt                      10.0.20348.0         haa95532_0
vc                        14.40                h2eaa2aa_1
vc14_runtime              14.40.33810         ha82c5b3_21    conda-forge
vs2015_runtime            14.40.33810         h3bf8584_21    conda-forge
vs2019_win-64             19.29.30154          h96f319f_5
vswhere                   2.8.4                haa95532_0
wcwidth                   0.2.13                   pypi_0    pypi
wget                      1.16.3                        0    menpo
wheel                     0.44.0          py311haa95532_0
widgetsnbextension        4.0.13                   pypi_0    pypi
wrapt                     1.16.0                   pypi_0    pypi
xz                        5.4.6                h8cc25b3_1
zlib                      1.2.13               h2466b09_6    conda-forge

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@cloudhan @weirenorweiren