Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update OpenVINO to 2023.3 #234

Conversation

atobiszei
Copy link

@kthui
Copy link
Contributor

kthui commented Feb 1, 2024

Hi @atobiszei, thanks for updating the OpenVINO version for Triton. We noticed there is an issue copying the /usr/lib/x86_64-linux-gnu/libpugixml.so.1 file from the ONNX Runtime build container to the backend build container during the build process, which likely is originating from this line. Would you be able to take a look into it?

#22 [16/20] RUN cp /workspace/build/Release/libonnxruntime_providers_openvino.so        /opt/onnxruntime/lib &&     cp /opt/intel/openvino_2023.3.0/runtime/lib/intel64/libopenvino.so.2023.3.0        /opt/onnxruntime/lib &&     cp /opt/intel/openvino_2023.3.0/runtime/lib/intel64/libopenvino_c.so.2023.3.0        /opt/onnxruntime/lib &&     cp /opt/intel/openvino_2023.3.0/runtime/lib/intel64/libopenvino_intel_cpu_plugin.so        /opt/onnxruntime/lib &&     cp /opt/intel/openvino_2023.3.0/runtime/lib/intel64/libopenvino_ir_frontend.so.2023.3.0        /opt/onnxruntime/lib &&     cp /opt/intel/openvino_2023.3.0/runtime/lib/intel64/libopenvino_onnx_frontend.so.2023.3.0        /opt/onnxruntime/lib &&     cp /usr/lib/x86_64-linux-gnu/libtbb.so.12 /opt/onnxruntime/lib &&     cp /usr/lib/x86_64-linux-gnu/libpugixml.so.1 /opt/onnxruntime/lib
#22 0.499 cp: cannot stat '/usr/lib/x86_64-linux-gnu/libpugixml.so.1': No such file or directory
#22 ERROR: process "/bin/sh -c cp /workspace/build/${ONNXRUNTIME_BUILD_CONFIG}/libonnxruntime_providers_openvino.so        /opt/onnxruntime/lib &&     cp ${INTEL_OPENVINO_DIR}/runtime/lib/intel64/libopenvino.so.${ONNXRUNTIME_OPENVINO_VERSION}        /opt/onnxruntime/lib &&     cp ${INTEL_OPENVINO_DIR}/runtime/lib/intel64/libopenvino_c.so.${ONNXRUNTIME_OPENVINO_VERSION}        /opt/onnxruntime/lib &&     cp ${INTEL_OPENVINO_DIR}/runtime/lib/intel64/libopenvino_intel_cpu_plugin.so        /opt/onnxruntime/lib &&     cp ${INTEL_OPENVINO_DIR}/runtime/lib/intel64/libopenvino_ir_frontend.so.${ONNXRUNTIME_OPENVINO_VERSION}        /opt/onnxruntime/lib &&     cp ${INTEL_OPENVINO_DIR}/runtime/lib/intel64/libopenvino_onnx_frontend.so.${ONNXRUNTIME_OPENVINO_VERSION}        /opt/onnxruntime/lib &&     cp /usr/lib/x86_64-linux-gnu/libtbb.so.12 /opt/onnxruntime/lib &&     cp /usr/lib/x86_64-linux-gnu/libpugixml.so.1 /opt/onnxruntime/lib" did not complete successfully: exit code: 1
------
 > [16/20] RUN cp /workspace/build/Release/libonnxruntime_providers_openvino.so        /opt/onnxruntime/lib &&     cp /opt/intel/openvino_2023.3.0/runtime/lib/intel64/libopenvino.so.2023.3.0        /opt/onnxruntime/lib &&     cp /opt/intel/openvino_2023.3.0/runtime/lib/intel64/libopenvino_c.so.2023.3.0        /opt/onnxruntime/lib &&     cp /opt/intel/openvino_2023.3.0/runtime/lib/intel64/libopenvino_intel_cpu_plugin.so        /opt/onnxruntime/lib &&     cp /opt/intel/openvino_2023.3.0/runtime/lib/intel64/libopenvino_ir_frontend.so.2023.3.0        /opt/onnxruntime/lib &&     cp /opt/intel/openvino_2023.3.0/runtime/lib/intel64/libopenvino_onnx_frontend.so.2023.3.0        /opt/onnxruntime/lib &&     cp /usr/lib/x86_64-linux-gnu/libtbb.so.12 /opt/onnxruntime/lib &&     cp /usr/lib/x86_64-linux-gnu/libpugixml.so.1 /opt/onnxruntime/lib:
0.499 cp: cannot stat '/usr/lib/x86_64-linux-gnu/libpugixml.so.1': No such file or directory
------
Dockerfile.ort:83
--------------------
  81 |     RUN cp /workspace/onnxruntime/include/onnxruntime/core/providers/openvino/openvino_provider_factory.h        /opt/onnxruntime/include
  82 |     
  83 | >>> RUN cp /workspace/build/${ONNXRUNTIME_BUILD_CONFIG}/libonnxruntime_providers_openvino.so        /opt/onnxruntime/lib &&     cp ${INTEL_OPENVINO_DIR}/runtime/lib/intel64/libopenvino.so.${ONNXRUNTIME_OPENVINO_VERSION}        /opt/onnxruntime/lib &&     cp ${INTEL_OPENVINO_DIR}/runtime/lib/intel64/libopenvino_c.so.${ONNXRUNTIME_OPENVINO_VERSION}        /opt/onnxruntime/lib &&     cp ${INTEL_OPENVINO_DIR}/runtime/lib/intel64/libopenvino_intel_cpu_plugin.so        /opt/onnxruntime/lib &&     cp ${INTEL_OPENVINO_DIR}/runtime/lib/intel64/libopenvino_ir_frontend.so.${ONNXRUNTIME_OPENVINO_VERSION}        /opt/onnxruntime/lib &&     cp ${INTEL_OPENVINO_DIR}/runtime/lib/intel64/libopenvino_onnx_frontend.so.${ONNXRUNTIME_OPENVINO_VERSION}        /opt/onnxruntime/lib &&     cp /usr/lib/x86_64-linux-gnu/libtbb.so.12 /opt/onnxruntime/lib &&     cp /usr/lib/x86_64-linux-gnu/libpugixml.so.1 /opt/onnxruntime/lib
  84 |     
  85 |     RUN OV_SHORT_VERSION=`echo ${ONNXRUNTIME_OPENVINO_VERSION} | awk '{ split($0,a,"."); print substr(a[1],3) a[2] a[3] }'` &&     (cd /opt/onnxruntime/lib &&         chmod a-x * &&         ln -s libopenvino.so.${ONNXRUNTIME_OPENVINO_VERSION} libopenvino.so.${OV_SHORT_VERSION} &&         ln -s libopenvino.so.${ONNXRUNTIME_OPENVINO_VERSION} libopenvino.so &&         ln -s libopenvino_c.so.${ONNXRUNTIME_OPENVINO_VERSION} libopenvino_c.so.${OV_SHORT_VERSION} &&         ln -s libopenvino_c.so.${ONNXRUNTIME_OPENVINO_VERSION} libopenvino_c.so &&         ln -s libopenvino_ir_frontend.so.${ONNXRUNTIME_OPENVINO_VERSION} libopenvino_ir_frontend.so.${OV_SHORT_VERSION} &&         ln -s libopenvino_ir_frontend.so.${ONNXRUNTIME_OPENVINO_VERSION} libopenvino_ir_frontend.so &&         ln -s libopenvino_onnx_frontend.so.${ONNXRUNTIME_OPENVINO_VERSION} libopenvino_onnx_frontend.so.${OV_SHORT_VERSION} &&         ln -s libopenvino_onnx_frontend.so.${ONNXRUNTIME_OPENVINO_VERSION} libopenvino_onnx_frontend.so)
--------------------
ERROR: failed to solve: process "/bin/sh -c cp /workspace/build/${ONNXRUNTIME_BUILD_CONFIG}/libonnxruntime_providers_openvino.so        /opt/onnxruntime/lib &&     cp ${INTEL_OPENVINO_DIR}/runtime/lib/intel64/libopenvino.so.${ONNXRUNTIME_OPENVINO_VERSION}        /opt/onnxruntime/lib &&     cp ${INTEL_OPENVINO_DIR}/runtime/lib/intel64/libopenvino_c.so.${ONNXRUNTIME_OPENVINO_VERSION}        /opt/onnxruntime/lib &&     cp ${INTEL_OPENVINO_DIR}/runtime/lib/intel64/libopenvino_intel_cpu_plugin.so        /opt/onnxruntime/lib &&     cp ${INTEL_OPENVINO_DIR}/runtime/lib/intel64/libopenvino_ir_frontend.so.${ONNXRUNTIME_OPENVINO_VERSION}        /opt/onnxruntime/lib &&     cp ${INTEL_OPENVINO_DIR}/runtime/lib/intel64/libopenvino_onnx_frontend.so.${ONNXRUNTIME_OPENVINO_VERSION}        /opt/onnxruntime/lib &&     cp /usr/lib/x86_64-linux-gnu/libtbb.so.12 /opt/onnxruntime/lib &&     cp /usr/lib/x86_64-linux-gnu/libpugixml.so.1 /opt/onnxruntime/lib" did not complete successfully: exit code: 1
gmake[2]: *** [CMakeFiles/ort_target.dir/build.make:74: onnxruntime/lib/libonnxruntime.so] Error 1
gmake[2]: Leaving directory '/tmp/tritonbuild/onnxruntime/build'
gmake[1]: *** [CMakeFiles/Makefile2:275: CMakeFiles/ort_target.dir/all] Error 2
gmake[1]: Leaving directory '/tmp/tritonbuild/onnxruntime/build'
gmake: *** [Makefile:136: all] Error 2

@nnshah1
Copy link

nnshah1 commented Feb 6, 2024

@dtrawins can you help answer if this is expected or not?

@kthui kthui mentioned this pull request Feb 15, 2024
@dyastremsky
Copy link
Contributor

Thank you for finding this and submitting this PR! Closing due to changes being merged in via #238.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants