Skip to content

[VL] Fix parquet write sort spill OOM #3373

[VL] Fix parquet write sort spill OOM

[VL] Fix parquet write sort spill OOM #3373

Triggered via pull request July 22, 2024 03:10
Status Cancelled
Total duration 21m 58s
Artifacts 2

velox_docker.yml

on: pull_request
build-native-lib-centos-7
3m 11s
build-native-lib-centos-7
build-native-lib-centos-8
21m 45s
build-native-lib-centos-8
Matrix: run-tpc-test-centos
Matrix: run-tpc-test-centos8-uniffle
Matrix: run-tpc-test-ubuntu-2204-celeborn
Matrix: run-tpc-test-ubuntu-oom
Matrix: run-tpc-test-ubuntu-randomkill
Matrix: run-tpc-test-ubuntu
run-spark-test-spark32
0s
run-spark-test-spark32
run-spark-test-spark32-slow
0s
run-spark-test-spark32-slow
run-spark-test-spark33
0s
run-spark-test-spark33
run-spark-test-spark33-slow
0s
run-spark-test-spark33-slow
run-spark-test-spark34
0s
run-spark-test-spark34
run-spark-test-spark34-slow
0s
run-spark-test-spark34-slow
run-spark-test-spark35
0s
run-spark-test-spark35
run-spark-test-spark35-slow
0s
run-spark-test-spark35-slow
Fit to window
Zoom out
Zoom in

Annotations

28 errors and 39 warnings
run-tpc-test-centos (centos:8, spark-3.2, java-8)
Process completed with exit code 1.
run-tpc-test-ubuntu-oom (spark-3.2)
Process completed with exit code 1.
run-tpc-test-ubuntu-2204-celeborn (spark-3.2, celeborn-0.5.0)
Process completed with exit code 1.
run-tpc-test-ubuntu (ubuntu:20.04, spark-3.2, java-8)
Process completed with exit code 1.
run-tpc-test-centos8-uniffle (spark-3.2)
Process completed with exit code 1.
run-tpc-test-ubuntu (ubuntu:22.04, spark-3.2, java-8)
Process completed with exit code 1.
run-tpc-test-ubuntu-2204-celeborn (spark-3.2, celeborn-0.3.2-incubating)
Process completed with exit code 1.
run-tpc-test-ubuntu-2204-celeborn (spark-3.2, celeborn-0.4.1)
Process completed with exit code 1.
run-tpc-test-centos (centos:7, spark-3.2, java-8)
Process completed with exit code 1.
run-tpc-test-ubuntu-randomkill (spark-3.2)
Process completed with exit code 1.
build-native-lib-centos-8
Canceling since a higher priority waiting request for 'apache/incubator-gluten-spill-Velox backend Github Runner' exists
build-native-lib-centos-8
The operation was canceled.
run-tpc-test-centos (centos:8, spark-3.5, java-8)
Canceling since a higher priority waiting request for 'apache/incubator-gluten-spill-Velox backend Github Runner' exists
run-tpc-test-centos (centos:8, spark-3.5, java-8)
The operation was canceled.
run-tpc-test-centos (centos:8, spark-3.3, java-8)
Canceling since a higher priority waiting request for 'apache/incubator-gluten-spill-Velox backend Github Runner' exists
run-tpc-test-centos (centos:8, spark-3.3, java-8)
The operation was canceled.
run-tpc-test-centos (centos:7, spark-3.4, java-8)
Canceling since a higher priority waiting request for 'apache/incubator-gluten-spill-Velox backend Github Runner' exists
run-tpc-test-centos (centos:7, spark-3.4, java-8)
The operation was canceled.
run-tpc-test-centos (centos:8, spark-3.5, java-11)
Canceling since a higher priority waiting request for 'apache/incubator-gluten-spill-Velox backend Github Runner' exists
run-tpc-test-centos (centos:8, spark-3.5, java-11)
The operation was canceled.
run-tpc-test-centos (centos:8, spark-3.4, java-8)
Canceling since a higher priority waiting request for 'apache/incubator-gluten-spill-Velox backend Github Runner' exists
run-tpc-test-centos (centos:8, spark-3.4, java-8)
The operation was canceled.
run-tpc-test-centos (centos:7, spark-3.3, java-8)
Canceling since a higher priority waiting request for 'apache/incubator-gluten-spill-Velox backend Github Runner' exists
run-tpc-test-centos (centos:7, spark-3.3, java-8)
The operation was canceled.
run-tpc-test-centos (centos:7, spark-3.5, java-8)
Canceling since a higher priority waiting request for 'apache/incubator-gluten-spill-Velox backend Github Runner' exists
run-tpc-test-centos (centos:7, spark-3.5, java-8)
The operation was canceled.
run-tpc-test-centos (centos:8, spark-3.3, java-17)
Canceling since a higher priority waiting request for 'apache/incubator-gluten-spill-Velox backend Github Runner' exists
run-tpc-test-centos (centos:8, spark-3.3, java-17)
The operation was canceled.
build-native-lib-centos-7
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/cache/restore@v3, actions/upload-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
build-native-lib-centos-7
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-centos (centos:8, spark-3.2, java-8)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-centos (centos:8, spark-3.2, java-8)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-ubuntu-oom (spark-3.2)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-ubuntu-oom (spark-3.2)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-ubuntu-2204-celeborn (spark-3.2, celeborn-0.5.0)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-ubuntu-2204-celeborn (spark-3.2, celeborn-0.5.0)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-ubuntu (ubuntu:20.04, spark-3.2, java-8)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-ubuntu (ubuntu:20.04, spark-3.2, java-8)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-centos8-uniffle (spark-3.2)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-centos8-uniffle (spark-3.2)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-ubuntu (ubuntu:22.04, spark-3.2, java-8)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-ubuntu (ubuntu:22.04, spark-3.2, java-8)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-ubuntu-2204-celeborn (spark-3.2, celeborn-0.3.2-incubating)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-ubuntu-2204-celeborn (spark-3.2, celeborn-0.3.2-incubating)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-ubuntu-2204-celeborn (spark-3.2, celeborn-0.4.1)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-ubuntu-2204-celeborn (spark-3.2, celeborn-0.4.1)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-centos (centos:7, spark-3.2, java-8)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-centos (centos:7, spark-3.2, java-8)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-ubuntu-randomkill (spark-3.2)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-ubuntu-randomkill (spark-3.2)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-ubuntu (ubuntu:20.04, spark-3.5, java-11)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-ubuntu (ubuntu:20.04, spark-3.5, java-11)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-ubuntu (ubuntu:22.04, spark-3.4, java-8)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-ubuntu (ubuntu:22.04, spark-3.4, java-8)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-ubuntu (ubuntu:20.04, spark-3.4, java-8)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-ubuntu (ubuntu:20.04, spark-3.4, java-8)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-ubuntu (ubuntu:20.04, spark-3.3, java-8)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-ubuntu (ubuntu:20.04, spark-3.3, java-8)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-ubuntu (ubuntu:22.04, spark-3.3, java-8)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-ubuntu (ubuntu:22.04, spark-3.3, java-8)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-ubuntu (ubuntu:20.04, spark-3.3, java-17)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-ubuntu (ubuntu:20.04, spark-3.3, java-17)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-ubuntu (ubuntu:22.04, spark-3.5, java-8)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-ubuntu (ubuntu:22.04, spark-3.5, java-8)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
run-tpc-test-ubuntu (ubuntu:20.04, spark-3.5, java-8)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
run-tpc-test-ubuntu (ubuntu:20.04, spark-3.5, java-8)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "velox-arrow-jar-centos-7-eaf52cb47d1ed62bda301eaeed711053ccf2c899", "velox-native-lib-centos-7-eaf52cb47d1ed62bda301eaeed711053ccf2c899". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/

Artifacts

Produced during runtime
Name Size
velox-arrow-jar-centos-7-eaf52cb47d1ed62bda301eaeed711053ccf2c899 Expired
20.3 MB
velox-native-lib-centos-7-eaf52cb47d1ed62bda301eaeed711053ccf2c899 Expired
296 MB