Skip to content

SPARK-45894 hive table level setting hadoop.mapred.max.split.size #9

SPARK-45894 hive table level setting hadoop.mapred.max.split.size

SPARK-45894 hive table level setting hadoop.mapred.max.split.size #9

Triggered via push November 11, 2023 14:55
Status Failure
Total duration 2h 26m 23s
Artifacts 13

build_main.yml

on: push
Run  /  Base image build
55s
Run / Base image build
Run  /  Breaking change detection with Buf (branch-3.5)
53s
Run / Breaking change detection with Buf (branch-3.5)
Run  /  Run TPC-DS queries with SF=1
1h 15m
Run / Run TPC-DS queries with SF=1
Run  /  Run Docker integration tests
38m 14s
Run / Run Docker integration tests
Run  /  Run Spark on Kubernetes Integration test
1h 31m
Run / Run Spark on Kubernetes Integration test
Matrix: Run / build
Matrix: Run / java-other-versions
Run  /  Build modules: sparkr
15s
Run / Build modules: sparkr
Run  /  Linters, licenses, dependencies and documentation generation
16s
Run / Linters, licenses, dependencies and documentation generation
Matrix: Run / pyspark
Fit to window
Zoom out
Zoom in

Annotations

65 errors and 26 warnings
Run / Base image build
The process '/usr/bin/docker' failed with exit code 1
Run / Run Docker integration tests
Process completed with exit code 18.
Run / Build modules: pyspark-connect
Docker pull failed with exit code 1
Run / Build modules: pyspark-connect
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-connect
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-core, pyspark-streaming
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-core, pyspark-streaming
Docker pull failed with exit code 1
Run / Build modules: pyspark-core, pyspark-streaming
Value cannot be null. (Parameter 'ContainerId')
Run / Linters, licenses, dependencies and documentation generation
Docker pull failed with exit code 1
Run / Build modules: pyspark-errors
Docker pull failed with exit code 1
Run / Build modules: pyspark-errors
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-errors
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-pandas
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-pandas
Docker pull failed with exit code 1
Run / Build modules: pyspark-pandas
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-mllib, pyspark-ml, pyspark-ml-connect
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-mllib, pyspark-ml, pyspark-ml-connect
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-mllib, pyspark-ml, pyspark-ml-connect
Docker pull failed with exit code 1
Run / Build modules: pyspark-pandas-connect-part1
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-pandas-connect-part1
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-pandas-connect-part1
Docker pull failed with exit code 1
Run / Build modules: pyspark-pandas-connect-part2
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-pandas-connect-part2
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-pandas-connect-part2
Docker pull failed with exit code 1
Run / Build modules: pyspark-pandas-connect-part3
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-pandas-connect-part3
Docker pull failed with exit code 1
Run / Build modules: pyspark-pandas-connect-part3
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: sparkr
Docker pull failed with exit code 1
Run / Build modules: sparkr
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-pandas-connect-part0
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-pandas-connect-part0
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-pandas-connect-part0
Docker pull failed with exit code 1
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing
Docker pull failed with exit code 1
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-pandas-slow
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-pandas-slow
Value cannot be null. (Parameter 'ContainerId')
Run / Build modules: pyspark-pandas-slow
Docker pull failed with exit code 1
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-a2e2478bbf345d22-exec-1".
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-e2a7e38bbf358a49-exec-1".
Run / Run Spark on Kubernetes Integration test
sleep interrupted
Run / Run Spark on Kubernetes Integration test
Task io.fabric8.kubernetes.client.utils.internal.SerialExecutor$$Lambda$679/0x00007f16a45c1af8@d1bd383 rejected from java.util.concurrent.ThreadPoolExecutor@4ddcbff4[Shutting down, pool size = 2, active threads = 2, queued tasks = 0, completed tasks = 331]
Run / Run Spark on Kubernetes Integration test
sleep interrupted
Run / Run Spark on Kubernetes Integration test
Task io.fabric8.kubernetes.client.utils.internal.SerialExecutor$$Lambda$679/0x00007f16a45c1af8@4c29be4f rejected from java.util.concurrent.ThreadPoolExecutor@4ddcbff4[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 332]
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-cfacf98bbf54079c-exec-1".
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-86d1f78bbf55348f-exec-1".
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-9fe8b48bbf595219-exec-1".
Run / Run Spark on Kubernetes Integration test
Status(apiVersion=v1, code=404, details=StatusDetails(causes=[], group=null, kind=pods, name=spark-test-app-af5f793167b54a1bb1e4571282ada3c8-driver, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "spark-test-app-af5f793167b54a1bb1e4571282ada3c8-driver" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=NotFound, status=Failure, additionalProperties={})..
DB2IntegrationSuite.(It is not a test it is a sbt.testing.SuiteSelector): DB2IntegrationSuite#L1
com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST unix://localhost:80/images/create?fromImage=ibmcom%2Fdb2&tag=11.5.6.0a: 500, body: {"message":"Head \"https://registry-1.docker.io/v2/ibmcom/db2/manifests/11.5.6.0a\": EOF"}
DB2KrbIntegrationSuite.(It is not a test it is a sbt.testing.SuiteSelector): DB2KrbIntegrationSuite#L1
com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST unix://localhost:80/images/create?fromImage=ibmcom%2Fdb2&tag=11.5.6.0a: 500, body: {"message":"Head \"https://registry-1.docker.io/v2/ibmcom/db2/manifests/11.5.6.0a\": EOF"}
MySQLIntegrationSuite.(It is not a test it is a sbt.testing.SuiteSelector): MySQLIntegrationSuite#L1
com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST unix://localhost:80/images/create?fromImage=mysql&tag=8.0.31: 500, body: {"message":"Get \"https://registry-1.docker.io/v2/\": EOF"}
OracleIntegrationSuite.(It is not a test it is a sbt.testing.SuiteSelector): OracleIntegrationSuite#L1
com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST unix://localhost:80/images/create?fromImage=gvenzl%2Foracle-free&tag=23.3: 500, body: {"message":"Get \"https://registry-1.docker.io/v2/\": EOF"}
PostgresIntegrationSuite.(It is not a test it is a sbt.testing.SuiteSelector): PostgresIntegrationSuite#L1
com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST unix://localhost:80/images/create?fromImage=postgres&tag=15.1-alpine: 500, body: {"message":"Get \"https://registry-1.docker.io/v2/\": EOF"}
PostgresKrbIntegrationSuite.(It is not a test it is a sbt.testing.SuiteSelector): PostgresKrbIntegrationSuite#L1
com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST unix://localhost:80/images/create?fromImage=postgres&tag=15.1: 500, body: {"message":"Get \"https://registry-1.docker.io/v2/\": EOF"}
DB2IntegrationSuite.(It is not a test it is a sbt.testing.SuiteSelector): DB2IntegrationSuite#L1
com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST unix://localhost:80/images/create?fromImage=ibmcom%2Fdb2&tag=11.5.6.0a: 500, body: {"message":"Get \"https://registry-1.docker.io/v2/\": EOF"}
DB2NamespaceSuite.(It is not a test it is a sbt.testing.SuiteSelector): DB2NamespaceSuite#L1
com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST unix://localhost:80/images/create?fromImage=ibmcom%2Fdb2&tag=11.5.6.0a: 500, body: {"message":"Get \"https://registry-1.docker.io/v2/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"}
MySQLIntegrationSuite.(It is not a test it is a sbt.testing.SuiteSelector): MySQLIntegrationSuite#L1
com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST unix://localhost:80/images/create?fromImage=mysql&tag=8.0.31: 500, body: {"message":"Get \"https://registry-1.docker.io/v2/\": EOF"}
MySQLNamespaceSuite.(It is not a test it is a sbt.testing.SuiteSelector): MySQLNamespaceSuite#L1
com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST unix://localhost:80/images/create?fromImage=mysql&tag=8.0.31: 500, body: {"message":"Get \"https://registry-1.docker.io/v2/\": EOF"}
PostgresNamespaceSuite.(It is not a test it is a sbt.testing.SuiteSelector): PostgresNamespaceSuite#L1
com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST unix://localhost:80/images/create?fromImage=postgres&tag=15.1-alpine: 500, body: {"message":"Head \"https://registry-1.docker.io/v2/library/postgres/manifests/15.1-alpine\": EOF"}
DB2KrbIntegrationSuite.(It is not a test it is a sbt.testing.SuiteSelector): DB2KrbIntegrationSuite#L1
com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST unix://localhost:80/images/create?fromImage=ibmcom%2Fdb2&tag=11.5.6.0a: 500, body: {"message":"Get \"https://registry-1.docker.io/v2/\": EOF"}
MySQLIntegrationSuite.(It is not a test it is a sbt.testing.SuiteSelector): MySQLIntegrationSuite#L1
com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST unix://localhost:80/images/create?fromImage=mysql&tag=8.0.31: 500, body: {"message":"Get \"https://registry-1.docker.io/v2/\": EOF"}
PostgresIntegrationSuite.(It is not a test it is a sbt.testing.SuiteSelector): PostgresIntegrationSuite#L1
com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST unix://localhost:80/images/create?fromImage=postgres&tag=15.1-alpine: 500, body: {"message":"Head \"https://registry-1.docker.io/v2/library/postgres/manifests/15.1-alpine\": Get \"https://auth.docker.io/token?account=githubactions&scope=repository%3Alibrary%2Fpostgres%3Apull&service=registry.docker.io\": EOF"}
PostgresKrbIntegrationSuite.(It is not a test it is a sbt.testing.SuiteSelector): PostgresKrbIntegrationSuite#L1
com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST unix://localhost:80/images/create?fromImage=postgres&tag=15.1: 500, body: {"message":"Head \"https://registry-1.docker.io/v2/library/postgres/manifests/15.1\": EOF"}
MySQLIntegrationSuite.(It is not a test it is a sbt.testing.SuiteSelector): MySQLIntegrationSuite#L1
com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST unix://localhost:80/images/create?fromImage=mysql&tag=8.0.31: 500, body: {"message":"Get \"https://registry-1.docker.io/v2/library/mysql/manifests/sha256:3d7ae561cf6095f6aca8eb7830e1d14734227b1fb4748092f2be2cfbccf7d614\": EOF"}
PostgresIntegrationSuite.(It is not a test it is a sbt.testing.SuiteSelector): PostgresIntegrationSuite#L1
com.spotify.docker.client.exceptions.DockerRequestException: Request error: POST unix://localhost:80/images/create?fromImage=postgres&tag=15.1-alpine: 500, body: {"message":"Head \"https://registry-1.docker.io/v2/library/postgres/manifests/15.1-alpine\": EOF"}
Run / Build modules: pyspark-connect
Docker pull failed with exit code 1, back off 3.927 seconds before retry.
Run / Build modules: pyspark-connect
Docker pull failed with exit code 1, back off 3.183 seconds before retry.
Run / Build modules: pyspark-core, pyspark-streaming
Docker pull failed with exit code 1, back off 1.506 seconds before retry.
Run / Build modules: pyspark-core, pyspark-streaming
Docker pull failed with exit code 1, back off 6.159 seconds before retry.
Run / Linters, licenses, dependencies and documentation generation
Docker pull failed with exit code 1, back off 8.735 seconds before retry.
Run / Linters, licenses, dependencies and documentation generation
Docker pull failed with exit code 1, back off 3.816 seconds before retry.
Run / Build modules: pyspark-errors
Docker pull failed with exit code 1, back off 6.061 seconds before retry.
Run / Build modules: pyspark-errors
Docker pull failed with exit code 1, back off 6.334 seconds before retry.
Run / Build modules: pyspark-pandas
Docker pull failed with exit code 1, back off 2.379 seconds before retry.
Run / Build modules: pyspark-pandas
Docker pull failed with exit code 1, back off 3.294 seconds before retry.
Run / Build modules: pyspark-mllib, pyspark-ml, pyspark-ml-connect
Docker pull failed with exit code 1, back off 7.663 seconds before retry.
Run / Build modules: pyspark-mllib, pyspark-ml, pyspark-ml-connect
Docker pull failed with exit code 1, back off 6.141 seconds before retry.
Run / Build modules: pyspark-pandas-connect-part1
Docker pull failed with exit code 1, back off 3.369 seconds before retry.
Run / Build modules: pyspark-pandas-connect-part1
Docker pull failed with exit code 1, back off 8.666 seconds before retry.
Run / Build modules: pyspark-pandas-connect-part2
Docker pull failed with exit code 1, back off 5.695 seconds before retry.
Run / Build modules: pyspark-pandas-connect-part2
Docker pull failed with exit code 1, back off 1.989 seconds before retry.
Run / Build modules: pyspark-pandas-connect-part3
Docker pull failed with exit code 1, back off 7.461 seconds before retry.
Run / Build modules: pyspark-pandas-connect-part3
Docker pull failed with exit code 1, back off 7.75 seconds before retry.
Run / Build modules: sparkr
Docker pull failed with exit code 1, back off 4.397 seconds before retry.
Run / Build modules: sparkr
Docker pull failed with exit code 1, back off 3.318 seconds before retry.
Run / Build modules: pyspark-pandas-connect-part0
Docker pull failed with exit code 1, back off 8.779 seconds before retry.
Run / Build modules: pyspark-pandas-connect-part0
Docker pull failed with exit code 1, back off 8.754 seconds before retry.
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing
Docker pull failed with exit code 1, back off 3.331 seconds before retry.
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing
Docker pull failed with exit code 1, back off 5.441 seconds before retry.
Run / Build modules: pyspark-pandas-slow
Docker pull failed with exit code 1, back off 3.776 seconds before retry.
Run / Build modules: pyspark-pandas-slow
Docker pull failed with exit code 1, back off 7.821 seconds before retry.

Artifacts

Produced during runtime
Name Size
spark-on-kubernetes-it-log Expired
434 KB
test-results-api, catalyst, hive-thriftserver--17-hadoop3-hive2.3 Expired
2.8 MB
test-results-core, unsafe, kvstore, avro, utils, network-common, network-shuffle, repl, launcher, examples, sketch--17-hadoop3-hive2.3 Expired
133 KB
test-results-docker-integration--17-hadoop3-hive2.3 Expired
123 KB
test-results-hive-- other tests-17-hadoop3-hive2.3 Expired
917 KB
test-results-hive-- slow tests-17-hadoop3-hive2.3 Expired
857 KB
test-results-mllib-local, mllib, graphx--17-hadoop3-hive2.3 Expired
1.31 MB
test-results-sql-- extended tests-17-hadoop3-hive2.3 Expired
2.98 MB
test-results-sql-- other tests-17-hadoop3-hive2.3 Expired
4.26 MB
test-results-sql-- slow tests-17-hadoop3-hive2.3 Expired
2.78 MB
test-results-streaming, sql-kafka-0-10, streaming-kafka-0-10, yarn, kubernetes, hadoop-cloud, spark-ganglia-lgpl, connect, protobuf--17-hadoop3-hive2.3 Expired
800 KB
test-results-tpcds--17-hadoop3-hive2.3 Expired
21.9 KB
unit-tests-log-docker-integration--17-hadoop3-hive2.3 Expired
1.83 MB