[GLUTEN-6887][VL] Daily Update Velox Version (2024_08_16)

[GlutenPerfBot]

Upstream Velox's New Commits:

fe9605f74 by Jialiang Tan, Change SharedArbitrator extra config string based (10685)
9523840ac by xiaoxmeng, Add to support byte input stream back by file (10717)

[github-actions]

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/apache/incubator-gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

• Other pull requests

[jinchengchenghh]

I make a workaround here because some API is removed by facebookincubator/velox#10717 and https://github.com/facebookincubator/velox/pull/10761/files

Can you help to refactor it when you are free? @marin-ma Thanks!

[marin-ma]

cc: @zhli1142015

[jinchengchenghh]

I meet this exception, because we call gluten::Runtime::registerFactory(gluten::kVeloxRuntimeKind, veloxRuntimeFactory); twice, create the velox backend in MemoryManagerTest and MultiMemoryManagerTest, do you have any suggestion? @zhztheplayer

/mnt/DP_disk1/code/gluten/cpp/build/velox/tests# ./velox_memory_test
Running main() from /mnt/DP_disk1/code/gluten/ep/build-velox/build/velox_ep/_build/release/_deps/gtest-src/googletest/src/gtest_main.cc
[==========] Running 3 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 2 tests from MemoryManagerTest
[ RUN      ] MemoryManagerTest.memoryPoolWithBlockReseravtion
[       OK ] MemoryManagerTest.memoryPoolWithBlockReseravtion (0 ms)
[ RUN      ] MemoryManagerTest.memoryAllocatorWithBlockReservation
[       OK ] MemoryManagerTest.memoryAllocatorWithBlockReservation (0 ms)
[----------] 2 tests from MemoryManagerTest (0 ms total)

[----------] 1 test from MultiMemoryManagerTest
unknown file: Failure
C++ exception with description "Runtime factory already registered for velox" thrown in SetUpTestSuite().
[ RUN      ] MultiMemoryManagerTest.spill
/mnt/DP_disk1/code/gluten/cpp/velox/tests/MemoryManagerTest.cc:342: Skipped

[  SKIPPED ] MultiMemoryManagerTest.spill (0 ms)
[----------] 1 test from MultiMemoryManagerTest (0 ms total)

[----------] Global test environment tear-down
[==========] 3 tests from 2 test suites ran. (33 ms total)
[  PASSED  ] 2 tests.
[  SKIPPED ] 1 test, listed below:
[  SKIPPED ] MultiMemoryManagerTest.spill
[  FAILED  ] 0 tests, listed below:

 0 FAILED TESTS
[  FAILED  ] MultiMemoryManagerTest: SetUpTestSuite or TearDownTestSuite

 1 FAILED TEST SUITE

[zhouyuan]

C++ exception with description "Runtime factory already registered for velox" thrown in SetUpTestSuite().

seems related with single-thread execution model.

[github-actions]

#6887

[GlutenPerfBot]

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query	log/native_master_08_16_2024_time.csv	log/native_master_08_15_2024_1845f30c4c_time.csv	difference	percentage
q1	40.99	40.51	-0.474	98.84%
q2	30.15	30.39	0.234	100.78%
q3	53.31	53.23	-0.080	99.85%
q4	42.30	44.25	1.947	104.60%
q5	105.58	102.93	-2.651	97.49%
q6	12.97	12.09	-0.882	93.20%
q7	116.05	116.78	0.730	100.63%
q8	116.44	117.10	0.664	100.57%
q9	168.30	169.16	0.867	100.52%
q10	66.48	66.73	0.254	100.38%
q11	27.13	26.55	-0.582	97.86%
q12	29.28	30.12	0.844	102.88%
q13	52.14	51.22	-0.925	98.23%
q14	25.75	24.79	-0.959	96.27%
q15	54.10	54.28	0.175	100.32%
q16	18.35	18.18	-0.171	99.07%
q17	131.98	130.17	-1.804	98.63%
q18	201.13	196.71	-4.418	97.80%
q19	28.08	27.00	-1.075	96.17%
q20	43.76	47.52	3.756	108.58%
q21	383.76	376.64	-7.111	98.15%
q22	15.87	15.77	-0.096	99.40%
total	1763.87	1752.12	-11.757	99.33%