Skip to content

[VL] Optimize the performance of hash based shuffle by accumulating batches #2330

[VL] Optimize the performance of hash based shuffle by accumulating batches

[VL] Optimize the performance of hash based shuffle by accumulating batches #2330

Job Run time
1h 18m 40s
1h 35m 11s
22m 6s
22m 55s
19m 18s
14m 28s
20m 4s
34m 13s
19m 14s
20m 46s
31m 36s
59m 37s
19m 32s
33m 4s
1h 19m 43s
20m 30s
33m 31s
19m 37s
32m 57s
19m 4s
31m 54s
20m 10s
31m 29s
31m 48s
31m 49s
23m 23s
1h 8m 36s
27m 9s
1h 3m 41s
56m 36s
28m 54s
33m 25s
1h 7m 15s
20h 12m 15s