Code

[VL] Fix ORC related failed UT#3437

Code

Closed

chenxu14 wants to merge 182 commits intoapache:upstream_veloxapache/incubator-gluten:upstream_veloxfrom chenxu14:chenxu14_devchenxu14/gluten:chenxu14_devCopy head branch name to clipboard

+44,455-9,902

Commits

Commits on Oct 18, 2023

• [GLUTEN-3417][CH] Reduce memory consumption in Expand operator apache#3418

  Show description for 8cc1e2c
  lgbo-ustc

  authored
  8cc1e2c

  Copy full SHA for 8cc1e2c

• [VL] Remove ColumnarToRow for Gluten columnar table cache (apache#3430)

  PHILO-HE

  authored
  7fbd3fc

  Copy full SHA for 7fbd3fc

• [VL] Copy compress small partition buffer (apache#3420)

  marin-ma

  authored
  1ab906a

  Copy full SHA for 1ab906a

• [CORE] fix CoalesceExec (apache#3372)

  Show description for 353c45a
  zhouyuan

  authored
  353c45a

  Copy full SHA for 353c45a

• Revert "[VL] Copy compress small partition buffer (apache#3420)" (apache#3433)

  marin-ma

  authored
  4dbb181

  Copy full SHA for 4dbb181

Commits on Oct 19, 2023

• [GLUTEN-2961][VL] Integrate with upstream Velox (apache#3341)

  Show description for 6cbd786
  

  7 peopleauthored
  6cbd786

  Copy full SHA for 6cbd786

• [VL] Copy-compress small partition buffer (apache#3434)

  marin-ma

  authored
  048d981

  Copy full SHA for 048d981

• [GLUTEN-3425] Create not existing HDFS folder when writing HDFS file (apache#3428)

  JkSelf

  authored
  a713d5e

  Copy full SHA for a713d5e

• [CORE] Code refactor: simplify transformer classes (apache#3426)

  ulysses-you

  authored
  6090cea

  Copy full SHA for 6090cea

• [VL] Increase kAbandonPartialAggregationMinRows (apache#3439)

  Show description for 86abf0a
  rui-mo

  authored
  86abf0a

  Copy full SHA for 86abf0a

• [VL][DOC] Refine the document about parquet write (apache#3441)

  Show description for a9324e6
  JkSelf

  authored
  a9324e6

  Copy full SHA for a9324e6

Commits on Oct 20, 2023

• [GLUTEN-2961][VL][FOLLOWUP] Fix issue on macOS (apache#3455)

  ulysses-you

  authored
  60e92e4

  Copy full SHA for 60e92e4

• [GLUTEN-3361] Support spark 3.4 in Gluten (apache#3360)

  Show description for 3e73f32
  JkSelf

  authored
  3e73f32

  Copy full SHA for 3e73f32

• [GLUTEN-3431][CH] Fix convertion from Inf to int

  Show description for 84599e1
  lgbo-ustc

  authored
  84599e1

  Copy full SHA for 84599e1

Commits on Oct 22, 2023

• [GLUTEN-3480][CH] Fix incorrect metrics values for ch backend (apache#3481)

  Show description for 30d78a1
  zzcclp

  authored
  30d78a1

  Copy full SHA for 30d78a1

Commits on Oct 23, 2023

• [GLUTEN-3467] Fix 'Names of tuple elements must be unique' error for ch backend (apache#3468)

  Show description for f1a0a3e
  zzcclp

  authored
  f1a0a3e

  Copy full SHA for f1a0a3e

• [GLUTEN-1632][CH]Daily Update Clickhouse Version (20231023) (apache#3482)

  Show description for 83d6cbf
  

  lwz9103

  and

  kyligence-git

  authored
  83d6cbf

  Copy full SHA for 83d6cbf

• [VL] Decouple JNI object storing code from ExecutionCtx (apache#3457)

  zhztheplayer

  authored
  327b8eb

  Copy full SHA for 327b8eb

• [VL] Fix duplicate metrics updating caused by R2C (apache#2865)

  rui-mo

  authored
  71b3793

  Copy full SHA for 71b3793

• [GLUTEN-3446][CH] Fix unprecise issue when parse float from string (apache#3453)

  Show description for 04d8ac2
  taiyang-li

  authored
  04d8ac2

  Copy full SHA for 04d8ac2

• [VL] Allow to enable or disable huge page allocation feature in Velox (apache#3483)

  Show description for 400a161
  marin-ma

  authored
  400a161

  Copy full SHA for 400a161

• GLUTEN-3361] Fix the compile issue with wrong Empty2Null package path in spark 3.4

  JkSelf

  authored
  c9014ae

  Copy full SHA for c9014ae

• [GLUTEN-3489] Fix exception when in-filter contains null value (apache#3491)

  lwz9103

  authored
  ecb5cef

  Copy full SHA for ecb5cef

• [GLUTEN-3459] Skip unnecessary local sort for static partition write (apache#3460)

  lwz9103

  authored
  19335ba

  Copy full SHA for 19335ba

• Fix a typo in error message of native backend initialization (apache#3495)

  j7nhai

  authored
  5cec4f9

  Copy full SHA for 5cec4f9

• [VL] Fix a compile issue after rebasing velox (apache#3484)

  PHILO-HE

  authored
  157f42c

  Copy full SHA for 157f42c

Commits on Oct 24, 2023

• fix round issue: apache#3462 (apache#3494)

  taiyang-li

  authored
  edc2c53

  Copy full SHA for edc2c53

• [VL] Remove unnecessary registerFileSystem and registerReader

  Yohahaha

  authored
  fd44284

  Copy full SHA for fd44284

• [VL] Add config for glog verbose level and severity level (apache#3454)

  Show description for d8f310a
  Yohahaha

  authored
  d8f310a

  Copy full SHA for d8f310a

• [VL] Fix Arrow ABI include (apache#3493)

  marin-ma

  authored
  cebe098

  Copy full SHA for cebe098

• [VL] Register row_constructor_with_null (apache#3499)

  rui-mo

  authored
  2aaf07b

  Copy full SHA for 2aaf07b

• [GLUTEN-3450][CH] Support allowPrecisionLoss=false (apache#3463)

  Show description for 7d5e8fb
  loneylee

  authored
  7d5e8fb

  Copy full SHA for 7d5e8fb

• [VL] Add stream insertion operator for SparkTaskInfo on native side (apache#3449)

  Yohahaha

  authored
  3637aee

  Copy full SHA for 3637aee

• [VL] Remove unnecessary registerConnectorFactory (apache#3442)

  Yohahaha

  authored
  471bd81

  Copy full SHA for 471bd81

• [VL] Remove the usage of isUnquotedPathCharacter in Velox (apache#3503)

  rui-mo

  authored
  edf5c50

  Copy full SHA for edf5c50

• [GLUTEN-3412][CH]Bug fix element_at 1st argument is map type (apache#3413)

  Show description for 277d1c4
  KevinyhZou

  authored
  277d1c4

  Copy full SHA for 277d1c4

Commits on Oct 25, 2023

• [VL] Use existing constructor for BigintRange and MultiRange (apache#3508)

  rui-mo

  authored
  9197780

  Copy full SHA for 9197780

• Fix cache output if selectedAttributes has wrong ordering with cacheAttributes (apache#3504)

  Show description for 43c6a42
  

  ulysses-you

  and

  yaooqinn

  authored
  43c6a42

  Copy full SHA for 43c6a42

• [GLUTEN-3512][CH] tolerate empty blocks when native writing (apache#3513)

  Show description for 778e8c5
  exmy

  authored
  778e8c5

  Copy full SHA for 778e8c5

• [GLUTEN-3511][CORE] Support to add custom aggregate functions for extension (apache#3514)

  Show description for f2ea6ca
  zzcclp

  authored
  f2ea6ca

  Copy full SHA for f2ea6ca

• [GLUTEN-1632][CH]Daily Update Clickhouse Version (20231025) (apache#3518)

  Show description for 7cf1a9d
  

  lwz9103

  and

  kyligence-git

  authored
  7cf1a9d

  Copy full SHA for 7cf1a9d

• [GLUTEN-3501][CH]Skip null values in to_json function (apache#3523)

  Show description for 0e867cf
  taiyang-li

  authored
  0e867cf

  Copy full SHA for 0e867cf

• [CORE] Fix convertBroadcastExchangeToColumnar for non-WholeStageCodegen fallback (apache#3424)

  liujiayi771

  authored
  caf959e

  Copy full SHA for caf959e

• [GLUTEN-3383][CH] Respect spark config spark.sql.orc.compression.codec for CH backend (apache#3487)

  Show description for 27e6f84
  taiyang-li

  authored
  27e6f84

  Copy full SHA for 27e6f84

• [VL] Adapt to latest rebased velox (10/25) (apache#3519)

  PHILO-HE

  authored
  05650cc

  Copy full SHA for 05650cc

Commits on Oct 26, 2023

• [VL] Fix native cmake include path (apache#3502)

  Yohahaha

  authored
  dd7eab4

  Copy full SHA for dd7eab4

• [Core] Shuffle the configured local directories for local spills (apache#3525)

  marin-ma

  authored
  9cd88de

  Copy full SHA for 9cd88de

• [GLUTEN-3509][CH]Fix partition lock problems in shuffle write

  Show description for 84b56e8
  KevinyhZou

  authored
  84b56e8

  Copy full SHA for 84b56e8

• [VL] Simplify the conversion from Substrait type to Velox type (apache#3471)

  rui-mo

  authored
  02bf40c

  Copy full SHA for 02bf40c

• [VL] Apply patch to Velox for compilation (apache#3520)

  rui-mo

  authored
  eb46721

  Copy full SHA for eb46721

• [CORE] Simplify hasNext and next functions of iterator (apache#3490)

  rui-mo

  authored
  d571c1f

  Copy full SHA for d571c1f

• [VL] Fix single partitioning evict error (apache#3522)

  marin-ma

  authored
  2ad99de

  Copy full SHA for 2ad99de

• [VL] Add EvictGuard to avoid spilling recursively in ShuffleWriter (apache#3529)

  marin-ma

  authored
  77a4b18

  Copy full SHA for 77a4b18

• [GLUTEN-3516][VL] Fix centos8 build failure when HDFS enabled (apache#3515)

  j7nhai

  authored
  5038204

  Copy full SHA for 5038204

• [CELEBORN] Optimize the performance of Celeborn's pushPartitionData (apache#3533)

  kerwin-zk

  authored
  87372db

  Copy full SHA for 87372db

• [GLUTEN-3531][VL] Build: Undefined reference while linking velox_plan_conversion_test in debug build

  Show description for f03d78f
  zhztheplayer

  authored
  f03d78f

  Copy full SHA for f03d78f

• [GLUTEN-3535][CH] Support hive transform dirs recursive (apache#3536)

  Show description for 8e8d25b
  loneylee

  authored
  8e8d25b

  Copy full SHA for 8e8d25b

• [GLUTEN-3534][CH] Fix incorrect logic of judging whether supports pre-project for the shuffle (apache#3537)

  Show description for 8fa19ba
  zzcclp

  authored
  8fa19ba

  Copy full SHA for 8fa19ba

• [GLUTEN-3297][CH] Refactor filter push down framework in gluten, support orc FPD and reuse parquet FPD in CH. (apache#3301)

  Show description for a03e2b3
  taiyang-li

  authored
  a03e2b3

  Copy full SHA for a03e2b3

• [GLUTEN-1632][CH]Daily Update Clickhouse Version (20231026) (apache#3530)

  Show description for d3b91cd
  

  3 peopleauthored
  d3b91cd

  Copy full SHA for d3b91cd

Commits on Oct 27, 2023

• [GLUTEN-3425] [VL] Fix the issue of incorrectly creating an HDFS path when writing a Parquet file into the HDFS directory (apache#3464)

  Show description for db7f98b
  JkSelf

  authored
  db7f98b

  Copy full SHA for db7f98b

• [GLUTEN-3538][VL] Build: Unregistered hive connector factory in debug build (apache#3539)

  zhztheplayer

  authored
  2085835

  Copy full SHA for 2085835

• [VL] Refine shuffle writer return types and namespace (apache#3544)

  marin-ma

  authored
  a21395e

  Copy full SHA for a21395e

• [CORE] Do not fall back eagerly with one ColumnarToRowExec (apache#3496)

  ulysses-you

  authored
  478e0c1

  Copy full SHA for 478e0c1

Commits on Oct 28, 2023

• [GLUTEN-1632][CH]Daily Update Clickhouse Version (20231028) (apache#3555)

  Show description for a7b68c3
  

  3 peopleauthored
  a7b68c3

  Copy full SHA for a7b68c3

Commits on Oct 30, 2023

• [VL] Iterator's and its payloads' lifecycle improvements (apache#3526)

  zhztheplayer

  authored
  39a5162

  Copy full SHA for 39a5162

• [HOTFIX][CH] Ignore 'test hive parquet_orc table, all columns being partitioned.' test cast (apache#3565)

  Show description for f4c419e
  zzcclp

  authored
  f4c419e

  Copy full SHA for f4c419e

Commits on Oct 31, 2023

• [VL] Use value of spark.io.compression.codec as Velox's spill codec

  jinchengchenghh

  authored
  599d959

  Copy full SHA for 599d959

• [GLUTEN-1632][CH]Daily Update Clickhouse Version (20231031) (apache#3568)

  Show description for d6d996c
  lwz9103

  authored
  d6d996c

  Copy full SHA for d6d996c

• [VL] Shrink min sized partition buffers and spill (apache#3265)

  marin-ma

  authored
  d0ec931

  Copy full SHA for d0ec931

Commits on Nov 1, 2023

• [GLUTEN-3359] Add Spark3.4 unit test framework (apache#3497)

  Show description for f37e9af
  JkSelf

  authored
  f37e9af

  Copy full SHA for f37e9af

• [CORE] Simplify WholeStageTransformer and BroadcastBuildSideRDD (apache#3574)

  ulysses-you

  authored
  0c59a5d

  Copy full SHA for 0c59a5d

• [VL] Fix an undefined reference issue to adapt to rebased velox (11/01) (apache#3575)

  PHILO-HE

  authored
  697b2bd

  Copy full SHA for 697b2bd

Commits on Nov 2, 2023

• [CORE] Consider the cost when applying stage fallback policy (apache#3569)

  PHILO-HE

  authored
  81fae1e

  Copy full SHA for 81fae1e

• [VL] In OAP Velox fork, simplify shrinking/spilling code for Velox memory pool (apache#3586)

  zhztheplayer

  authored
  27defd8

  Copy full SHA for 27defd8

• [VL] Support left Spark function (apache#3588)

  Show description for e597c59
  PHILO-HE

  authored
  e597c59

  Copy full SHA for e597c59

• [VL] Add EvictState and EvictGuard in shuffle writer (apache#3585)

  marin-ma

  authored
  f82737a

  Copy full SHA for f82737a

• [GLUTEN-3590][CORE] Reduce driver memory usage by using serialized bytes for substrait plan in GlutenPartition (apache#3591)

  exmy

  authored
  805d909

  Copy full SHA for 805d909

• Clear the buffer before serialize (apache#3578)

  Show description for 78104be
  JkSelf

  authored
  78104be

  Copy full SHA for 78104be

Commits on Nov 3, 2023

• [VL] Gluten-it: Fix a trivial cli parameter parsing bug (apache#3597)

  zhztheplayer

  authored
  5f8591e

  Copy full SHA for 5f8591e

• [VL] Refine setting shuffle writer local directories (apache#3601)

  marin-ma

  authored
  55f1480

  Copy full SHA for 55f1480

• [GLUTEN-3598][CH] Support to config the hash algorithm for the ch shuffle hash partitioner (apache#3604)

  Show description for 07ba657
  zzcclp

  authored
  07ba657

  Copy full SHA for 07ba657

• [GLUTEN-3542][CH] Cancel empty string as null representation when readi… (apache#3543)

  Show description for 1bacef5
  lhuang09287750

  authored
  1bacef5

  Copy full SHA for 1bacef5

• [GLUTEN-1632][CH]Daily Update Clickhouse Version (20231103) (apache#3605)

  Show description for b1d098d
  

  3 peopleauthored
  b1d098d

  Copy full SHA for b1d098d

• [VL] Disable columnar table cache by default (apache#3488)

  gaoyangxiaozhu

  authored
  1788834

  Copy full SHA for 1788834

• [GLUTEN-3602][VL] Sed install_awssdk function to setup-centos8.sh#velox on centos8 (apache#3600)

  Show description for 8ee2bac
  dcoliversun

  authored
  8ee2bac

  Copy full SHA for 8ee2bac

• [HOTFIX][CH] Using sparkMurmurHash3_32 function instead of the murmurHash3_32 for the shuffle hash algorithm (apache#3613)

  Show description for 13a0a63
  zzcclp

  authored
  13a0a63

  Copy full SHA for 13a0a63

Commits on Nov 4, 2023

• [VL] Replace string comparisons with enum for shuffle partitioning (apache#3611)

  marin-ma

  authored
  16e2874

  Copy full SHA for 16e2874

Commits on Nov 6, 2023

• [VL] Align names of decimal compare functions (apache#3593)

  rui-mo

  authored
  7185955

  Copy full SHA for 7185955

• [CORE] Optimize some methods in agg transformer (apache#3564)

  liujiayi771

  authored
  ba045c7

  Copy full SHA for ba045c7

• [CORE] Remove ColumnarAQEShuffleRead (apache#3607)

  ulysses-you

  authored
  87b3c2e

  Copy full SHA for 87b3c2e

• [CORE] Add GlutenImplicits to get FallbackSummary easily (apache#3599)

  ulysses-you

  authored
  05c7435

  Copy full SHA for 05c7435

• [VL] Refine cmake flags to decrease normal build time (apache#3485)

  Yohahaha

  authored
  bd7abeb

  Copy full SHA for bd7abeb

• [GLUTEN-3521][CH] Fix substring start index can not be 0 (apache#3524)

  Show description for c68e495
  KevinyhZou

  authored
  c68e495

  Copy full SHA for c68e495

• Bug fix csv read field whitespaces (apache#3554)

  KevinyhZou

  authored
  52552c9

  Copy full SHA for 52552c9

• Bug fix to_date can not convert 1970-01-01 (apache#3563)

  KevinyhZou

  authored
  d57fdf2

  Copy full SHA for d57fdf2

Commits on Nov 7, 2023

• [VL] GHA CI: Add cases for aggregation within limited memory (apache#3622)

  zhztheplayer

  authored
  40ef132

  Copy full SHA for 40ef132

• [CORE] Remove unnecessary case match in getAttrForAggregateExpr (apache#3629)

  liujiayi771

  authored
  7308fdb

  Copy full SHA for 7308fdb

• [CORE] Use collection interface in method parameter and return type (apache#3603)

  liujiayi771

  authored
  c470b9b

  Copy full SHA for c470b9b

• [GLUTEN-3141][CH] Rewrite date comparison expression into a more efficient way (apache#3592)

  Show description for 5d4cac1
  lgbo-ustc

  authored
  5d4cac1

  Copy full SHA for 5d4cac1

• fix issue 3627 (apache#3630)

  lhuang09287750

  authored
  9c2d057

  Copy full SHA for 9c2d057

• fix issue 3609 (apache#3614)

  lhuang09287750

  authored
  a14baf3

  Copy full SHA for a14baf3

• Fix the compile issue when rebasing upstream velox to 11/7 (apache#3624)

  JkSelf

  authored
  e3eff1d

  Copy full SHA for e3eff1d

Commits on Nov 8, 2023

• [VL] Fix failed to get iterator exception from file format writer (apache#3641)

  JkSelf

  authored
  b60fe75

  Copy full SHA for b60fe75

• [CORE] Refine maven Spark dependency (apache#3625)

  Show description for 427971d
  ulysses-you

  authored
  427971d

  Copy full SHA for 427971d

• [VL] Add find and build glog/gflags to cmake (apache#3638)

  marin-ma

  authored
  2b9891b

  Copy full SHA for 2b9891b

• [GLUTEN-1632][CH]Daily Update Clickhouse Version (20231108) (apache#3640)

  Show description for 1080543
  

  3 peopleauthored
  1080543

  Copy full SHA for 1080543

• [CH] Add using gperftools doc for CH (apache#3628)

  Show description for 0473d67
  zhanglistar

  authored
  0473d67

  Copy full SHA for 0473d67

• [GLUTEN-3625][FOLLOWUP] Fix IDEA load module issue (apache#3647)

  Show description for 0e99bb6
  ulysses-you

  authored
  0e99bb6

  Copy full SHA for 0e99bb6

• [VL] Allow users to set bloom filter configurations (apache#3610)

  Show description for 4a72871
  zhli1142015

  authored
  4a72871

  Copy full SHA for 4a72871

• [GLUTEN-3553][CH] Support bucket scan for ch backend (apache#3618)

  Show description for 3ec7bed
  zzcclp

  authored
  3ec7bed

  Copy full SHA for 3ec7bed

• [GLUTEN-3644][CH] Revert the logic to support the custom aggregate functions (apache#3648)

  Show description for a090556
  zzcclp

  authored
  a090556

  Copy full SHA for a090556

• [GLUTEN-3572][VL] Remove --arrow_home option and fix "libarrow not found" in debug mode (apache#3573)

  Surbhi-Vijay

  authored
  29b5899

  Copy full SHA for 29b5899

Commits on Nov 9, 2023

• Add duplicated sorting keys validation in TopNNode (apache#3642)

  Show description for 2bb522f
  JkSelf

  authored
  2bb522f

  Copy full SHA for 2bb522f

• [CI] Improve CI to auto close stale patch (apache#3634)

  Show description for c7780fe
  zhouyuan

  authored
  c7780fe

  Copy full SHA for c7780fe

• [VL] Refactor split buffer allocation (apache#3177)

  Show description for 5ee4e34
  marin-ma

  authored
  5ee4e34

  Copy full SHA for 5ee4e34

• [VL] Support custom cmake deps download url (apache#3652)

  Yohahaha

  authored
  451eb66

  Copy full SHA for 451eb66

• [GLUTEN-1648][VL] Support max_by/min_by aggregate function (apache#2336)

  Yohahaha

  authored
  fee6529

  Copy full SHA for fee6529

• [VL] remove unused libhdfs binaries (apache#3656)

  Show description for 745ecb3
  zhouyuan

  authored
  745ecb3

  Copy full SHA for 745ecb3

Commits on Nov 10, 2023

• [GLUTEN-3637][VL] Fix whole stage pipeline metric (apache#3661)

  Yohahaha

  authored
  33003d4

  Copy full SHA for 33003d4

• Fix the duplicated key exception in TopN (apache#3655)

  Show description for 3ecf596
  JkSelf

  authored
  3ecf596

  Copy full SHA for 3ecf596

• [GLUTEN-3625][FOLLOWUP] Recover to the use of hardcode module name (apache#3659)

  ulysses-you

  authored
  047c993

  Copy full SHA for 047c993

• [VL] Fix for a corner case may break bhj + exchange validation (apache#3595)

  zhztheplayer

  authored
  337b9d9

  Copy full SHA for 337b9d9

• [CH] Use max_block_size controller read mergetree block size (apache#3669)

  Show description for 6be077d
  loneylee

  authored
  6be077d

  Copy full SHA for 6be077d

• [GLUTEN-3668][CH] Performance regresses seriously after PR 3169 merge when executing convert string to date (apache#3671)

  Show description for bd483c9
  zzcclp

  authored
  bd483c9

  Copy full SHA for bd483c9

• [CORE] Fix ExpandExecTransformer miss input (apache#3665)

  ulysses-you

  authored
  797770d

  Copy full SHA for 797770d

Commits on Nov 11, 2023

• [CI] bump checkout action to v4 (apache#3681)

  Show description for 3a64f2e
  zhouyuan

  authored
  3a64f2e

  Copy full SHA for 3a64f2e

Commits on Nov 12, 2023

• [GLUTEN-1632][CH]Daily Update Clickhouse Version (20231112) (apache#3683)

  Show description for 5b632f6
  

  3 peopleauthored
  5b632f6

  Copy full SHA for 5b632f6

Commits on Nov 13, 2023

• [Gluten-core][VL] Support RewriteTransformer Rules and DeltaLake 2.2 Scan (apache#3646)

  Show description for 19800f9
  YannByron

  authored
  19800f9

  Copy full SHA for 19800f9

• [CORE] Deprecate RegularMemoryConsumer, use TreeMemoryConsumer for both isolated/shared memory mode (apache#3673)

  zhztheplayer

  authored
  1f6c6c3

  Copy full SHA for 1f6c6c3

• [VL] Fix shuffle ignores uncompressed compression configuration (apache#3672)

  marin-ma

  authored
  139c8a1

  Copy full SHA for 139c8a1

• [GLUTEN-3670][CH] Support escape with excel format (apache#3674)

  Show description for 70061ac
  loneylee

  authored
  70061ac

  Copy full SHA for 70061ac

• [VL] Declare IntermediateTypes for specific agg function (apache#3679)

  liujiayi771

  authored
  7cf715b

  Copy full SHA for 7cf715b

Commits on Nov 14, 2023

• [VL] Enable Spark functions for translate, add_months, array_min & array_max (apache#3687)

  PHILO-HE

  authored
  5dabb5b

  Copy full SHA for 5dabb5b

• [VL] bump faster xml version to 2.13.5 (apache#3688)

  zhouyuan

  authored
  f7d6386

  Copy full SHA for f7d6386

• [VL] Fix validate issues for Generate and validate CaseWhen expression on native side (apache#3682)

  jackylee-ch

  authored
  0f9f196

  Copy full SHA for 0f9f196

• fix issue 3689 (apache#3691)

  lhuang09287750

  authored
  6c38a76

  Copy full SHA for 6c38a76

• [VL] use velox config lib to extract the configurations from spark (apache#3694)

  Show description for bc25d07
  FelixYBW

  authored
  bc25d07

  Copy full SHA for bc25d07

• [GLUTEN-1632][CH]Daily Update Clickhouse Version (20231114) (apache#3698)

  Show description for 3e42cb0
  

  3 peopleauthored
  3e42cb0

  Copy full SHA for 3e42cb0

Commits on Nov 15, 2023

• [GLUTEN-3705][CORE] Support mapping one custom aggregate function to more than one backend functions (apache#3708)

  Show description for 31e354f
  zzcclp

  authored
  31e354f

  Copy full SHA for 31e354f

• Add doc using jemalloc with ch backend. (apache#3725)

  zhanglistar

  authored
  4713b47

  Copy full SHA for 4713b47

• [CH] Fix nativeBufferSize assign bug (apache#3717)

  Show description for 2449443
  zhanglistar

  authored
  2449443

  Copy full SHA for 2449443

• [MINOR] Code refactor for ColumnarShuffleExchange constructing apache#3720

  PHILO-HE

  authored
  857872e

  Copy full SHA for 857872e

• [GLUTEN-3711][VL] Fix printConf to Support Velox Config apache#3710

  Show description for 36c9208
  

  ted-jenks

  and

  Ted Jenks

  authored
  36c9208

  Copy full SHA for 36c9208

• [GLUTEN-3635][VL] Clean up docs related to build-arrow paths (apache#3709)

  ted-jenks

  authored
  b2c62cd

  Copy full SHA for b2c62cd

Commits on Nov 16, 2023

• [HOTFIX][CH] Fix randomly failed ut for PR#3537 (apache#3714)

  Show description for 808e091
  zzcclp

  authored
  808e091

  Copy full SHA for 808e091

• [GLUTEN-3705][FOLLOW][CH] Set the correct agg schema names after mapping one agg function to the other name (apache#3734)

  Show description for c5ae59d
  zzcclp

  authored
  c5ae59d

  Copy full SHA for c5ae59d

• [VL] Fix validation runtime handle leak (apache#3730)

  ulysses-you

  authored
  8abe4d3

  Copy full SHA for 8abe4d3

• [VL] rebase velox to 20231114 (apache#3735)

  Show description for fea2222
  FelixYBW

  authored
  fea2222

  Copy full SHA for fea2222

• [VL][DOC] Move TPC-H/DS workload to tools/ and fix doc link (apache#3737)

  PHILO-HE

  authored
  a42bca9

  Copy full SHA for a42bca9

• [CH] Optimize aggregate state serialization performance (apache#3279)

  Show description for aab6dbe
  liuneng1994

  authored
  aab6dbe

  Copy full SHA for aab6dbe

• [GLUTEN-1902] Separate the implementations for TranslateTransformer (apache#1903)

  PHILO-HE

  authored
  6c9c81b

  Copy full SHA for 6c9c81b

• [CI] increase operations per run for stale action (apache#3699)

  Show description for 510b228
  zhouyuan

  authored
  510b228

  Copy full SHA for 510b228

Commits on Nov 17, 2023

• [CORE] Remove redundant case match for HiveTableScanExecTransformer in PreOverrides rule (apache#3738)

  exmy

  authored
  efbe2f3

  Copy full SHA for efbe2f3

• reduce libch.so size (apache#3746)

  zhanglistar

  authored
  5db72cf

  Copy full SHA for 5db72cf

• [CORE] set default spark.version to 3.4.1 (apache#3727)

  Show description for 4df8832
  zhouyuan

  authored
  4df8832

  Copy full SHA for 4df8832

• [GLUTEN-3548][CH] Bug fix csv file cr at end of line (apache#3549)

  Show description for 9956fba
  KevinyhZou

  authored
  9956fba

  Copy full SHA for 9956fba

• [GLUTEN-3692][CH]Fix count no result on empty table (apache#3693)

  Show description for f21a96f
  KevinyhZou

  authored
  f21a96f

  Copy full SHA for f21a96f

• [VL] rebase to velox 2023-11-14 (apache#3747)

  Show description for cb4e7b7
  FelixYBW

  authored
  cb4e7b7

  Copy full SHA for cb4e7b7

• [VL]Avoid unnecessary filter binding for subfield (apache#3300)

  Show description for a662f3f
  yma11

  authored
  a662f3f

  Copy full SHA for a662f3f

• [GLUTEN-3378][CORE] Move getLocalFilesNode logic to scan transformer (apache#3650)

  Show description for 49b8e06
  liujiayi771

  authored
  49b8e06

  Copy full SHA for 49b8e06

• [GLUTEN-3739][VL] Add a config to control velox's file handle cache (apache#3753)

  Show description for 23c2e4c
  zhli1142015

  authored
  23c2e4c

  Copy full SHA for 23c2e4c

• [GLUTEN-3668][CH]Fix to_date function performance (apache#3701)

  Show description for ad23092
  KevinyhZou

  authored
  ad23092

  Copy full SHA for ad23092

• [GLUTEN-1632][CH]Daily Update Clickhouse Version (20231117) (apache#3756)

  Show description for bb88f4f
  

  3 peopleauthored
  bb88f4f

  Copy full SHA for bb88f4f

Commits on Nov 18, 2023

• [VL] Enable spill-to-disk for partial aggregation (apache#3697)

  zhztheplayer

  authored
  5f5d18a

  Copy full SHA for 5f5d18a

Commits on Nov 20, 2023

• [GLUTEN-3749][VL] fix redundant Velox build (apache#3759)

  Show description for 48496c0
  zhouyuan

  authored
  48496c0

  Copy full SHA for 48496c0

• [VL] Activate random kill tasks GHA CI job (apache#3761)

  zhztheplayer

  authored
  dc75cca

  Copy full SHA for dc75cca

• [CELEBORN] Fix push small data (apache#3766)

  exmy

  authored
  cb18fc1

  Copy full SHA for cb18fc1

• [VL] [Minor] Fix compile error in debug mode (apache#3765)

  Show description for 7553cd1
  

  JkSelf

  and

  zhztheplayer

  authored
  7553cd1

  Copy full SHA for 7553cd1

• [CORE] Support get native plan tree string (apache#3729)

  Show description for 6983898
  

  ulysses-you

  and

  yaooqinn

  authored
  6983898

  Copy full SHA for 6983898

• [GLUTEN-3779][CH] Fix core dump when executing sql with runtime filter (apache#3781)

  Show description for 60fc2a0
  zzcclp

  authored
  60fc2a0

  Copy full SHA for 60fc2a0

Commits on Nov 21, 2023

• Add config to specify the window type in velox backend (apache#3703)

  JkSelf

  authored
  92356bc

  Copy full SHA for 92356bc

• [GLUTEN-3715] [VL] Add GCS support in velox backend (apache#2634)

  Show description for 1b489d1
  tigrux

  authored
  1b489d1

  Copy full SHA for 1b489d1

• [VL] update pacakge.sh for spark34 (apache#3786)

  Show description for b22c862
  zhouyuan

  authored
  b22c862

  Copy full SHA for b22c862

• [VL] Respect spark.gluten.sql.debug in native side (apache#3748)

  Yohahaha

  authored
  018da4c

  Copy full SHA for 018da4c

• [GLUTEN-3719][VL] Introduce VeloxIntermediateData to adjust agg func intermediate types (apache#3721)

  liujiayi771

  authored
  f29077e

  Copy full SHA for f29077e

• Make debug behavior clear (apache#3793)

  Show description for 7c640bd
  

  ulysses-you

  and

  yaooqinn

  authored
  7c640bd

  Copy full SHA for 7c640bd

• [VL] Fix parquet writer passing wrong param (apache#3790)

  marin-ma

  authored
  0d4e43c

  Copy full SHA for 0d4e43c

• [VL] Ban flaky unit tests (apache#3798)

  Show description for 30865e5
  zhouyuan

  authored
  30865e5

  Copy full SHA for 30865e5

• [CORE][VL] Add naitve plan string and plan with stats (apache#3787)

  Show description for b40a5f0
  ulysses-you

  authored
  b40a5f0

  Copy full SHA for b40a5f0

Commits on Nov 22, 2023

• [VL] Add configuration for generating 4k window size gzip parquet file (apache#3792)

  marin-ma

  authored
  5966579

  Copy full SHA for 5966579

• [VL] Fix ORC related failed UT

  chenxu14

  committed
  fc04d0c

  Copy full SHA for fc04d0c