[CH-247] support async reader when reading parquet from hdfs#248

Open

binmahone wants to merge 670 commits intoKyligence:clickhouse_backendfrom binmahone:tp_async_reader_2

+128,374-48,233

This pull request is big! We're only showing the most recent 250 commits

Commits on Dec 14, 2021

Commits on Dec 16, 2021

Merge pull request ClickHouse#32718 from ClickHouse/backport/21.9/27822
Vitaly Baranov
authored
Merge pull request ClickHouse#32541 from ClickHouse/backport/21.9/32201
tavplubix
authored
Merge pull request ClickHouse#32790 from ClickHouse/backport/21.9/32755
alesapin
authored

Commits on Dec 17, 2021

fix memory error
neng.liu
committed

Commits on Dec 22, 2021

init code of Q6
neng.liu
committed

Commits on Dec 27, 2021

support filter and aggregate
neng.liu
committed
fix benchmark error
neng.liu
committed
add agg benchmark
neng.liu
committed

Commits on Dec 28, 2021

Commits on Dec 29, 2021

upgrade substrait
Neng Liu
committed
print test result
neng.liu
committed

Commits on Dec 30, 2021

Commits on Jan 4, 2022

add rpm config
neng.liu
committed
add rpm config
neng.liu
committed

Commits on Jan 5, 2022

remove runtime dependency
neng.liu
committed

Commits on Jan 10, 2022

support equal to
neng.liu
committed
fix ut fail
neng.liu
committed

Commits on Jan 13, 2022

Fix start index
zzcclp
committed

Commits on Jan 14, 2022

Merge pull request ClickHouse#1 from liuneng1994/fix_start_index
liuneng1994
authored
support duckdb parquet reader
neng.liu
committed
support date
neng.liu
committed

Commits on Jan 24, 2022

some optimize
neng.liu
committed

Commits on Jan 26, 2022

Commits on Jan 27, 2022

add merge tree test
neng.liu
committed

Commits on Jan 28, 2022

add filter benchmark
neng.liu
committed

Commits on Feb 21, 2022

Commits on Feb 22, 2022

support mergetree on jni
neng.liu
committed
add part selection
neng.liu
committed

Commits on Feb 23, 2022

remove jni
neng.liu
committed

Commits on Feb 24, 2022

change so dependency in rpm
neng.liu
committed
remove java
neng.liu
committed

Commits on Feb 28, 2022

optimize merge tree load parts
neng.liu
committed
add benchmark for executor create
neng.liu
committed

Commits on Mar 1, 2022

optimize mergetree
liuneng1994
committed

Commits on Mar 2, 2022

add logger
liuneng1994
committed

Commits on Mar 4, 2022

optimize cmake
neng.liu
committed

Commits on Mar 8, 2022

refactor code
neng.liu
committed

Commits on Mar 10, 2022

change config
liuneng1994
committed

Commits on Mar 16, 2022

add splitter
liuneng1994
committed

Commits on Mar 17, 2022

Commits on Mar 18, 2022

Backport ClickHouse#35378 to 22.3: Fix possible deadlock in cache
robot-clickhouse
committed

Commits on Mar 20, 2022

Backport ClickHouse#35409 to 22.3: Fix race in data type Object
robot-clickhouse
committed
Merge pull request ClickHouse#35441 from ClickHouse/backport/22.3/35409
CurtizJ
authored

Commits on Mar 23, 2022

Commits on Mar 24, 2022

Commits on Mar 25, 2022

add reader
liuneng1994
committed

Commits on Mar 30, 2022

support columnar tpch q6
liuneng1994
committed
[GJ-75] Unify function names

zzcclp
authored and
liuneng1994
committed

Commits on Mar 31, 2022

Backport ClickHouse#35755 to 22.3: Fix bug in conversion from custom types to string
robot-clickhouse
committed

Commits on Apr 1, 2022

Commits on Apr 2, 2022

Commits on Apr 3, 2022

Commits on Apr 4, 2022

Commits on Apr 5, 2022

Commits on Apr 8, 2022

Commits on Apr 11, 2022

Commits on Apr 12, 2022

fix rebase error
liuneng1994
committed
change benchmark error column
liuneng1994
committed
add time print in transform
liuneng1994
committed
fix filter actionDag has useless column
liuneng1994
committed
fix parse alias function failed
liuneng1994
committed
fix compile error in benchmark

liuneng1994
authored and
zzcclp
committed
fix metrics error

liuneng1994
authored and
zzcclp
committed
add mergetree data generate tool

liuneng1994
authored and
zzcclp
committed
change jni package name

liuneng1994
authored and
zzcclp
committed
add new benchmark

liuneng1994
authored and
zzcclp
committed
change benchmark error column

liuneng1994
authored and
zzcclp
committed
add time print in transform

liuneng1994
authored and
zzcclp
committed
fix filter actionDag has useless column

liuneng1994
authored and
zzcclp
committed
fix parse alias function failed

liuneng1994
authored and
zzcclp
committed

Commits on Apr 16, 2022

fix rebase compile error
liuneng1994
committed

Commits on Apr 27, 2022

Support TPCH Q1 (ClickHouse#8 )
liuneng1994
authored

Commits on Apr 28, 2022

fix hash partition error (ClickHouse#14 )
liuneng1994
authored

Commits on May 9, 2022

[CH-18] Supported substrait cast node (ClickHouse#19 )
zzcclp
authored

Commits on May 10, 2022

add blob and s3 read support (ClickHouse#20 )
liuneng1994
authored

Commits on May 25, 2022

Commits on Jun 1, 2022

fix join use nulls and support post join filter (ClickHouse#27 )
liuneng1994
authored

Commits on Jun 7, 2022

add function result cast (ClickHouse#32 )
liuneng1994
authored

Commits on Jun 9, 2022

add native c2r (ClickHouse#33 )
liuneng1994
authored

Commits on Jun 15, 2022

Support broadCast join (ClickHouse#34 )
liuneng1994
authored

Commits on Jun 22, 2022

a lot of optimization (ClickHouse#35 )
liuneng1994
authored

Commits on Jun 30, 2022

Support new shuffle (ClickHouse#36 )

liuneng1994
and
zzcclp
authored

Commits on Jul 1, 2022

fix mem leak (ClickHouse#37 )
liuneng1994
authored

Commits on Jul 12, 2022

Using NewWeakGlobalRef instead of NewGlobalRef (ClickHouse#38 )
zzcclp
authored

Commits on Jul 13, 2022

fix join duplicate table error (ClickHouse#39 )
liuneng1994
authored

Commits on Jul 14, 2022

add context clean when unload lib (ClickHouse#40 )
liuneng1994
authored

Commits on Jul 22, 2022

Optimize clickhouse arrow parquet reader (ClickHouse#41 )
liuneng1994
authored

Commits on Aug 18, 2022

Support nullable datatype (ClickHouse#51 )
liuneng1994
authored

Commits on Aug 19, 2022

support const column in c2r (ClickHouse#54 )
liuneng1994
authored

Commits on Aug 22, 2022

Commits on Aug 24, 2022

add BlockIterator to manage memory between java and cpp (ClickHouse#62 )
liuneng1994
authored

Commits on Aug 25, 2022

Commits on Aug 29, 2022

Commits on Aug 30, 2022

[CH-87] fix min max on date32 (ClickHouse#96 )
Hongbin Ma
authored

Commits on Aug 31, 2022

fix aggregate nullable boolean column failed (ClickHouse#99 )
liuneng1994
authored

Commits on Sep 1, 2022

Commits on Sep 2, 2022

Commits on Sep 8, 2022

[CH-107] Support Native RowToColumnar (ClickHouse#114 )
Hongbin Ma
authored

Commits on Sep 14, 2022

修复编译过程中的Warning (ClickHouse#106 )
taiyang-li
authored

Commits on Sep 15, 2022

Commits on Sep 16, 2022

catch c++ exceptions and rethrow java exceptions (ClickHouse#126 )
lgbo-ustc
authored

Commits on Sep 20, 2022

fixed : cover more jni interfaces for catching c++ exceptions (ClickHouse#127 )
lgbo-ustc
authored

Commits on Sep 21, 2022

Commits on Sep 22, 2022

Commits on Sep 27, 2022

Reduce log output (ClickHouse#134 )
liuneng1994
authored

Commits on Sep 30, 2022

Commits on Oct 10, 2022

improve: catch java exception in c++ (ClickHouse#143 )
lgbo-ustc
authored

Commits on Oct 12, 2022

Support loading setting from config file and improve logging. (ClickHouse#118 )

taiyang-li
and
lgbo-ustc
authored

Commits on Oct 13, 2022

revert log level to error (ClickHouse#148 )
liuneng1994
authored

Commits on Oct 14, 2022

[CH-123] Support short/byte/binary/decimal/array/map/struct (ClickHouse#128 )
taiyang-li
authored

Commits on Oct 17, 2022

Revert "[CH-123] Support short/byte/binary/decimal/array/map/struct (ClickHouse#128 )" (ClickHouse#159 )
liuneng1994
authored

Commits on Oct 20, 2022

support right semi join on substrait (ClickHouse#164 )
liuneng1994
authored

Commits on Oct 21, 2022

[CH-120] Support memory manager (ClickHouse#168 )
liuneng1994
authored

Commits on Oct 24, 2022

Commits on Oct 26, 2022

Commits on Oct 31, 2022

Commits on Nov 2, 2022

fix concurrent problem in allocator (ClickHouse#183 )
liuneng1994
authored

Commits on Nov 3, 2022

[CH-170] Implement strings functions between spark and clickhouse: concat/instr/char_length/replace/abs/chr/ceil/floor/exp/power (ClickHouse#172 )
taiyang-li
authored

Commits on Nov 4, 2022

[CH-123] Support short/byte/binary/decimal/array/map/struct (ClickHouse#163 )
taiyang-li
authored

Commits on Nov 11, 2022

Commits on Nov 13, 2022

[CH-190] enable tests in GlutenDataFrameAggregateSuite (ClickHouse#192 )
Hongbin Ma
authored

Commits on Nov 21, 2022

Commits on Nov 22, 2022

[CH-186] support RangePartitioning (ClickHouse#189 )
lgbo-ustc
authored

Commits on Nov 30, 2022

finish shift left and right (ClickHouse#217 )
taiyang-li
authored

Commits on Dec 1, 2022

fix failed ch ut in apache/incubator-gluten#620 (ClickHouse#224 )
taiyang-li
authored

Commits on Dec 5, 2022

support trim both (ClickHouse#211 )
taiyang-li
authored

Commits on Dec 6, 2022

finish debug (ClickHouse#209 )
taiyang-li
authored

Commits on Dec 7, 2022

[CH-225]Fix decimal bug cased by big-endian encoding in spark row. (ClickHouse#228 )
taiyang-li
authored

Commits on Dec 12, 2022

Improve: reducing the open operation for the same file when reading parquet files (ClickHouse#213 )
lgbo-ustc
authored

Commits on Dec 13, 2022

Commits on Dec 15, 2022

support map[key] and array[index] operator for gluten (ClickHouse#216 )
taiyang-li
authored

Commits on Dec 19, 2022

Commits on Dec 20, 2022

[CH-219] Support rlike/regexp_replace/regexp_extract/coalesce/DATE_ADD/DATE_SUB/DATEDIFF/modulo/concat_ws/collect_list/FROM_UNIXTIME (ClickHouse#230 )

taiyang-li
and
rvasin
authored

Commits on Dec 26, 2022

Commits on Dec 27, 2022

[CH-247] support async reader when reading parquet from hdfs
binmahone
committed

Commits on Jan 4, 2023

not null

liuneng1994
authored and
binmahone
committed