[CH] Memory limit exceeded: would use 1.00 PiB

[baibaichen]

Backend

CH (ClickHouse)

Bug description

After #7101, when running the following sql

select `TEST_MEASURE`.`ID1`,
       count(distinct `TEST_MEASURE`.`ID1`, `TEST_MEASURE`.`ID2`, `TEST_MEASURE`.`ID3`, `TEST_MEASURE`.`ID4`,
             `TEST_MEASURE`.`PRICE1`, `TEST_MEASURE`.`PRICE2`, `TEST_MEASURE`.`PRICE3`, `TEST_MEASURE`.`PRICE5`,
             `TEST_MEASURE`.`PRICE6`, `TEST_MEASURE`.`PRICE7`, `TEST_MEASURE`.`NAME1`, `TEST_MEASURE`.`NAME2`,
             `TEST_MEASURE`.`NAME3`, `TEST_MEASURE`.`NAME4`, `TEST_MEASURE`.`TIME1`, `TEST_MEASURE`.`TIME2`,
             `TEST_MEASURE`.`FLAG`),
       1
from `TEST_MEASURE`
         left join `TEST_MEASURE1` on `TEST_MEASURE`.`ID1` = `TEST_MEASURE1`.`ID1`
group by `TEST_MEASURE`.`ID1`

we get following exception:

Exception in thread "Executor task launch worker for task 0.0 in stage 14.0 (TID 10)" 2024-09-26 03:48:19.730 <Error> local_engine: Enter java exception handle.
org.apache.gluten.exception.GlutenException: org.apache.gluten.exception.GlutenException: Memory limit exceeded: would use 1.00 PiB (attempt to allocate chunk of 1125899907053810 bytes), current RSS 0.00 B, maximum: 512.00 MiB.: While executing GraceMergingAggregatedTransform
0. /gluten_backend/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000013fafab9
1. /gluten_backend/src/Common/Exception.cpp:109: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c3369d9
2. /gluten_backend/src/Common/Exception.h:110: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x0000000006673b6c
3. /gluten_backend/src/Common/Exception.h:128: DB::Exception::Exception<char const*, char const*, String, long&, String, String, char const*, std::basic_string_view<char, std::char_traits<char>>>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<char const*>::type, std::type_identity<std::basic_string_view<char, std::char_traits<char>>>::type>, char const*&&, char const*&&, String&&, long&, String&&, String&&, char const*&&, std::basic_string_view<char, std::char_traits<char>>&&) @ 0x000000000c35cec9
4. /gluten_backend/src/Common/MemoryTracker.cpp:318: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000000c35bed2
5. /gluten_backend/src/Common/MemoryTracker.cpp:377: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x000000000c35ba96
6. /gluten_backend/src/Common/CurrentMemoryTracker.cpp:64: CurrentMemoryTracker::allocImpl(long, bool) @ 0x000000000c3053be
7. /gluten_backend/src/Common/Allocator.cpp:151: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x000000000c3037a7
8. void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::realloc<>(unsigned long) @ 0x000000000674dcab

Spark version

None

Spark configurations

No response

System information

No response

Relevant logs

No response