Skip to content

Commit

Permalink
update comment
Browse files Browse the repository at this point in the history
  • Loading branch information
marin-ma committed Sep 5, 2024
1 parent 2a1385c commit e34ce56
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions cpp/velox/shuffle/VeloxSortShuffleWriter.cc
Original file line number Diff line number Diff line change
Expand Up @@ -104,8 +104,8 @@ arrow::Status VeloxSortShuffleWriter::init() {
options_.partitioning == Partitioning::kSingle,
arrow::Status::Invalid("VeloxSortShuffleWriter doesn't support single partition."));
allocateMinimalArray();
// In Spark, sortedBuffer_ memory and compressionBuffer_ memory are pre-allocated and not counted into executor
// memory. To align with Spark, we use arrow::default_memory_pool() to avoid counting these memory in Gluten.
// In Spark, sortedBuffer_ memory and compressionBuffer_ memory are pre-allocated and counted into executor
// memory overhead. To align with Spark, we use arrow::default_memory_pool() to avoid counting these memory in Gluten.
ARROW_ASSIGN_OR_RAISE(
sortedBuffer_, arrow::AllocateBuffer(options_.compressionBufferSize, arrow::default_memory_pool()));
rawBuffer_ = sortedBuffer_->mutable_data();
Expand Down

0 comments on commit e34ce56

Please sign in to comment.