Skip to content

Commit

Permalink
[VL] Fix sort based shuffle oom in spill when compress was disabled (a…
Browse files Browse the repository at this point in the history
…pache#7553)

Co-authored-by: antmeta_antspark <[email protected]>
  • Loading branch information
clay4megtr and antmeta_antspark authored Dec 13, 2024
1 parent 05b1e7a commit 67b6831
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion cpp/core/shuffle/rss/RssPartitionWriter.cc
Original file line number Diff line number Diff line change
Expand Up @@ -85,7 +85,7 @@ arrow::Status RssPartitionWriter::doEvict(
inMemoryPayload->toBlockPayload(
payloadType, payloadPool_.get(), codec_ ? codec_.get() : nullptr, std::move(compressed)));
// Copy payload to arrow buffered os.
ARROW_ASSIGN_OR_RAISE(auto rssBufferOs, arrow::io::BufferOutputStream::Create(options_.pushBufferMaxSize, pool_));
ARROW_ASSIGN_OR_RAISE(auto rssBufferOs, arrow::io::BufferOutputStream::Create(options_.pushBufferMaxSize));
RETURN_NOT_OK(payload->serialize(rssBufferOs.get()));
payload = nullptr; // Invalidate payload immediately.

Expand Down

0 comments on commit 67b6831

Please sign in to comment.