Skip to content

Commit

Permalink
[VL] Daily Update Velox Version (2023-12-20) (#4114)
Browse files Browse the repository at this point in the history
Rebase Velox 2023-12-20

```
5144f14 Add next_day Spark function (#7333)
b57f14b Fix static initialization order of default memory manager (#8098)
ef47305 Revert D51867634: Multisect successfully blamed "D51867634: [velox][PR] Scatter struct nulls when deserializing Presto wire format" for otest failure (#8105)
eb71c70 Back out "Extract files used in ReaderTest to helper file"
7c42ddc Expose memory leak metrics (#8095)
ce212f1 Specify units of individual counters in ExchangeSource.stats (#8005)
f0b1ae0 Add per-driver cpu time slicing support (#8083)
0f32527 Move velox_aggregation_fuzzer_test and spark_aggregation_fuzzer_test to the fuzzer directory (#8007)
2ada2ec Add schema to parquet writer options (#6074)
050c16c Extract files used in ReaderTest to helper file (#7740)
f08cb12 Optimize Presto Serialization (#8029)
```
  • Loading branch information
GlutenPerfBot authored Dec 20, 2023
1 parent edf649e commit 4f7b4e4
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions cpp/velox/operators/writer/VeloxParquetDatasource.cc
Original file line number Diff line number Diff line change
Expand Up @@ -124,9 +124,9 @@ void VeloxParquetDatasource::init(const std::unordered_map<std::string, std::str
return std::make_unique<velox::parquet::LambdaFlushPolicy>(
maxRowGroupRows_, maxRowGroupBytes_, [&]() { return false; });
};
writeOption.schema = gluten::fromArrowSchema(schema_);
auto schema = gluten::fromArrowSchema(schema_);

parquetWriter_ = std::make_unique<velox::parquet::Writer>(std::move(sink_), writeOption, pool_);
parquetWriter_ = std::make_unique<velox::parquet::Writer>(std::move(sink_), writeOption, pool_, asRowType(schema));
}

void VeloxParquetDatasource::inspectSchema(struct ArrowSchema* out) {
Expand Down

0 comments on commit 4f7b4e4

Please sign in to comment.