Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Layout range reader #2298

Open
wants to merge 11 commits into
base: develop
Choose a base branch
from
Open

Layout range reader #2298

wants to merge 11 commits into from

Conversation

gatesn
Copy link
Contributor

@gatesn gatesn commented Feb 10, 2025

Possible solution to sharing cached layout reads across row splits.

Alternative (possibly simpler...) would just be to tell the layout reader to invalidate a row-range from its caches.

@gatesn gatesn added the benchmark Run benchmarks on this branch label Feb 10, 2025
@github-actions github-actions bot removed the benchmark Run benchmarks on this branch label Feb 10, 2025
Copy link
Contributor

Benchmarks: random_access

Table of Results
name PR d819de9 base cc1658f ratio (PR/base) unit
random-access/vortex-tokio-local-disk 2.9581e+06 2.61702e+06 1.13033 ns
random-access/vortex-local-fs 3.55059e+06 2.94477e+06 1.20573 ns
random-access/parquet-tokio-local-disk 2.1981e+08 2.21545e+08 0.992168 ns

Copy link

codspeed-hq bot commented Feb 10, 2025

CodSpeed Performance Report

Merging #2298 will degrade performances by 34.95%

Comparing ngates/layout-range-reader (bf786a0) with develop (cc1658f)

Summary

❌ 1 regressions
✅ 260 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Benchmarks breakdown

Benchmark BASE HEAD Change
vortex 860.3 ns 1,322.5 ns -34.95%

Copy link
Contributor

Benchmarks: Clickbench

Table of Results
name PR d819de9 base cc1658f ratio (PR/base) unit
clickbench_q00/parquet 2099740 2.59061e+06 0.81052 ns
clickbench_q01/parquet 61794298 5.92364e+07 1.04318 ns
clickbench_q02/parquet 120496149 1.16711e+08 1.03243 ns
clickbench_q03/parquet 86569091 8.42009e+07 1.02813 ns
clickbench_q04/parquet 638605023 6.39746e+08 0.998217 ns
clickbench_q05/parquet 704688323 6.90136e+08 1.02109 ns
clickbench_q06/parquet 2119100 2.17884e+06 0.97258 ns
clickbench_q07/parquet 61909748 6.37675e+07 0.970867 ns
clickbench_q08/parquet 731645131 7.48423e+08 0.977582 ns
clickbench_q09/parquet 1039471179 1.00776e+09 1.03146 ns
clickbench_q10/parquet 255120239 2.5645e+08 0.994813 ns
clickbench_q11/parquet 304437358 3.01177e+08 1.01083 ns
clickbench_q12/parquet 725664481 7.15447e+08 1.01428 ns
clickbench_q13/parquet 968626536 9.60124e+08 1.00886 ns
clickbench_q14/parquet 714479084 6.88595e+08 1.03759 ns
clickbench_q15/parquet 773478927 7.17595e+08 1.07788 ns
clickbench_q16/parquet 1540524814 1.49382e+09 1.03126 ns
clickbench_q17/parquet 1381456895 1.37908e+09 1.00172 ns
clickbench_q18/parquet 2952708707 2.94041e+09 1.00418 ns
clickbench_q19/parquet 67708697 6.63815e+07 1.01999 ns
clickbench_q20/parquet 1167799083 1.13586e+09 1.02812 ns
clickbench_q21/parquet 1305464805 1.3052e+09 1.0002 ns
clickbench_q22/parquet 1908843253 1.90636e+09 1.0013 ns
clickbench_q23/parquet 7743660162 7.66922e+09 1.00971 ns
clickbench_q24/parquet 442076890 4.34675e+08 1.01703 ns
clickbench_q25/parquet 388686865 3.87961e+08 1.00187 ns
clickbench_q26/parquet 485873313 4.82974e+08 1.006 ns
clickbench_q27/parquet 1550253964 1.53305e+09 1.01122 ns
clickbench_q28/parquet 11517427083 1.12568e+10 1.02315 ns
clickbench_q29/parquet 429997225 4.27929e+08 1.00483 ns
clickbench_q30/parquet 666300552 6.71464e+08 0.992309 ns
clickbench_q31/parquet 696108778 6.99992e+08 0.994453 ns
clickbench_q32/parquet 2797664823 2.72873e+09 1.02526 ns
clickbench_q33/parquet 2860023671 2.80403e+09 1.01997 ns
clickbench_q34/parquet 2744187948 2.785e+09 0.985346 ns
clickbench_q35/parquet 841121486 8.43442e+08 0.997249 ns
clickbench_q36/parquet 177767222 1.71769e+08 1.03492 ns
clickbench_q37/parquet 82954295 8.23848e+07 1.00691 ns
clickbench_q38/parquet 109287296 1.08483e+08 1.00741 ns
clickbench_q39/parquet 314993888 3.12967e+08 1.00648 ns
clickbench_q40/parquet 51806249 5.02829e+07 1.03029 ns
clickbench_q41/parquet 48216508 4.88934e+07 0.986156 ns
clickbench_q42/parquet 70327663 6.65442e+07 1.05686 ns
clickbench_q00/vortex-file-compressed 2143665 2.09687e+06 1.02232 ns
clickbench_q01/vortex-file-compressed 14468083 1.43645e+07 1.00721 ns
clickbench_q02/vortex-file-compressed 134181633 1.60241e+08 0.837372 ns
clickbench_q03/vortex-file-compressed 101454460 1.08821e+08 0.932307 ns
clickbench_q04/vortex-file-compressed 636493917 6.43671e+08 0.98885 ns
clickbench_q05/vortex-file-compressed 688387709 7.07003e+08 0.973671 ns
clickbench_q06/vortex-file-compressed 2227219 2.21329e+06 1.00629 ns
clickbench_q07/vortex-file-compressed 26009736 2.57998e+07 1.00814 ns
clickbench_q08/vortex-file-compressed 777792514 8.16275e+08 0.952856 ns
clickbench_q09/vortex-file-compressed 804995905 8.92021e+08 0.902441 ns
clickbench_q10/vortex-file-compressed 190171498 1.99819e+08 0.95172 ns
clickbench_q11/vortex-file-compressed 210940749 2.21792e+08 0.951074 ns
clickbench_q12/vortex-file-compressed 545812471 6.05717e+08 0.901101 ns
clickbench_q13/vortex-file-compressed 775096653 8.41198e+08 0.92142 ns
clickbench_q14/vortex-file-compressed 518618720 5.70883e+08 0.90845 ns
clickbench_q15/vortex-file-compressed 748803065 7.39013e+08 1.01325 ns
clickbench_q16/vortex-file-compressed 1461142261 1.44482e+09 1.0113 ns
clickbench_q17/vortex-file-compressed 1331211533 1.34193e+09 0.992011 ns
clickbench_q18/vortex-file-compressed 2904438388 2.85653e+09 1.01677 ns
clickbench_q19/vortex-file-compressed 38096570 5.05046e+07 0.754319 ns
clickbench_q20/vortex-file-compressed 697058060 7.13119e+08 0.977478 ns
clickbench_q21/vortex-file-compressed 806563596 8.19881e+08 0.983757 ns
clickbench_q22/vortex-file-compressed 1613608529 1.69601e+09 0.951413 ns
clickbench_q23/vortex-file-compressed 3666018590 3.98552e+09 0.919834 ns
clickbench_q24/vortex-file-compressed 270938048 2.81595e+08 0.962157 ns
clickbench_q25/vortex-file-compressed 246950633 2.62251e+08 0.941658 ns
clickbench_q26/vortex-file-compressed 332559761 3.45204e+08 0.963372 ns
clickbench_q27/vortex-file-compressed 1326807505 1.32837e+09 0.998826 ns
clickbench_q28/vortex-file-compressed 11091889190 1.06937e+10 1.03723 ns
clickbench_q29/vortex-file-compressed 2386522632 2.32283e+09 1.02742 ns
clickbench_q30/vortex-file-compressed 477653725 4.94993e+08 0.964971 ns
clickbench_q31/vortex-file-compressed 485175671 5.43779e+08 0.89223 ns
clickbench_q32/vortex-file-compressed 2907337098 2.7873e+09 1.04307 ns
clickbench_q33/vortex-file-compressed 2358603852 2.27646e+09 1.03608 ns
clickbench_q34/vortex-file-compressed 2345872193 2.27725e+09 1.03014 ns
clickbench_q35/vortex-file-compressed 1021073886 9.66615e+08 1.05634 ns
clickbench_q36/vortex-file-compressed 203284333 1.92703e+08 1.05491 ns
clickbench_q37/vortex-file-compressed 116564483 1.15473e+08 1.00945 ns
clickbench_q38/vortex-file-compressed 123564177 1.17036e+08 1.05578 ns
clickbench_q39/vortex-file-compressed 340609716 3.38038e+08 1.00761 ns
clickbench_q40/vortex-file-compressed 41442972 3.90929e+07 1.06012 ns
clickbench_q41/vortex-file-compressed 49995778 4.63027e+07 1.07976 ns
clickbench_q42/vortex-file-compressed 57108216 5.51087e+07 1.03628 ns

Copy link
Contributor

Benchmarks: TPC-H

Table of Results
name PR d819de9 base cc1658f ratio (PR/base) unit
tpch_q01/arrow 581009529 5.55423e+08 1.04607 ns
tpch_q01/parquet 796221064 7.72073e+08 1.03128 ns
tpch_q01/vortex-file-compressed 643095459 6.4586e+08 0.995719 ns
tpch_q02/arrow 148353276 1.4604e+08 1.01584 ns
tpch_q02/parquet 179886045 1.76376e+08 1.0199 ns
tpch_q02/vortex-file-compressed 142117858 1.45687e+08 0.975504 ns
tpch_q03/arrow 179372004 1.79187e+08 1.00103 ns
tpch_q03/parquet 378817948 3.84203e+08 0.985985 ns
tpch_q03/vortex-file-compressed 258421696 2.55389e+08 1.01187 ns
tpch_q04/arrow 218748376 2.24603e+08 0.973934 ns
tpch_q04/parquet 218441853 2.23162e+08 0.978847 ns
tpch_q04/vortex-file-compressed 191210167 1.98146e+08 0.964994 ns
tpch_q05/arrow 334546030 3.45699e+08 0.967738 ns
tpch_q05/parquet 527491564 5.31344e+08 0.99275 ns
tpch_q05/vortex-file-compressed 429832815 4.32011e+08 0.994958 ns
tpch_q06/arrow 27561435 2.66814e+07 1.03298 ns
tpch_q06/parquet 152492325 1.53113e+08 0.995944 ns
tpch_q06/vortex-file-compressed 64765838 5.8484e+07 1.10741 ns
tpch_q07/arrow 667886193 6.47856e+08 1.03092 ns
tpch_q07/parquet 800935573 7.82849e+08 1.0231 ns
tpch_q07/vortex-file-compressed 650918058 6.60027e+08 0.986198 ns
tpch_q08/arrow 282764159 2.76802e+08 1.02154 ns
tpch_q08/parquet 575756624 5.73648e+08 1.00368 ns
tpch_q08/vortex-file-compressed 434798252 4.38732e+08 0.991035 ns
tpch_q09/arrow 503730418 4.82073e+08 1.04493 ns
tpch_q09/parquet 813646493 7.91715e+08 1.0277 ns
tpch_q09/vortex-file-compressed 694283313 7.05074e+08 0.984696 ns
tpch_q10/arrow 281848026 2.75287e+08 1.02383 ns
tpch_q10/parquet 529460563 5.23232e+08 1.0119 ns
tpch_q10/vortex-file-compressed 298092079 2.89443e+08 1.02988 ns
tpch_q11/arrow 148427435 1.42414e+08 1.04223 ns
tpch_q11/parquet 161896770 1.53696e+08 1.05335 ns
tpch_q11/vortex-file-compressed 128218176 1.34964e+08 0.950015 ns
tpch_q12/arrow 186278302 1.85645e+08 1.00341 ns
tpch_q12/parquet 331774357 3.32441e+08 0.997996 ns
tpch_q12/vortex-file-compressed 252251125 2.66538e+08 0.946398 ns
tpch_q13/arrow 173093399 1.76331e+08 0.981638 ns
tpch_q13/parquet 314429158 3.20049e+08 0.982439 ns
tpch_q13/vortex-file-compressed 179055436 1.72044e+08 1.04075 ns
tpch_q14/arrow 44210433 3.67132e+07 1.20421 ns
tpch_q14/parquet 238972778 2.39911e+08 0.99609 ns
tpch_q14/vortex-file-compressed 64264179 6.23784e+07 1.03023 ns
tpch_q15/arrow 71057302 7.06264e+07 1.0061 ns
tpch_q15/parquet 324546034 3.39426e+08 0.956162 ns
tpch_q15/vortex-file-compressed 117221204 1.12799e+08 1.03921 ns
tpch_q16/arrow 104797149 1.01044e+08 1.03715 ns
tpch_q16/parquet 115016282 1.17547e+08 0.978468 ns
tpch_q16/vortex-file-compressed 105179357 1.07911e+08 0.974682 ns
tpch_q17/arrow 639112022 6.51487e+08 0.981005 ns
tpch_q17/parquet 691000261 7.17882e+08 0.962554 ns
tpch_q17/vortex-file-compressed 484940783 5.02025e+08 0.96597 ns
tpch_q18/arrow 1298874160 1.33158e+09 0.975439 ns
tpch_q18/parquet 1422401554 1.48215e+09 0.95969 ns
tpch_q18/vortex-file-compressed 1177383711 1.17434e+09 1.00259 ns
tpch_q19/arrow 151208649 1.51613e+08 0.997332 ns
tpch_q19/parquet 415152064 4.24466e+08 0.978057 ns
tpch_q19/vortex-file-compressed 135604237 1.26403e+08 1.0728 ns
tpch_q20/arrow 177214614 1.79171e+08 0.989082 ns
tpch_q20/parquet 318820480 3.15811e+08 1.00953 ns
tpch_q20/vortex-file-compressed 205325753 2.00274e+08 1.02523 ns
tpch_q21/arrow 1051612250 1.01089e+09 1.04028 ns
tpch_q21/parquet 1133394833 1.14049e+09 0.993783 ns
tpch_q21/vortex-file-compressed 1036911784 9.57648e+08 1.08277 ns
tpch_q22/arrow 80479820 7.97479e+07 1.00918 ns
tpch_q22/parquet 112178064 1.14517e+08 0.979576 ns
tpch_q22/vortex-file-compressed 86161493 8.94188e+07 0.963572 ns

Copy link
Contributor

Benchmarks: compress

Table of Results
name PR d819de9 base cc1658f ratio (PR/base) unit
compress time/wide table cols=10 chunks=1 rows=1000 3.60441e+06 3.55211e+06 1.01472 ns
compress time/wide table cols=10 chunks=1 rows=1000 throughput 0.033332 0.0338227 0.98549 bytes/ns
parquet_rs-zstd compress time/wide table cols=10 chunks=1 rows=1000 712187 709286 1.00409 ns
parquet_rs-zstd compress time/wide table cols=10 chunks=1 rows=1000 throughput 0.168694 0.169384 0.995926 bytes/ns
decompress time/wide table cols=10 chunks=1 rows=1000 240314 234604 1.02434 ns
decompress time/wide table cols=10 chunks=1 rows=1000 throughput 0.499937 0.512105 0.976239 bytes/ns
parquet_rs-zstd decompress time/wide table cols=10 chunks=1 rows=1000 244063 243145 1.00377 ns
parquet_rs-zstd decompress time/wide table cols=10 chunks=1 rows=1000 throughput 0.492259 0.494116 0.99624 bytes/ns
compress time/wide table cols=100 chunks=1 rows=1000 3.72688e+07 3.64375e+07 1.02281 ns
compress time/wide table cols=100 chunks=1 rows=1000 throughput 0.0322313 0.0329666 0.977695 bytes/ns
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 8.28496e+06 7.42265e+06 1.11617 ns
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 throughput 0.144988 0.161832 0.895918 bytes/ns
decompress time/wide table cols=100 chunks=1 rows=1000 2.4727e+06 2.45664e+06 1.00654 ns
decompress time/wide table cols=100 chunks=1 rows=1000 throughput 0.485794 0.48897 0.993504 bytes/ns
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2.5327e+06 2.51005e+06 1.00902 ns
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 throughput 0.474286 0.478564 0.99106 bytes/ns
compress time/wide table cols=1000 chunks=1 rows=1000 3.86825e+08 3.8949e+08 0.993158 ns
compress time/wide table cols=1000 chunks=1 rows=1000 throughput 0.0310529 0.0308404 1.00689 bytes/ns
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 9.77738e+07 9.48116e+07 1.03124 ns
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 throughput 0.122855 0.126694 0.969703 bytes/ns
decompress time/wide table cols=1000 chunks=1 rows=1000 3.20965e+07 2.72788e+07 1.17661 ns
decompress time/wide table cols=1000 chunks=1 rows=1000 throughput 0.374247 0.440343 0.849899 bytes/ns
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 2.95108e+07 2.74406e+07 1.07544 ns
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 throughput 0.407038 0.437746 0.929851 bytes/ns
compress time/wide table cols=10 chunks=50 rows=1000 7.21467e+07 7.16159e+07 1.00741 ns
compress time/wide table cols=10 chunks=50 rows=1000 throughput 0.00175286 0.00176585 0.992644 bytes/ns
parquet_rs-zstd compress time/wide table cols=10 chunks=50 rows=1000 1.03578e+06 995917 1.04003 ns
parquet_rs-zstd compress time/wide table cols=10 chunks=50 rows=1000 throughput 0.122094 0.126981 0.961511 bytes/ns
decompress time/wide table cols=10 chunks=50 rows=1000 1.21522e+06 1.17359e+06 1.03547 ns
decompress time/wide table cols=10 chunks=50 rows=1000 throughput 0.104066 0.107758 0.965745 bytes/ns
parquet_rs-zstd decompress time/wide table cols=10 chunks=50 rows=1000 253630 250406 1.01287 ns
parquet_rs-zstd decompress time/wide table cols=10 chunks=50 rows=1000 throughput 0.498613 0.505031 0.987292 bytes/ns
compress time/wide table cols=100 chunks=50 rows=1000 7.31622e+08 7.20626e+08 1.01526 ns
compress time/wide table cols=100 chunks=50 rows=1000 throughput 0.00172283 0.00174912 0.984971 bytes/ns
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 1.52777e+07 1.08376e+07 1.4097 ns
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 throughput 0.0825032 0.116305 0.709372 bytes/ns
decompress time/wide table cols=100 chunks=50 rows=1000 1.23048e+07 1.15722e+07 1.06331 ns
decompress time/wide table cols=100 chunks=50 rows=1000 throughput 0.102436 0.108922 0.940459 bytes/ns
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2.69229e+06 2.52878e+06 1.06466 ns
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 throughput 0.468174 0.498446 0.939267 bytes/ns
compress time/wide table cols=1000 chunks=50 rows=1000 7.40902e+09 7.37642e+09 1.00442 ns
compress time/wide table cols=1000 chunks=50 rows=1000 throughput 0.00170069 0.00170821 0.9956 bytes/ns
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 1.82762e+08 1.6171e+08 1.13018 ns
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 throughput 0.0689448 0.0779201 0.884814 bytes/ns
decompress time/wide table cols=1000 chunks=50 rows=1000 1.28863e+08 1.23497e+08 1.04345 ns
decompress time/wide table cols=1000 chunks=50 rows=1000 throughput 0.097782 0.102031 0.95836 bytes/ns
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 2.89234e+07 2.73035e+07 1.05933 ns
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 throughput 0.43565 0.461496 0.943995 bytes/ns
compress time/taxi 1.61751e+09 1.58963e+09 1.01754 ns
compress time/taxi throughput 0.291071 0.296176 0.982766 bytes/ns
parquet_rs-zstd compress time/taxi 1.88749e+09 1.83092e+09 1.03089 ns
parquet_rs-zstd compress time/taxi throughput 0.249438 0.257143 0.970033 bytes/ns
decompress time/taxi 2.42781e+08 2.28613e+08 1.06198 ns
decompress time/taxi throughput 1.93924 2.05942 0.94164 bytes/ns
parquet_rs-zstd decompress time/taxi 3.05117e+08 2.95912e+08 1.03111 ns
parquet_rs-zstd decompress time/taxi throughput 1.54305 1.59105 0.969831 bytes/ns
compress time/AirlineSentiment 271413 265091 1.02385 ns
compress time/AirlineSentiment throughput 0.00751622 0.00769546 0.976709 bytes/ns
parquet_rs-zstd compress time/AirlineSentiment 48742.9 47587.7 1.02428 ns
parquet_rs-zstd compress time/AirlineSentiment throughput 0.0418523 0.0428683 0.9763 bytes/ns
decompress time/AirlineSentiment 102318 98356.4 1.04028 ns
decompress time/AirlineSentiment throughput 0.0199379 0.0207409 0.961282 bytes/ns
parquet_rs-zstd decompress time/AirlineSentiment 28431.6 28362.2 1.00245 ns
parquet_rs-zstd decompress time/AirlineSentiment throughput 0.0717512 0.0719268 0.997559 bytes/ns
compress time/Arade 3.15431e+09 2.98163e+09 1.05791 ns
compress time/Arade throughput 0.24951 0.26396 0.945257 bytes/ns
parquet_rs-zstd compress time/Arade 3.426e+09 3.2945e+09 1.03992 ns
parquet_rs-zstd compress time/Arade throughput 0.229722 0.238892 0.961617 bytes/ns
decompress time/Arade 5.78317e+08 5.77904e+08 1.00072 ns
decompress time/Arade throughput 1.3609 1.36187 0.999285 bytes/ns
parquet_rs-zstd decompress time/Arade 6.3411e+08 6.17934e+08 1.02618 ns
parquet_rs-zstd decompress time/Arade throughput 1.24116 1.27365 0.97449 bytes/ns
compress time/Bimbo 1.02882e+10 8.64457e+09 1.19013 ns
compress time/Bimbo throughput 0.692189 0.823795 0.840244 bytes/ns
parquet_rs-zstd compress time/Bimbo 2.21892e+10 2.11462e+10 1.04932 ns
parquet_rs-zstd compress time/Bimbo throughput 0.320937 0.336767 0.952995 bytes/ns
decompress time/Bimbo 3.78651e+09 3.43964e+09 1.10084 ns
decompress time/Bimbo throughput 1.88072 2.07037 0.908395 bytes/ns
parquet_rs-zstd decompress time/Bimbo 2.51688e+09 2.43204e+09 1.03489 ns
parquet_rs-zstd decompress time/Bimbo throughput 2.82943 2.92814 0.966289 bytes/ns
compress time/CMSprovider 2.41218e+10 2.27298e+10 1.06124 ns
compress time/CMSprovider throughput 0.213465 0.226538 0.942292 bytes/ns
parquet_rs-zstd compress time/CMSprovider 1.85973e+10 1.83475e+10 1.01362 ns
parquet_rs-zstd compress time/CMSprovider throughput 0.276876 0.280647 0.986565 bytes/ns
decompress time/CMSprovider 7.65034e+09 7.62356e+09 1.00351 ns
decompress time/CMSprovider throughput 0.673062 0.675427 0.996498 bytes/ns
parquet_rs-zstd decompress time/CMSprovider 3.29845e+09 3.30093e+09 0.999247 ns
parquet_rs-zstd decompress time/CMSprovider throughput 1.56108 1.55991 1.00075 bytes/ns
compress time/Euro2016 2.02192e+09 2.03921e+09 0.991522 ns
compress time/Euro2016 throughput 0.194496 0.192847 1.00855 bytes/ns
parquet_rs-zstd compress time/Euro2016 1.72023e+09 1.71627e+09 1.00231 ns
parquet_rs-zstd compress time/Euro2016 throughput 0.228606 0.229134 0.997699 bytes/ns
decompress time/Euro2016 2.98317e+08 3.03125e+08 0.984141 ns
decompress time/Euro2016 throughput 1.31824 1.29734 1.01611 bytes/ns
parquet_rs-zstd decompress time/Euro2016 4.44856e+08 4.48424e+08 0.992042 ns
parquet_rs-zstd decompress time/Euro2016 throughput 0.884005 0.87697 1.00802 bytes/ns
compress time/Food 8.72592e+08 8.80519e+08 0.990997 ns
compress time/Food throughput 0.381301 0.377868 1.00908 bytes/ns
parquet_rs-zstd compress time/Food 1.10495e+09 1.09527e+09 1.00883 ns
parquet_rs-zstd compress time/Food throughput 0.301119 0.303778 0.991246 bytes/ns
decompress time/Food 1.99693e+08 2.05581e+08 0.971359 ns
decompress time/Food throughput 1.66616 1.61843 1.02949 bytes/ns
parquet_rs-zstd decompress time/Food 2.03913e+08 2.08629e+08 0.977397 ns
parquet_rs-zstd decompress time/Food throughput 1.63167 1.59479 1.02313 bytes/ns
compress time/HashTags 3.73592e+09 3.69958e+09 1.00982 ns
compress time/HashTags throughput 0.215341 0.217457 0.990271 bytes/ns
parquet_rs-zstd compress time/HashTags 2.77639e+09 2.72629e+09 1.01838 ns
parquet_rs-zstd compress time/HashTags throughput 0.289764 0.295089 0.981955 bytes/ns
decompress time/HashTags 1.0976e+09 1.12197e+09 0.978279 ns
decompress time/HashTags throughput 0.73296 0.717039 1.0222 bytes/ns
parquet_rs-zstd decompress time/HashTags 6.80053e+08 6.80726e+08 0.999011 ns
parquet_rs-zstd decompress time/HashTags throughput 1.183 1.18183 1.00099 bytes/ns
compress time/TPC-H l_comment chunked 1.02517e+09 1.06821e+09 0.959712 ns
compress time/TPC-H l_comment chunked throughput 0.24308 0.233287 1.04198 bytes/ns
parquet_rs-zstd compress time/TPC-H l_comment chunked 9.54004e+08 9.50081e+08 1.00413 ns
parquet_rs-zstd compress time/TPC-H l_comment chunked throughput 0.261213 0.262292 0.995888 bytes/ns
decompress time/TPC-H l_comment chunked 1.07577e+08 1.04206e+08 1.03235 ns
decompress time/TPC-H l_comment chunked throughput 2.31648 2.39141 0.968667 bytes/ns
parquet_rs-zstd decompress time/TPC-H l_comment chunked 2.50249e+08 2.41175e+08 1.03762 ns
parquet_rs-zstd decompress time/TPC-H l_comment chunked throughput 0.995804 1.03327 0.963741 bytes/ns
compress time/TPC-H l_comment canonical 1.01516e+09 1.04202e+09 0.974224 ns
compress time/TPC-H l_comment canonical throughput 0.245476 0.239149 1.02646 bytes/ns
parquet_rs-zstd compress time/TPC-H l_comment canonical 9.68567e+08 9.54593e+08 1.01464 ns
parquet_rs-zstd compress time/TPC-H l_comment canonical throughput 0.257285 0.261051 0.985573 bytes/ns
decompress time/TPC-H l_comment canonical 1.08198e+08 1.04676e+08 1.03365 ns
decompress time/TPC-H l_comment canonical throughput 2.30317 2.38066 0.967449 bytes/ns
parquet_rs-zstd decompress time/TPC-H l_comment canonical 2.46189e+08 2.40521e+08 1.02357 ns
parquet_rs-zstd decompress time/TPC-H l_comment canonical throughput 1.01222 1.03608 0.976976 bytes/ns

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant