Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change compression method (from lz4 to zstd) #1

Open
pilab-gwon opened this issue Sep 14, 2023 · 0 comments
Open

Change compression method (from lz4 to zstd) #1

pilab-gwon opened this issue Sep 14, 2023 · 0 comments
Assignees

Comments

@pilab-gwon
Copy link
Member

pilab-gwon commented Sep 14, 2023

Benchmark

zstd

time

real	10m5.408s
user	5m46.166s
sys	1m33.642s

size

65G	bifrost-mainnet-20230914.tar.zstd

lz4

time

real	13m24.552s
user	2m47.343s
sys	3m0.412s

size

80G bifrost-mainnet-20230914.tar.lz4
@pilab-gwon pilab-gwon self-assigned this Sep 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

1 participant