Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Convert and compress pictures before adding them to the ZIM #436

Open
benoit74 opened this issue Feb 10, 2025 · 1 comment
Open

Convert and compress pictures before adding them to the ZIM #436

benoit74 opened this issue Feb 10, 2025 · 1 comment
Labels
enhancement New feature or request
Milestone

Comments

@benoit74
Copy link
Collaborator

Experienced with other scrapers showed that converting pictures to WEBP and compressing them can save a significant ZIM size.

This is probably true as well for warc2zim.

Suggested in openzim/libzim#951

@benoit74 benoit74 added the enhancement New feature or request label Feb 10, 2025
@benoit74 benoit74 added this to the backlog milestone Feb 10, 2025
@ThisIsFineTM
Copy link

In my own limited testing, webp and avif seem to get the best compression, but webp certainly wins when it comes to speed and platform support.

libwebp has support for jpeg, png, gif, tiff, bmp, and netpbm. This should cover most of what would be scraped into a zim. avif and jpegxl aren't supported by libwebp from what I've been able to find, but those formats are still pretty rare to see.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants