Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

build variations from number of cores #374

Open
bmwiedemann opened this issue Jul 14, 2024 · 1 comment
Open

build variations from number of cores #374

bmwiedemann opened this issue Jul 14, 2024 · 1 comment

Comments

@bmwiedemann
Copy link

While working on reproducible builds for openSUSE (sponsored by the NLnet NGI0 fund), I found that our warzone2100 had files vary when build VMs had different CPU counts.

Here is an extract from the two build logs:

[ 5122s] [  3%] Generating base/texpages/bdrops/backdrop0.ktx2
[ 5122s] cd /home/abuild/rpmbuild/BUILD/warzone2100/build/data && ../3rdparty/basis_universal_host_tool/basis_install/bin/basisu -ktx2 -uastc -uastc_level 2 -uastc_rdo_l 1.0 -uastc_rdo_m -resample 2048 2048 -output_file /home/abuild/rpmbuild/BUILD/warzone2100/build/data/base/texpages/bdrops/backdrop0.ktx2 -file /home/abuild/rpmbuild/BUILD/warzone2100/data/base/texpages/bdrops/backdrop0.png
[ 5517s] Wrote output .basis/.ktx2 file "/home/abuild/rpmbuild/BUILD/warzone2100/build/data/base/texpages/bdrops/backdrop0.ktx2"
[ 5517s] Compression succeeded to file "/home/abuild/rpmbuild/BUILD/warzone2100/build/data/base/texpages/bdrops/backdrop0.ktx2" size 2128338 bytes in 395.214 secs
----
[ 5678s] [  0%] Generating base/texpages/bdrops/backdrop0.ktx2
[ 5678s] cd /home/abuild/rpmbuild/BUILD/warzone2100/build/data && ../3rdparty/basis_universal_host_tool/basis_install/bin/basisu -ktx2 -uastc -uastc_level 2 -uastc_rdo_l 1.0 -uastc_rdo_m -resample 2048 2048 -output_file /home/abuild/rpmbuild/BUILD/warzone2100/build/data/base/texpages/bdrops/backdrop0.ktx2 -file /home/abuild/rpmbuild/BUILD/warzone2100/data/base/texpages/bdrops/backdrop0.png
[ 5678s] Wrote output .basis/.ktx2 file "/home/abuild/rpmbuild/BUILD/warzone2100/build/data/base/texpages/bdrops/backdrop0.ktx2"
[ 5678s] Compression succeeded to file "/home/abuild/rpmbuild/BUILD/warzone2100/build/data/base/texpages/bdrops/backdrop0.ktx2" size 2151211 bytes in 5611.483 secs

Notice the different sizes in the log.

We had a similar issue in Warzone2100/warzone2100#2991 before. There it helped to add -uastc_rdo_m but here it does not.
I'd appreciate some patch or workaround to make build output deterministic.

@richgel999
Copy link
Contributor

We had a similar issue in Warzone2100/warzone2100#2991 before. There it helped to add -uastc_rdo_m but here it does not. I'd appreciate some patch or workaround to make build output deterministic.

Got it - perhaps limiting the max # of threads to some reasonable low value would help. I'll look into this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants