Operator for BigWhoop compression

[gregorweiss]

Following discussions with Scott, we added a new operator that can be used to compress data with the BigWhoop compression library.

Optimal use of this compressor was previously demonstrated with structured mesh data here
https://doi.org/10.1007/978-3-030-68049-7_7
https://doi.org/10.1007/978-3-030-80602-6_19
And we currently investigate and find successful compression strategies for BigWhoop using unstructured data from Neko, for which we already rely on the PR's operator implementation.

BigWhoop is currently maintained here https://code.hlrs.de/TOPIO/BigWhoop (whereas the new API of the feat/api branch conforms with the operator implementation and will be part of BigWhoop's future release.)

[eisenhauer]

In general I think this looks great. However, we probably want to think about CI. I think we need a test for the bigwhoop compressor in this PR. Actual testing in our CI would require a machine image with BigWhoop installed, but we can do that in a later step. Also, lets leave off modifying things like ci-ubuntu20.04-gcc8-static-serial.cmake until we have this installed somewhere and there's a need for changes.

[pnorbert]

How do you build adios with this compressor? How do you build and install BigWhoop for this? make release and make full does not seem to be enough.

BIGWHOOP_DIR=/home/adios/Software/BigWhoop
cmake ...
      -DADIOS2_USE_BigWhoop=ON\
      -DCMAKE_PREFIX_PATH="${BIGWHOOP_DIR}" \
...

CMake Error at cmake/DetectOptions.cmake:77 (find_package):
  Could not find a package configuration file provided by "BWC" with any of
  the following names:

    BWCConfig.cmake
    bwc-config.cmake

[gregorweiss]

BigWhoop compilation works this way

BIGWHOOP_DIR=/home/adios/Software/BigWhoop
cmake .. -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX=${BIGWHOOP_DIR}
make -j install

ADIOS2 with BigWhoop should work with using BWC_DIR to find the CMake package

cmake ...
      -DADIOS2_USE_BigWhoop=ON\
      -DBWC_DIR=${BIGWHOOP_DIR}/lib/cmake/bwc
...

I also tested your route using CMAKE_PREFIX_PATH and it works too.

[pnorbert]

Well, I am struggling to build this. I used the master branch first, and I could install it, then configure BigWhoop in ADIOS but the build has failed.
Then I checked out the feat/api branch, and I cannot even cmake configure this:

~/Software/BigWhoop/build$ cmake --version
cmake version 3.30.2
~/Software/BigWhoop/build$ BIGWHOOP_DIR=/opt/bigwhoop
~/Software/BigWhoop/build$ cmake .. -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX=${BIGWHOOP_DIR}
-- The C compiler identification is GNU 9.4.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/bin/cc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Compiling with C standard: 11
-- Compiling with C++ standard: 11
-- Enable OpenMP parallelization
-- Found OpenMP_C: -fopenmp (found version "4.5")
-- Found OpenMP: TRUE (found version "4.5")
['macros.h', 'constants.h', 'dwt.h', 'tagtree.h', 'mq_types.h', 'mq.h', 'bitstream.h', 'codestream.h', 'tier1.h', 'tier2.h', 'types.h', 'libbwc.h']
CMake Error at src/library/CMakeLists.txt:110 (set_target_properties):
  set_target_properties called with incorrect number of arguments.


-- Configuring incomplete, errors occurred!

[gregorweiss]

Well, I can confirm and could reproduce the error. I committed a fix. Please fetch it and try again. I hope it works now.

[vicentebolea]

CMAKE wise it looks good, only a few comments. @gregorweiss thanks for your contribution.

[vicentebolea]

Looks good cmakewise! :)

[gregorweiss]

Thank you @vicentebolea for the review.

@pnorbert, did you have further questions regarding BigWhoop? The feat/api branch now fixes the previous issues that you encountered earlier.

Well, I am struggling to build this. I used the master branch first, and I could install it, then configure BigWhoop in ADIOS but the build has failed. Then I checked out the feat/api branch, and I cannot even cmake configure this

Is there anything I can help with at this point?

Update:

BigWhoop's feat/api was merged into the main branch on https://code.hlrs.de/TOPIO/BigWhoop . Hence, its main branch conforms with the API used for this PR.