ref: Generalize propagation benchmark functionality

[niermann999]

Generalize the benchmark functionality to different detectors and actor setups. Also splits some common benchmark functionality into a detray benchmark library, like e.g. the generation of track samples.

The CPU benchmarks have also been switched to use dynamic scheduling for load balancing.

Also adds the charge conjugation operation to the pdg particle, so that the charge hypothesis can be updated when test tracks are generated with randomized charge (this was triggering an assertion in the benchmarks otherwise)

[beomki-yeo]

Is this still in the development? Because I saw openmp macro in the benchmark code

[niermann999]

Is this still in the development? Because I saw openmp macro in the benchmark code

True, the openMP part made it into main, but I would like to revisit the refactoring of the benchmark done here

[asalzburger]

Close this one?

[niermann999]

Close this one?

Please leave this open, I have been working on this recently to benchmark different scenarios (e.g. with/without covarance transport/material maps). I just need to find a way to integrate it with the recent benchmark monitoring...

[niermann999]

The GPU benchmarks can now also be run the same way. In particular, with and without covariance transport
GPU (array plugin):

2024-12-10T20:20:52+01:00
Running ./bin/detray_benchmark_cuda_propagation_array
Run on (48 X 2540.18 MHz CPU s)
CPU Caches:
  L1 Data 32 KiB (x24)
  L1 Instruction 32 KiB (x24)
  L2 Unified 512 KiB (x24)
  L3 Unified 32768 KiB (x4)
Load Average: 0.01, 0.61, 3.24
--------------------------------------------------------------------------------------------------------------------
Benchmark                                                          Time             CPU   Iterations UserCounters...
--------------------------------------------------------------------------------------------------------------------
BM_PROPAGATION_TOY_DETECTOR_W_COV_TRANSPORT_64_TRACKS        2037113 ns      2033445 ns          326 TracksPropagated=31.4737k/s
BM_PROPAGATION_TOY_DETECTOR_W_COV_TRANSPORT_256_TRACKS       2094531 ns      2090671 ns          335 TracksPropagated=122.449k/s
BM_PROPAGATION_TOY_DETECTOR_W_COV_TRANSPORT_1024_TRACKS      2124243 ns      2120429 ns          330 TracksPropagated=482.921k/s
BM_PROPAGATION_TOY_DETECTOR_W_COV_TRANSPORT_4096_TRACKS      2402214 ns      2397999 ns          293 TracksPropagated=1.70809M/s
BM_PROPAGATION_TOY_DETECTOR_W_COV_TRANSPORT_16384_TRACKS     3218884 ns      3213157 ns          219 TracksPropagated=5.09903M/s
BM_PROPAGATION_TOY_DETECTOR_W_COV_TRANSPORT_65536_TRACKS    11053775 ns     11035153 ns           64 TracksPropagated=5.93884M/s
BM_PROPAGATION_TOY_DETECTOR_W_COV_TRANSPORT_262144_TRACKS   39791139 ns     39722842 ns           18 TracksPropagated=6.59933M/s
BM_PROPAGATION_TOY_DETECTOR_64_TRACKS                        1194310 ns      1192008 ns          584 TracksPropagated=53.6909k/s
BM_PROPAGATION_TOY_DETECTOR_256_TRACKS                       1202305 ns      1200128 ns          583 TracksPropagated=213.311k/s
BM_PROPAGATION_TOY_DETECTOR_1024_TRACKS                      1149717 ns      1147501 ns          610 TracksPropagated=892.374k/s
BM_PROPAGATION_TOY_DETECTOR_4096_TRACKS                      1171619 ns      1169484 ns          597 TracksPropagated=3.5024M/s
BM_PROPAGATION_TOY_DETECTOR_16384_TRACKS                     1297809 ns      1295279 ns          539 TracksPropagated=12.649M/s
BM_PROPAGATION_TOY_DETECTOR_65536_TRACKS                     2993472 ns      2988127 ns          237 TracksPropagated=21.9321M/s
BM_PROPAGATION_TOY_DETECTOR_262144_TRACKS                   10588788 ns     10570713 ns           67 TracksPropagated=24.7991M/s
BM_PROPAGATION_WIRE_CHAMBER_W_COV_TRANSPORT_64_TRACKS        2052405 ns      2048621 ns          340 TracksPropagated=31.2405k/s
BM_PROPAGATION_WIRE_CHAMBER_W_COV_TRANSPORT_256_TRACKS       2444316 ns      2439919 ns          287 TracksPropagated=104.922k/s
BM_PROPAGATION_WIRE_CHAMBER_W_COV_TRANSPORT_1024_TRACKS      2755773 ns      2750885 ns          254 TracksPropagated=372.244k/s
BM_PROPAGATION_WIRE_CHAMBER_W_COV_TRANSPORT_4096_TRACKS      2998216 ns      2992741 ns          234 TracksPropagated=1.36864M/s
BM_PROPAGATION_WIRE_CHAMBER_W_COV_TRANSPORT_16384_TRACKS     4029450 ns      4022418 ns          174 TracksPropagated=4.07317M/s
BM_PROPAGATION_WIRE_CHAMBER_W_COV_TRANSPORT_65536_TRACKS    10430930 ns     10413473 ns           68 TracksPropagated=6.29339M/s
BM_PROPAGATION_WIRE_CHAMBER_W_COV_TRANSPORT_262144_TRACKS   45734699 ns     45655685 ns           15 TracksPropagated=5.74176M/s
BM_PROPAGATION_WIRE_CHAMBER_64_TRACKS                        1098592 ns      1096597 ns          634 TracksPropagated=58.3624k/s
BM_PROPAGATION_WIRE_CHAMBER_256_TRACKS                       1241353 ns      1239026 ns          565 TracksPropagated=206.614k/s
BM_PROPAGATION_WIRE_CHAMBER_1024_TRACKS                      1414712 ns      1412121 ns          496 TracksPropagated=725.15k/s
BM_PROPAGATION_WIRE_CHAMBER_4096_TRACKS                      1501604 ns      1498823 ns          467 TracksPropagated=2.73281M/s
BM_PROPAGATION_WIRE_CHAMBER_16384_TRACKS                     1636545 ns      1633525 ns          428 TracksPropagated=10.0298M/s
BM_PROPAGATION_WIRE_CHAMBER_65536_TRACKS                     2917888 ns      2912812 ns          244 TracksPropagated=22.4992M/s
BM_PROPAGATION_WIRE_CHAMBER_262144_TRACKS                   10154730 ns     10136979 ns           70 TracksPropagated=25.8602M/s

CPU (array plugin):

2024-12-10T20:22:59+01:00
Running ./bin/detray_benchmark_cpu_propagation_array
Run on (48 X 1923.09 MHz CPU s)
CPU Caches:
  L1 Data 32 KiB (x24)
  L1 Instruction 32 KiB (x24)
  L2 Unified 512 KiB (x24)
  L3 Unified 32768 KiB (x4)
Load Average: 0.07, 0.46, 2.84
--------------------------------------------------------------------------------------------------------------------
Benchmark                                                          Time             CPU   Iterations UserCounters...
--------------------------------------------------------------------------------------------------------------------
BM_PROPAGATION_TOY_DETECTOR_W_COV_TRANSPORT_64_TRACKS          72314 ns        72102 ns         9737 TracksPropagated=887.627k/s
BM_PROPAGATION_TOY_DETECTOR_W_COV_TRANSPORT_256_TRACKS        213122 ns       212421 ns         3779 TracksPropagated=1.20515M/s
BM_PROPAGATION_TOY_DETECTOR_W_COV_TRANSPORT_1024_TRACKS       668295 ns       665859 ns         1055 TracksPropagated=1.53786M/s
BM_PROPAGATION_TOY_DETECTOR_W_COV_TRANSPORT_4096_TRACKS      2696460 ns      2686243 ns          272 TracksPropagated=1.52481M/s
BM_PROPAGATION_TOY_DETECTOR_W_COV_TRANSPORT_16384_TRACKS    10607854 ns     10568141 ns           68 TracksPropagated=1.55032M/s
BM_PROPAGATION_TOY_DETECTOR_W_COV_TRANSPORT_65536_TRACKS    40922337 ns     40770747 ns           13 TracksPropagated=1.60743M/s
BM_PROPAGATION_TOY_DETECTOR_W_COV_TRANSPORT_262144_TRACKS  163753024 ns    163147137 ns            4 TracksPropagated=1.60679M/s
BM_PROPAGATION_TOY_DETECTOR_64_TRACKS                          41115 ns        40999 ns        16897 TracksPropagated=1.56103M/s
BM_PROPAGATION_TOY_DETECTOR_256_TRACKS                        107042 ns       106714 ns         6797 TracksPropagated=2.39893M/s
BM_PROPAGATION_TOY_DETECTOR_1024_TRACKS                       378640 ns       377469 ns         1914 TracksPropagated=2.7128M/s
BM_PROPAGATION_TOY_DETECTOR_4096_TRACKS                      1420297 ns      1415247 ns          496 TracksPropagated=2.89419M/s
BM_PROPAGATION_TOY_DETECTOR_16384_TRACKS                     6342550 ns      6320105 ns          125 TracksPropagated=2.59236M/s
BM_PROPAGATION_TOY_DETECTOR_65536_TRACKS                    22383618 ns     22306686 ns           31 TracksPropagated=2.93795M/s
BM_PROPAGATION_TOY_DETECTOR_262144_TRACKS                   89681423 ns     89372023 ns            8 TracksPropagated=2.93318M/s
BM_PROPAGATION_WIRE_CHAMBER_W_COV_TRANSPORT_64_TRACKS          55462 ns        55304 ns        12673 TracksPropagated=1.15724M/s
BM_PROPAGATION_WIRE_CHAMBER_W_COV_TRANSPORT_256_TRACKS        171903 ns       171360 ns         4678 TracksPropagated=1.49393M/s
BM_PROPAGATION_WIRE_CHAMBER_W_COV_TRANSPORT_1024_TRACKS       509352 ns       507743 ns         1381 TracksPropagated=2.01677M/s
BM_PROPAGATION_WIRE_CHAMBER_W_COV_TRANSPORT_4096_TRACKS      2016280 ns      2009437 ns          349 TracksPropagated=2.03838M/s
BM_PROPAGATION_WIRE_CHAMBER_W_COV_TRANSPORT_16384_TRACKS     8369566 ns      8340759 ns           73 TracksPropagated=1.96433M/s
BM_PROPAGATION_WIRE_CHAMBER_W_COV_TRANSPORT_65536_TRACKS    32288152 ns     32173467 ns           22 TracksPropagated=2.03696M/s
BM_PROPAGATION_WIRE_CHAMBER_W_COV_TRANSPORT_262144_TRACKS  127973107 ns    127525634 ns            5 TracksPropagated=2.05562M/s
BM_PROPAGATION_WIRE_CHAMBER_64_TRACKS                          31645 ns        31558 ns        23134 TracksPropagated=2.02804M/s
BM_PROPAGATION_WIRE_CHAMBER_256_TRACKS                         73822 ns        73614 ns         9600 TracksPropagated=3.47761M/s
BM_PROPAGATION_WIRE_CHAMBER_1024_TRACKS                       252862 ns       252076 ns         2014 TracksPropagated=4.06226M/s
BM_PROPAGATION_WIRE_CHAMBER_4096_TRACKS                       988791 ns       985845 ns          711 TracksPropagated=4.15481M/s
BM_PROPAGATION_WIRE_CHAMBER_16384_TRACKS                     3931960 ns      3918705 ns          179 TracksPropagated=4.18097M/s
BM_PROPAGATION_WIRE_CHAMBER_65536_TRACKS                    16473055 ns     16413907 ns           45 TracksPropagated=3.99271M/s
BM_PROPAGATION_WIRE_CHAMBER_262144_TRACKS                   62515746 ns     62305748 ns           11 TracksPropagated=4.20738M/s

[sonarqubecloud]

Quality Gate passed

Issues
2 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
12.7% Duplication on New Code

See analysis details on SonarQube Cloud

[niermann999]

This finished, but needs a MR in the detray-benchmark repository first.

[niermann999]

This finished, but needs a MR in the detray-benchmark repository first.

The gitlab benchmark MR was merged, so this PR needs to be the next in line, otherwise the corresponding benchmark run will fail. Could someone please do a review?

[beomki-yeo]

Looks good