Feature/multi-loader sweep

[nosnelmil]

Summary

Introduce a sweep feature to the multi-loader, enabling users to easily sweep through different configuration values for experiments.

Implementation Notes ⚒️

• A new field, Sweep, has been added to the multi-loader configuration, allowing users to define the fields they want to sweep through.
• SweepOptions consists of Field, Values, and an optional Format for each sweep option.
• A new optional field SweepType has been added to allow users to define the sweep method used. There are two methods for applying sweep options: grid and linear.
  • Grid: For each trace, all permutations of the sweep options are executed. For example, a configuration defining 2 traces, 2 sweep options with 3 values each, will result in 9 experiments per trace (2 traces × 2 sweep options × 3 values).
• Linear: For each trace, sweep options are applied sequentially, one after the other, without permutations. Using the same example as above, this results in only 6 experiments. For instance:
  • Experiment 1: Trace 1 with the first value from the first sweep option, and the first value from the second sweep option.
  • Experiment 2: Trace 1 with the second value from the first sweep option, and the second value from the second sweep option.
  • ...
• An optional Format field is provided in SweepOptions. This field accepts a string containing the placeholder {}, which will be replaced by the corresponding values during runtime.

External Dependencies 🍀

• N/A

Breaking API Changes ⚠️

• N/A

[leokondrashov]

I think the math in the description doesn't add up. In the grid, two options with three values each would give 9 configuration per trace.

[nosnelmil]

I think the math in the description doesn't add up. In the grid, two options with three values each would give 9 configuration per trace.

Yeap that's right, my mistake

[leokondrashov]

Looks nice. Please see comments below.