BF-Streams: Multiprocessing and pipelining

[detlefarend]

Description/Motivation
Multiprocessing and pipelining shall be introduced into the stream processing.

a) Multiprocessing and plotting
This is already supported in dark mode (without visualization). Since Matplotlib supports multiprocessing via one process per figure, multiprocessing can be enabled for stream processing with visualization as well. There is a challenge in detail: shared figures.

b) Pipelining
Enhancement a) makes no sense without pipelining. Currently, a new instance is processed in sequence by all tasks of a workflow before the next instance is induced. A real parallelism is reached by inducing subsequent instances to a task whenever it has processed the current one. A new mechanism is needed that enabled asynchronous processing of the "finished" event.

Both measures in combination introduce real parallelism into the stream processing promising significant performance improvements with and without visualization.

Task list

• 1. Do this
• 2. Do that

Related issues
#...

Cross references
...