User Navigation
After starting the Testing Kit you get the possibility to choose between the different Testing Kits you implemented. If you only installed the given Testing Kit, you can only choose the SpeedDreams Testing Kit, the other options still do not have any functions behind.
In the home screen of the application you can see all already created testsets on the left side. Clicking on them you can get more detailed information. You can use the buttons on the top right to either delete a testset or start it directly. On the top of the page the main navigation can be found. You can switch to the results of old test passes of the given testsets or see and change the settings. To create your new, own testset, press the "+" Button.
You reach a new screen where you can edit your own testset. Every testset consists of different scenarios to enable the possibility to test different parameters in one and the same test pass. On the top right you have the buttons to add as more scenarios you want to to your testset and save. Having more scenarios than one, you get different tabs you can switch. In the content area you can define the scenario you are located.
On the left side you have to define some details of the scenario:
- name: choose a unique name for your scenario
- fault injection time: the time when your ECU shall have the fall out
- number of runs: How many times shall this scenario be carried out
- config file: choose your own edited config file where you set QUEMU params, image path, kill switch boolean
In the center you can choose the track you want to use (In SpeedDreams: kia4sm, Speedways, Grand Prix Circuit). On the right you set the mode you want to test (only ACC works at the moment).
You have to define all these settings for each scenario, otherwise you cannot save. The case you forgot something the application will remind you to set these params. When everything is defined, save your testset and you get back to the homescreen. Your created testset you can find now in the list of testsets on the left.
All testsets in homescreen are ready to start. You have only to choose one (maybe your just created one) and press the "Start" Button on the top right. The test will start immediately and you will be transferred to the running screen. If you did not fill in your PC-admin-password in the settings, you will be asked for it before the test can start.
The running screen shall give you an overview about the state of your currently running scenario. You will see each run of scenario, if it is passed or not and live logs. On the right you have an overview diagram where you can see how many tests passed or failed in the scenario. On top you can see the estimated time and get the possibility to stop your tests before all runs are finished. Once the test stopped automatically or manually by pressing the "Stop" Button, the screen will switch to the results of your test pass.
There are 2 possibilities to reach the result screen of a given testset pass:
- you just finished a pass of a testset and it switches you automatically to the result screen
- you want to see the results of old testset passes and navigate using the main navigation
for option 2, you start in homescreen and choose "results" in the main navigation:
Doing that you get a list of all finished test passes and you can sort them as you wish. If you want a specific result, you can search for it as well. As you found your result just click on it and you will reach the chosen result view.
In the result view you can switch through your scenarios by tabs as you could when creating them. On the left side you can see all the runs of one scenario, the color signaling if a test passed or failed. On the right there is a diagram of the given runs with different params. These are modular and can be changed, as well as there can be added more diagrams. On the top right you can export the settings of your testset and all the raw results in .csv format. This can be helpful if you want to work with your data any further.
To the settings you can navigate as well through the main navigation on home screen.
A popup occurs in which you can set different settings:
- you can check the box if you do not want to see the SpeedDreams Simulation window while the test is running
- you can delete your entries in your database (be careful on that!)
- you can fill in your PC-Admin-password here. This is needed for starting all the entities of the testbed. If you do not fill in your password in the settings, you will be asked for it when starting your test.
In this diagram you get an short overview what navigation is possible between the different screens:
