Question on Visualization of Open-loop Evaluation Results

[curryqka]

Question on Visualization of Open-loop Evaluation Results

Description

In the context of conducting open-loop evaluations, I am interested in understanding how to effectively visualize the evaluation results. Specifically, I would like to know if there are established toolchains that support this process.

Currently, it appears that the NuScenes dataset/toolchain is a prominent option for visualization and analysis. However, considering the diversity of datasets and potential differences in evaluation methodologies, I'm curious about other possible tools or frameworks that might be available or recommended for visualizing open-loop evaluation outcomes.

Questions

1. Are there specific tools or frameworks designed for visualizing the results of open-loop evaluations beyond the NuScenes toolchain?
2. The visualization tools is only able to support nuscenes input format;
3. Is there any documentation or examples available showcasing the integration of these visualization tools with custom datasets or evaluation metrics?

Thank you in advance for your assistance and insights on this topic!