[GLUTEN-7641][VL] Add perf analysis scripts for TPCH workload #8065
Conversation
| 1. Copy the sample file [trace_result_tpch_q1.json](./sample/trace_result_tpch_q1.json) to the `$HOME/trace_result` directory | ||
| 2. Open the following link in your browser to view the results: http://[your-host-ip]:1088/tracing_examples/trace_viewer.html#/tracing/test_data/trace_result_tpch_q1.json | ||
|
|
||
| This visualization helps to better understand performance metrics and optimize accordingly. |
There was a problem hiding this comment.
Can you add one more guide that the json file can be open by chrome about://tracing?
|
Thank you, Rong. Can you add sample of tpch_q1.nbconvert.ipynb and tpch_q1.html as example as well? |
|
Let's use the perf stat tool to add PMU events as well. |
There was a problem hiding this comment.
Any description missing in the document?
I cannot find in which steps will use this file to install the requirements.
There was a problem hiding this comment.
Got it in tools/workload/benchmark_velox/initialize.ipynb, please ignore this comments. Thanks.
| " self.finished_nb = f\"http://{self.server}:8888/tree/{self.base_dir}/{output_nb_name}\"\n", | ||
| " if output_nb.startswith(cwd):\n", | ||
| " output_nb = os.path.relpath(output_nb, home)\n", | ||
| " self.finished_nb = f\"http://{localhost}:8888/tree/{output_nb}\"\n", |
There was a problem hiding this comment.
Just make sure this is not a typo.
I can find there are two jupyter notebook will be launched(8888 and 8889) in the initialize.ipynb.
8888 for user usage, 8889 for perf. analysis result, right?
There was a problem hiding this comment.
Yes, port 8888 is used for accessing benchmark scripts and 8889 for perf analysis scripts. We need to start the jupyter server for perf analysis script under virtual environment, as described in initialized.ipynb, therefore they cannot share the same port.
|
Let me try soon |
No description provided.