Skip to content

Commit

Permalink
Update UsingGperftoolsInCH.md
Browse files Browse the repository at this point in the history
  • Loading branch information
zhanglistar authored Nov 8, 2023
1 parent 6995acd commit c53691a
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion docs/developers/UsingGperftoolsInCH.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,9 @@ We need using gpertools to find the memory or CPU issue. That's what this docume
Install gperftools as described in https://github.com/gperftools/gperftools.
We get the library and the command line tools.

## Compiler libch.so
Disable jemalloc `-DENABLE_JEMALLOC=OFF` in cpp-ch/CMakeLists.txt, and recompile libch.so.

## Run Gluten with gperftools
For Spark on Yarn, we can change the submit script to run Gluten with gperftools.
Add the following to the submit script:
Expand All @@ -18,4 +21,4 @@ export LD_PRELOAD=$tcmalloc_path,libch.so # load the library in the driver
## Analyze the result
We can get the result in the path we set in the previous step. For example, we can get the result in `/tmp/gluten_heap_perf`. We can use the following website to analyze the result:
https://gperftools.github.io/gperftools/heapprofile.html
https://gperftools.github.io/gperftools/cpuprofile.html
https://gperftools.github.io/gperftools/cpuprofile.html

0 comments on commit c53691a

Please sign in to comment.