a. Clone GraphQA repo.
To evaluate CodeGraph on GraphQA benchmark, please first clone the repo of graphqa and place it under the following folder structure.
Folder structure
CodeGraph/
├── codegraph/
├── docs/
├── graphqa/
├── models/
├── README.md
├──run_parallel_cg_graph_generator_with_diff_exemplar.sh
└── ...
b. Generating graphs.
-
Navigate to the Project Directory
cd CodeGraph
-
Modify the Output Path modify the output path in
graph_generator.sh
under thegraphqa
folderOUTPUT_PATH="graphqa/graphs"
-
Generate Graphs for Test Set
./graphqa/graph_generator.sh
-
Generate Graphs for Train Set
Step 1
To generate graphs for the
train
split instead of thetest
split, modify the--split
in graph_generator.sh:--split=train
Step 2
./graphqa/graph_generator.sh