Skip to content

Commit

Permalink
Update benchmark_tool.md
Browse files Browse the repository at this point in the history
  • Loading branch information
longbinlai authored Sep 23, 2024
1 parent 26321e8 commit 2f0122a
Showing 1 changed file with 6 additions and 6 deletions.
12 changes: 6 additions & 6 deletions docs/interactive_engine/benchmark_tool.md
Original file line number Diff line number Diff line change
@@ -1,16 +1,16 @@
# A Generic Benchmark Tool for GIE
# A Generic Benchmark Tool

We provide a benchmarking tool to evaluate GraphScope GIE. This tool acts as multiple clients that send queries to the Gremlin (or Cypher) server through the corresponding endpoint exposed by the engine. It reports performance metrics such as latency, throughput, and query results.
We provide a benchmarking tool to evaluate the performance of Interactive Engine. This tool acts as multiple clients that send queries (Gremlin, or Cypher) to the server through the corresponding endpoint exposed by the engine. It reports performance metrics such as latency, throughput, and query results.

Notably, the tool has recently been enhanced to support comprehensive comparisons of different systems and a variety of benchmark workloads, enabling thorough assessments of query correctness and performance testing.
Notably, the tool has recently been enhanced to support comprehensive comparisons of different systems and a variety of benchmark workloads, enabling thorough assessments and comparison of query correctness and performance.

## Benchmark Tool Overview

Here are some key features of the benchmark tool:

* **Support for Multiple Query Languages**. The tool accommodates various graph query languages, including Gremlin and Cypher, allowing systems to configure according to their specific language support.
* **Support for Different Graph Systems**. It supports comparison among multiple graph systems, such as GraphScope GIE and KuzuDB. More systems will be integrated in the future.
* **Support for Versatile Workload**. The tool supports various workloads, including LDBC IC/BI, LSQB, and JOB.
* **Multiple Query Languages**. The tool accommodates various graph query languages, including Gremlin and Cypher, allowing systems to configure according to their specific language support.
* **Different Graph Systems**. It supports comparison among multiple graph systems, such as GraphScope GIE and KuzuDB. More systems will be integrated in the future.
* **Versatile Workload**. The tool supports various workloads, including [LDBC IC](https://ldbcouncil.org/benchmarks/snb-interactive/) and [BI](https://ldbcouncil.org/benchmarks/snb-bi/), [LSQB](https://github.com/ldbc/lsqb), and [JOB](https://github.com/gregrahn/join-order-benchmark).
* **Results Evaluation**. It enables correctness validation and performance benchmarking for detailed comparisons.

## Benchmark Tool Usage
Expand Down

0 comments on commit 2f0122a

Please sign in to comment.