From 8313d28299c013d884b55e03fc6e6a111f668fdc Mon Sep 17 00:00:00 2001 From: stanbrub Date: Tue, 5 Dec 2023 19:12:27 -0700 Subject: [PATCH] Added Comparison Summary mardown --- docs/ComparisonSummary.md | 19 +++++++++++++++++++ 1 file changed, 19 insertions(+) create mode 100644 docs/ComparisonSummary.md diff --git a/docs/ComparisonSummary.md b/docs/ComparisonSummary.md new file mode 100644 index 00000000..c17335af --- /dev/null +++ b/docs/ComparisonSummary.md @@ -0,0 +1,19 @@ +# Comparison Benchmark Summary + +![Operation Rate Comparison](https://storage.googleapis.com/deephaven-benchmark/compare/benchmark-summary.svg?) + +## Comparison Table Organization + +- Each row shows the benchmark in rows per sec for equivalent operations +- The versions displayed show the latest stable release of each product +- The Benchmark Date shows the day when the benchmarks where collected + +## Basic Benchmark Methodology + +- All products are run on the same hardware in the same environment +- For each operation (row), all products use the same single parquet file +- All products are benchmarked "out of the box" with no tuning +- Parquet read is included in the benchmark + - Some products group or index on parquet read +- Deephaven runs as a service while the other products run in-process +