Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmark history cleanup #1074

Merged
merged 6 commits into from
Oct 11, 2023
Merged

Benchmark history cleanup #1074

merged 6 commits into from
Oct 11, 2023

Conversation

erikvanoosten
Copy link
Collaborator

This PR contains a number of commits that each clean up a part of the benchmark history:

  • Remove data for JMHSample_01_HelloWorld.wellHelloThere benchmark
  • Remove data for ZioKafkaNoOptimisticResumeBenchmarks benchmark (plus one more JMHSample_01_HelloWorld.wellHelloThere)
  • Remove data for ZioKafkaNoPrefetchingBenchmarks
  • Remove data for New commit interface branch to get rid of the high peak in the graphs
  • Benchmarks zio.kafka.bench.ConsumersComparisonBenchmark.* were moved to another package. By renaming the old data, these data points are joined again in the same graphs.
  • Remove PR commits older than a month

The last step was done with a bash script and can be repeated regularly. Documentation for that will follow in a later PR.

@svroonland
Copy link
Collaborator

Do the benchmarks still run on PR branches or did we remove that and it runs just on master?

@erikvanoosten
Copy link
Collaborator Author

erikvanoosten commented Oct 10, 2023

Do the benchmarks still run on PR branches or did we remove that and it runs just on master?

This PR only removes the results of old PR benchmarks. For the rest I did not change anything. So when benchmarks are running is still the same. As far as I know PR benchmarks are still running.

@erikvanoosten
Copy link
Collaborator Author

BTW, this is a low risk change. If it doesn't work, we can simply revert and all the data is back! 🙂

Also: remove data for one more `JMHSample_01_HelloWorld.wellHelloThere` benchmark
Removing these because this branch causes such a huge peak in the graph that the rest of the graph became less readable.
Benchmarks `zio.kafka.bench.ConsumersComparisonBenchmark.*` were moved to another package. By renaming the old data, these data points are joined again in the same graphs.
@erikvanoosten erikvanoosten force-pushed the benchmark-history-cleanup branch from 643b37c to edc41ce Compare October 11, 2023 06:23
@erikvanoosten erikvanoosten merged commit a561f26 into gh-pages Oct 11, 2023
4 of 15 checks passed
@erikvanoosten erikvanoosten deleted the benchmark-history-cleanup branch October 11, 2023 06:24
@erikvanoosten
Copy link
Collaborator Author

I merged because:

  • it is a low risk change, it can be reverted at any time without affecting releases
  • I don't want to keep rebasing it

Before:
Screenshot 2023-10-11 at 08-24-50 Benchmarks

After:
Screenshot 2023-10-11 at 08-36-42 Benchmarks

@erikvanoosten
Copy link
Collaborator Author

One more correction in 24e7382 we get:

Screenshot 2023-10-11 at 09-37-42 Benchmarks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants