Skip to content

Commit

Permalink
Remove wall time from BM report (facebookincubator#10829)
Browse files Browse the repository at this point in the history
Summary:
The method I used to get the wall time is brittle against changes in the ninja log layout (e.g. through cmake or ninja updates) and currently making the plots useless due to an underflow.

- remove wall time from plots
- no longer track wall time

Pull Request resolved: facebookincubator#10829

Reviewed By: DanielHunte

Differential Revision: D61862320

Pulled By: kgpai

fbshipit-source-id: 310d26e09c9317759c4c7733eb6041c504589db7
  • Loading branch information
assignUser authored and Joe-Abraham committed Sep 3, 2024
1 parent de6baab commit 1de8425
Show file tree
Hide file tree
Showing 3 changed files with 3 additions and 3 deletions.
1 change: 1 addition & 0 deletions .github/workflows/build-metrics.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ on:
pull_request:
paths:
- ".github/workflows/build-metrics.yml"
- "script/bm-report/**"

workflow_dispatch:
inputs:
Expand Down
2 changes: 1 addition & 1 deletion scripts/bm-report/report.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,7 @@ format_tags <- function(x) {
```{r total-graphs}
# Filter the data and layout the overview plots
times_plot <- results |>
filter(tags.suite == "total", endsWith(tags.source, "time")) |>
filter(tags.suite == "total", endsWith(tags.source, "time"), tags.name != "wall_time") |>
mutate(
stats.data = lubridate::dseconds(stats.data),
tags.name = format_tags(tags.name)
Expand Down
3 changes: 1 addition & 2 deletions scripts/build-metrics.py
Original file line number Diff line number Diff line change
Expand Up @@ -95,7 +95,7 @@ def _transform_results(self) -> List[BenchmarkResult]:
class NinjaLogAdapter(BenchmarkAdapter):
"""
Adapter to extract compile and link times from a .ninja_log.
Will calculate aggregates for total, compile, link and wall time.
Will calculate aggregates for total, compile and link time.
Suite metadata will be set based on binary ending to object, library or executable.
Only files in paths beginning with velox/ will be tracked to avoid dependencies.
Expand Down Expand Up @@ -135,7 +135,6 @@ def _transform_results(self) -> List[BenchmarkResult]:
"link_time": 0,
"compile_time": 0,
"total_time": 0,
"wall_time": get_epoch(log_lines[-1]) - get_epoch(log_lines[0]),
}

for line in log_lines:
Expand Down

0 comments on commit 1de8425

Please sign in to comment.