Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Seven entries per benchmark per metric in influx. #227

Open
loonatick-src opened this issue Jan 31, 2024 · 3 comments
Open

Seven entries per benchmark per metric in influx. #227

loonatick-src opened this issue Jan 31, 2024 · 3 comments

Comments

@loonatick-src
Copy link

loonatick-src commented Jan 31, 2024

I am trying to understand the output when using the influx format. For a simple benchmark there are seven entries per benchmark and metric combination. E.g. like so (platform columns removed).

metric,units,test,value,test_average,iterations,warmup_iterations,timestamp
Time(userCPU),ns,blackHole,1000,1613.0,100000,100,2024-01-31T14:17:56Z
Time(userCPU),ns,blackHole,1083,1613.0,100000,100,2024-01-31T14:17:56Z
Time(userCPU),ns,blackHole,1166,1613.0,100000,100,2024-01-31T14:17:56Z
Time(userCPU),ns,blackHole,1167,1613.0,100000,100,2024-01-31T14:17:56Z
Time(userCPU),ns,blackHole,1500,1613.0,100000,100,2024-01-31T14:17:56Z
Time(userCPU),ns,blackHole,2042,1613.0,100000,100,2024-01-31T14:17:56Z
Time(userCPU),ns,blackHole,3333,1613.0,100000,100,2024-01-31T14:17:56Z

It is not immediately obvious to me why they are repeated seven times with only the value column changing, but my guess is that this is the seven-figure summary. Is that correct? If yes, perhaps there should be an additional column indicating which percentile it is, or is the user expected to infer that using the relative orders?

@loonatick-src loonatick-src changed the title The seven entries per benchmark per metric in influx. Seven entries per benchmark per metric in influx. Jan 31, 2024
@hassila
Copy link
Contributor

hassila commented Jan 31, 2024

@clackary or @ORyanHampton maybe you'd like to comment?

@ORyanHampton
Copy link
Contributor

The seven entries are from the percentile values. For each of the values they are written in order, so you can infer from the order which percentile the value belongs to. However, I agree, we should probably add another tag column indicating which percentile the value belongs to.

@hassila
Copy link
Contributor

hassila commented Mar 27, 2024

@loonatick-src something you would like to do a PR for if you need this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

3 participants