Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Julio/test windows build #719

Closed
wants to merge 29 commits into from
Closed

Julio/test windows build #719

wants to merge 29 commits into from

Conversation

hoolioh
Copy link
Contributor

@hoolioh hoolioh commented Nov 7, 2024

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@hoolioh hoolioh force-pushed the julio/test-windows-build branch from 403e4df to a86a309 Compare November 7, 2024 09:03
@pr-commenter
Copy link

pr-commenter bot commented Nov 7, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-11-07 09:14:04

Comparing candidate commit a86a309 in PR branch julio/test-windows-build with baseline commit 16b19c9 in branch main.

Found 15 performance improvements and 7 performance regressions! Performance is the same for 29 metrics, 2 unstable metrics.

scenario:concentrator/add_spans_to_concentrator

  • 🟩 execution_time [-246.476µs; -238.093µs] or [-2.634%; -2.544%]

scenario:credit_card/is_card_number/ 378282246310005

  • 🟩 execution_time [-2.433µs; -2.152µs] or [-2.877%; -2.544%]
  • 🟩 throughput [+309368.109op/s; +350056.008op/s] or [+2.617%; +2.961%]

scenario:credit_card/is_card_number/378282246310005

  • 🟩 execution_time [-2.038µs; -1.783µs] or [-2.535%; -2.218%]
  • 🟩 throughput [+283363.111op/s; +324587.563op/s] or [+2.278%; +2.609%]

scenario:credit_card/is_card_number_no_luhn/ 3782-8224-6310-005

  • 🟩 execution_time [-1.901µs; -1.806µs] or [-2.577%; -2.448%]
  • 🟩 throughput [+340426.500op/s; +358531.238op/s] or [+2.511%; +2.645%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟩 execution_time [-2.214µs; -2.135µs] or [-3.325%; -3.207%]
  • 🟩 throughput [+497868.991op/s; +516701.469op/s] or [+3.315%; +3.441%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟩 execution_time [-2.119µs; -2.057µs] or [-3.403%; -3.303%]
  • 🟩 throughput [+548656.934op/s; +565574.177op/s] or [+3.417%; +3.523%]

scenario:normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...

  • 🟩 execution_time [-21.491µs; -21.206µs] or [-7.861%; -7.756%]
  • 🟩 throughput [+307811.477op/s; +311738.497op/s] or [+8.415%; +8.523%]

scenario:normalization/normalize_name/normalize_name/bad-name

  • 🟩 execution_time [-1.198µs; -1.177µs] or [-4.630%; -4.545%]
  • 🟩 throughput [+1840615.624op/s; +1874535.870op/s] or [+4.764%; +4.852%]

scenario:normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters

  • 🟥 execution_time [+4.812µs; +4.876µs] or [+2.671%; +2.707%]
  • 🟥 throughput [-146357.134op/s; -144416.519op/s] or [-2.636%; -2.601%]

scenario:normalization/normalize_service/normalize_service/[empty string]

  • 🟥 execution_time [+1.157µs; +1.216µs] or [+2.568%; +2.698%]
  • 🟥 throughput [-583193.047op/s; -555243.965op/s] or [-2.628%; -2.502%]

scenario:normalization/normalize_service/normalize_service/test_ASCII

  • 🟥 execution_time [+1.232µs; +1.324µs] or [+2.507%; +2.694%]
  • 🟥 throughput [-533159.295op/s; -496832.471op/s] or [-2.620%; -2.442%]

scenario:sql/obfuscate_sql_string

  • 🟥 execution_time [+4.396µs; +4.451µs] or [+6.551%; +6.632%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a86a309 1730970199 julio/test-windows-build
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 9.032ms 9.115ms ± 0.027ms 9.115ms ± 0.011ms 9.125ms 9.140ms 9.151ms 9.320ms 2.25% 3.821 30.323 0.29% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [9.112ms; 9.119ms] or [-0.041%; +0.041%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a86a309 1730970199 julio/test-windows-build
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 71.376µs 71.531µs ± 0.139µs 71.521µs ± 0.035µs 71.554µs 71.617µs 71.820µs 73.274µs 2.45% 10.011 122.046 0.19% 0.010µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [71.511µs; 71.550µs] or [-0.027%; +0.027%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a86a309 1730970199 julio/test-windows-build
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 289.419ns 303.438ns ± 14.792ns 296.352ns ± 5.786ns 311.540ns 335.476ns 346.024ns 348.563ns 17.62% 1.325 0.995 4.86% 1.046ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [301.388ns; 305.488ns] or [-0.676%; +0.676%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a86a309 1730970199 julio/test-windows-build
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 19.381µs 25.209µs ± 10.130µs 20.155µs ± 0.280µs 31.076µs 39.578µs 42.649µs 96.275µs 377.68% 2.990 14.320 40.08% 0.716µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [23.805µs; 26.613µs] or [-5.569%; +5.569%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a86a309 1730970199 julio/test-windows-build
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 141.993µs 143.064µs ± 0.459µs 143.083µs ± 0.202µs 143.257µs 143.539µs 144.294µs 146.664µs 2.50% 2.539 18.887 0.32% 0.032µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [143.000µs; 143.128µs] or [-0.044%; +0.044%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a86a309 1730970199 julio/test-windows-build
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.134µs 1.202µs ± 0.025µs 1.206µs ± 0.015µs 1.223µs 1.226µs 1.227µs 1.228µs 1.76% -1.379 1.120 2.10% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.199µs; 1.206µs] or [-0.292%; +0.292%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a86a309 1730970199 julio/test-windows-build
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.629µs 2.682µs ± 0.018µs 2.684µs ± 0.006µs 2.689µs 2.706µs 2.712µs 2.808µs 4.60% 0.690 12.199 0.68% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.680µs; 2.685µs] or [-0.094%; +0.094%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a86a309 1730970199 julio/test-windows-build
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.393µs 3.266µs ± 1.420µs 3.122µs ± 0.030µs 3.146µs 3.180µs 13.964µs 15.015µs 380.96% 7.575 57.579 43.36% 0.100µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.069µs; 3.463µs] or [-6.024%; +6.024%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a86a309 1730970199 julio/test-windows-build
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 37.819µs 38.368µs ± 0.965µs 37.929µs ± 0.040µs 38.000µs 40.429µs 40.448µs 41.485µs 9.37% 1.728 1.088 2.51% 0.068µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [38.234µs; 38.501µs] or [-0.348%; +0.348%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a86a309 1730970199 julio/test-windows-build
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 4.599µs 4.612µs ± 0.002µs 4.612µs ± 0.001µs 4.613µs 4.615µs 4.618µs 4.621µs 0.21% -0.130 4.607 0.05% 0.000µs 1 200
credit_card/is_card_number/ throughput 216388759.916op/s 216840693.367op/s ± 111313.618op/s 216840878.339op/s ± 70259.071op/s 216913757.756op/s 216998722.486op/s 217029385.770op/s 217444197.593op/s 0.28% 0.141 4.637 0.05% 7871.061op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 88.498µs 90.741µs ± 0.795µs 90.733µs ± 0.507µs 91.233µs 92.004µs 92.448µs 92.559µs 2.01% -0.162 -0.056 0.87% 0.056µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 10803908.095op/s 11021218.801op/s ± 96660.260op/s 11021339.152op/s ± 61534.479op/s 11083300.524op/s 11174167.861op/s 11282098.802op/s 11299722.597op/s 2.53% 0.213 -0.007 0.87% 6834.913op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 79.923µs 82.293µs ± 0.766µs 82.565µs ± 0.394µs 82.903µs 83.138µs 83.448µs 83.825µs 1.53% -0.818 -0.114 0.93% 0.054µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 11929564.360op/s 12152692.926op/s ± 114035.199op/s 12111605.803op/s ± 57499.329op/s 12238060.730op/s 12371226.741op/s 12434641.593op/s 12512064.478op/s 3.31% 0.852 -0.039 0.94% 8063.506op/s 1 200
credit_card/is_card_number/37828224631 execution_time 4.600µs 4.612µs ± 0.003µs 4.611µs ± 0.001µs 4.613µs 4.615µs 4.617µs 4.635µs 0.51% 2.542 22.788 0.06% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 215758872.897op/s 216845901.129op/s ± 132433.279op/s 216855750.585op/s ± 69823.338op/s 216918036.735op/s 217008415.235op/s 217064930.496op/s 217408496.733op/s 0.25% -2.508 22.504 0.06% 9364.447op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 76.152µs 78.474µs ± 0.825µs 78.688µs ± 0.553µs 79.115µs 79.527µs 80.048µs 80.254µs 1.99% -0.467 -0.474 1.05% 0.058µs 1 200
credit_card/is_card_number/378282246310005 throughput 12460513.935op/s 12744466.726op/s ± 134666.541op/s 12708338.216op/s ± 89628.207op/s 12850344.673op/s 12963026.334op/s 13053600.316op/s 13131655.535op/s 3.33% 0.508 -0.417 1.05% 9522.362op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 58.968µs 59.176µs ± 0.174µs 59.147µs ± 0.120µs 59.269µs 59.499µs 59.657µs 59.694µs 0.92% 0.960 0.304 0.29% 0.012µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 16752029.325op/s 16898975.550op/s ± 49581.918op/s 16906915.053op/s ± 34386.720op/s 16940545.509op/s 16955617.222op/s 16957673.965op/s 16958386.027op/s 0.30% -0.948 0.273 0.29% 3505.971op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.818µs 6.821µs ± 0.003µs 6.821µs ± 0.002µs 6.823µs 6.826µs 6.828µs 6.832µs 0.16% 1.116 1.769 0.04% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 146360028.098op/s 146599800.671op/s ± 56013.026op/s 146600227.244op/s ± 41477.657op/s 146646274.232op/s 146662115.806op/s 146670506.127op/s 146675347.126op/s 0.05% -1.113 1.756 0.04% 3960.719op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 4.603µs 4.612µs ± 0.002µs 4.612µs ± 0.002µs 4.613µs 4.616µs 4.618µs 4.621µs 0.21% 0.490 1.218 0.05% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 216398647.613op/s 216837537.124op/s ± 110809.277op/s 216846167.942op/s ± 74099.819op/s 216920856.940op/s 216980142.701op/s 217024926.501op/s 217241307.819op/s 0.18% -0.485 1.214 0.05% 7835.399op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 71.353µs 71.917µs ± 0.298µs 71.872µs ± 0.191µs 72.110µs 72.442µs 72.891µs 72.957µs 1.51% 0.871 0.911 0.41% 0.021µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 13706756.662op/s 13905160.788op/s ± 57509.788op/s 13913717.556op/s ± 36873.153op/s 13947509.403op/s 13981647.733op/s 13996273.929op/s 14014762.687op/s 0.73% -0.845 0.839 0.41% 4066.556op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 63.839µs 64.414µs ± 0.269µs 64.384µs ± 0.170µs 64.564µs 64.930µs 65.098µs 65.190µs 1.25% 0.606 0.012 0.42% 0.019µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 15339770.006op/s 15524857.108op/s ± 64654.521op/s 15531892.651op/s ± 41003.046op/s 15568093.994op/s 15606547.883op/s 15642112.543op/s 15664363.302op/s 0.85% -0.585 -0.016 0.42% 4571.765op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 4.598µs 4.612µs ± 0.002µs 4.612µs ± 0.001µs 4.613µs 4.615µs 4.616µs 4.617µs 0.11% -1.713 9.106 0.05% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 216597305.266op/s 216846293.762op/s ± 105164.017op/s 216835252.998op/s ± 55977.376op/s 216908220.827op/s 216992937.025op/s 217056220.509op/s 217484598.601op/s 0.30% 1.725 9.182 0.05% 7436.219op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 59.687µs 60.197µs ± 0.201µs 60.176µs ± 0.134µs 60.325µs 60.516µs 60.685µs 60.856µs 1.13% 0.299 0.014 0.33% 0.014µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 16432359.586op/s 16612337.896op/s ± 55386.491op/s 16617943.106op/s ± 36907.065op/s 16652094.839op/s 16704706.345op/s 16723153.706op/s 16753932.584op/s 0.82% -0.280 -0.004 0.33% 3916.416op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 58.969µs 59.110µs ± 0.114µs 59.081µs ± 0.071µs 59.179µs 59.326µs 59.371µs 59.524µs 0.75% 0.864 0.048 0.19% 0.008µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 16799815.977op/s 16917653.382op/s ± 32442.619op/s 16925981.404op/s ± 20228.369op/s 16943290.531op/s 16955451.618op/s 16956697.635op/s 16958064.413op/s 0.19% -0.857 0.026 0.19% 2294.040op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.818µs 6.821µs ± 0.002µs 6.822µs ± 0.002µs 6.823µs 6.825µs 6.827µs 6.829µs 0.12% 0.646 0.229 0.03% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 146424268.460op/s 146598146.056op/s ± 49532.532op/s 146594349.456op/s ± 38900.093op/s 146641541.350op/s 146663567.303op/s 146671544.547op/s 146677397.013op/s 0.06% -0.644 0.224 0.03% 3502.479op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [4.611µs; 4.612µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/ throughput [216825266.370op/s; 216856120.364op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [90.631µs; 90.851µs] or [-0.121%; +0.121%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [11007822.618op/s; 11034614.983op/s] or [-0.122%; +0.122%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [82.187µs; 82.400µs] or [-0.129%; +0.129%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12136888.744op/s; 12168497.108op/s] or [-0.130%; +0.130%] None None None
credit_card/is_card_number/37828224631 execution_time [4.611µs; 4.612µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/37828224631 throughput [216827547.150op/s; 216864255.108op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/378282246310005 execution_time [78.360µs; 78.588µs] or [-0.146%; +0.146%] None None None
credit_card/is_card_number/378282246310005 throughput [12725803.238op/s; 12763130.213op/s] or [-0.146%; +0.146%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [59.152µs; 59.200µs] or [-0.041%; +0.041%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [16892103.973op/s; 16905847.126op/s] or [-0.041%; +0.041%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.821µs; 6.822µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number/x371413321323331 throughput [146592037.804op/s; 146607563.538op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/ execution_time [4.611µs; 4.612µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/ throughput [216822180.024op/s; 216852894.224op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [71.876µs; 71.958µs] or [-0.058%; +0.058%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [13897190.484op/s; 13913131.091op/s] or [-0.057%; +0.057%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [64.377µs; 64.451µs] or [-0.058%; +0.058%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [15515896.614op/s; 15533817.603op/s] or [-0.058%; +0.058%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [4.611µs; 4.612µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [216831719.040op/s; 216860868.483op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [60.169µs; 60.225µs] or [-0.046%; +0.046%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [16604661.861op/s; 16620013.931op/s] or [-0.046%; +0.046%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [59.094µs; 59.126µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [16913157.147op/s; 16922149.617op/s] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.821µs; 6.822µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [146591281.323op/s; 146605010.788op/s] or [-0.005%; +0.005%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a86a309 1730970199 julio/test-windows-build
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 251.689µs 252.047µs ± 0.437µs 251.978µs ± 0.081µs 252.062µs 252.369µs 254.607µs 255.551µs 1.42% 5.531 34.996 0.17% 0.031µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3913107.306op/s 3967523.894op/s ± 6816.770op/s 3968600.687op/s ± 1269.633op/s 3969800.575op/s 3972050.271op/s 3972934.601op/s 3973150.220op/s 0.11% -5.498 34.628 0.17% 482.018op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 24.579µs 24.696µs ± 0.051µs 24.696µs ± 0.029µs 24.719µs 24.795µs 24.836µs 24.939µs 0.99% 0.894 2.335 0.21% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 40097243.240op/s 40491823.715op/s ± 83158.130op/s 40492804.935op/s ± 47583.427op/s 40545593.521op/s 40607835.382op/s 40646586.955op/s 40685183.699op/s 0.48% -0.872 2.255 0.20% 5880.168op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 15.706µs 15.738µs ± 0.032µs 15.724µs ± 0.016µs 15.755µs 15.769µs 15.804µs 16.048µs 2.07% 4.710 41.936 0.20% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 62311462.010op/s 63542568.896op/s ± 128490.523op/s 63598612.612op/s ± 65225.206op/s 63632101.647op/s 63652722.729op/s 63664799.332op/s 63669287.808op/s 0.11% -4.580 40.229 0.20% 9085.652op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [251.987µs; 252.108µs] or [-0.024%; +0.024%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3966579.155op/s; 3968468.633op/s] or [-0.024%; +0.024%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [24.689µs; 24.703µs] or [-0.029%; +0.029%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [40480298.798op/s; 40503348.632op/s] or [-0.028%; +0.028%] None None None
normalization/normalize_name/normalize_name/good execution_time [15.733µs; 15.742µs] or [-0.028%; +0.028%] None None None
normalization/normalize_name/normalize_name/good throughput [63524761.345op/s; 63560376.446op/s] or [-0.028%; +0.028%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a86a309 1730970199 julio/test-windows-build
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 507.376µs 507.886µs ± 0.233µs 507.860µs ± 0.142µs 508.014µs 508.266µs 508.545µs 508.909µs 0.21% 0.774 1.613 0.05% 0.016µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1964986.257op/s 1968945.015op/s ± 901.787op/s 1969045.447op/s ± 550.137op/s 1969541.105op/s 1970319.513op/s 1970606.078op/s 1970925.830op/s 0.10% -0.770 1.600 0.05% 63.766op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 477.694µs 478.376µs ± 0.249µs 478.382µs ± 0.152µs 478.519µs 478.801µs 478.836µs 479.146µs 0.16% -0.014 0.023 0.05% 0.018µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2087044.703op/s 2090406.184op/s ± 1085.986op/s 2090378.160op/s ± 663.176op/s 2091108.094op/s 2092090.141op/s 2093039.561op/s 2093391.944op/s 0.14% 0.018 0.024 0.05% 76.791op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 184.587µs 184.969µs ± 0.157µs 184.972µs ± 0.108µs 185.066µs 185.258µs 185.322µs 185.374µs 0.22% 0.120 -0.160 0.08% 0.011µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5394492.670op/s 5406315.256op/s ± 4592.606op/s 5406236.120op/s ± 3148.384op/s 5409513.356op/s 5414101.338op/s 5416396.112op/s 5417486.006op/s 0.21% -0.116 -0.161 0.08% 324.746op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 45.973µs 46.253µs ± 0.153µs 46.222µs ± 0.081µs 46.320µs 46.563µs 46.688µs 46.726µs 1.09% 0.947 0.588 0.33% 0.011µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 21401290.662op/s 21620439.950op/s ± 71349.234op/s 21634665.391op/s ± 37804.717op/s 21668932.060op/s 21713663.430op/s 21748034.764op/s 21752036.820op/s 0.54% -0.931 0.555 0.33% 5045.153op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 49.520µs 50.424µs ± 0.325µs 50.417µs ± 0.196µs 50.626µs 50.965µs 51.088µs 51.154µs 1.46% -0.100 -0.135 0.64% 0.023µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19548778.646op/s 19832673.031op/s ± 127918.241op/s 19834519.286op/s ± 77300.130op/s 19906382.320op/s 20043302.436op/s 20171466.821op/s 20193837.896op/s 1.81% 0.136 -0.105 0.64% 9045.186op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [507.854µs; 507.919µs] or [-0.006%; +0.006%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1968820.036op/s; 1969069.994op/s] or [-0.006%; +0.006%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [478.342µs; 478.410µs] or [-0.007%; +0.007%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2090255.677op/s; 2090556.691op/s] or [-0.007%; +0.007%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [184.947µs; 184.991µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5405678.765op/s; 5406951.747op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [46.232µs; 46.274µs] or [-0.046%; +0.046%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21610551.632op/s; 21630328.267op/s] or [-0.046%; +0.046%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [50.379µs; 50.469µs] or [-0.089%; +0.089%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [19814944.793op/s; 19850401.269op/s] or [-0.089%; +0.089%] None None None

Baseline

Omitted due to size.

@hoolioh hoolioh closed this Dec 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants