Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add v05 support in the trace exporter #898

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

Add v05 support in the trace exporter #898

wants to merge 2 commits into from

Conversation

hoolioh
Copy link
Contributor

@hoolioh hoolioh commented Feb 26, 2025

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@hoolioh hoolioh force-pushed the julio/APMSP-1446-add-v05-support branch 4 times, most recently from d08c603 to 9941831 Compare February 26, 2025 11:14
@pr-commenter
Copy link

pr-commenter bot commented Feb 26, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-02-27 13:40:26

Comparing candidate commit 450d437 in PR branch julio/APMSP-1446-add-v05-support with baseline commit a1d958b in branch main.

Found 4 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/x371413321323331

  • 🟩 execution_time [-610.941ns; -593.307ns] or [-9.201%; -8.936%]
  • 🟩 throughput [+14807035.122op/s; +15206988.198op/s] or [+9.830%; +10.096%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

  • 🟩 execution_time [-600.651ns; -582.580ns] or [-9.060%; -8.787%]
  • 🟩 throughput [+14558486.575op/s; +14970576.970op/s] or [+9.651%; +9.924%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 450d437 1740662934 julio/APMSP-1446-add-v05-support
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.892µs 3.913µs ± 0.002µs 3.913µs ± 0.001µs 3.914µs 3.917µs 3.918µs 3.919µs 0.15% -3.078 28.454 0.06% 0.000µs 1 200
credit_card/is_card_number/ throughput 255172866.139op/s 255538524.436op/s ± 155409.787op/s 255547421.118op/s ± 54255.584op/s 255596006.313op/s 255716202.559op/s 255836005.965op/s 256906265.598op/s 0.53% 3.116 28.848 0.06% 10989.131op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 81.390µs 82.709µs ± 0.608µs 82.746µs ± 0.491µs 83.209µs 83.596µs 83.892µs 83.999µs 1.51% -0.119 -0.856 0.73% 0.043µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11904944.289op/s 12091287.350op/s ± 88990.113op/s 12085202.662op/s ± 71977.121op/s 12160701.820op/s 12233398.904op/s 12270074.544op/s 12286587.266op/s 1.67% 0.144 -0.851 0.73% 6292.551op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 78.533µs 79.567µs ± 0.403µs 79.609µs ± 0.285µs 79.859µs 80.203µs 80.421µs 80.679µs 1.34% -0.049 -0.245 0.50% 0.028µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12394822.126op/s 12568422.878op/s ± 63621.254op/s 12561350.362op/s ± 44805.355op/s 12611940.174op/s 12674157.006op/s 12706692.195op/s 12733561.849op/s 1.37% 0.076 -0.251 0.50% 4498.702op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.894µs 3.913µs ± 0.002µs 3.913µs ± 0.001µs 3.915µs 3.917µs 3.918µs 3.921µs 0.19% -2.283 18.406 0.06% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255049272.107op/s 255530558.083op/s ± 161233.884op/s 255537993.706op/s ± 66913.908op/s 255597335.403op/s 255770084.581op/s 255890208.700op/s 256804644.909op/s 0.50% 2.312 18.661 0.06% 11400.957op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 74.944µs 76.305µs ± 0.414µs 76.324µs ± 0.286µs 76.597µs 76.953µs 77.167µs 77.238µs 1.20% -0.225 -0.227 0.54% 0.029µs 1 200
credit_card/is_card_number/378282246310005 throughput 12947007.701op/s 13105737.002op/s ± 71162.657op/s 13101987.966op/s ± 49275.410op/s 13151592.605op/s 13227737.986op/s 13257856.625op/s 13343272.049op/s 1.84% 0.253 -0.198 0.54% 5031.960op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.340µs 51.428µs ± 0.028µs 51.426µs ± 0.015µs 51.444µs 51.479µs 51.493µs 51.515µs 0.17% -0.086 1.161 0.05% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19411819.867op/s 19444792.266op/s ± 10544.154op/s 19445600.932op/s ± 5674.595op/s 19450652.236op/s 19461494.073op/s 19475211.853op/s 19477818.660op/s 0.17% 0.091 1.165 0.05% 745.584op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.026µs 6.038µs ± 0.007µs 6.037µs ± 0.002µs 6.039µs 6.044µs 6.048µs 6.109µs 1.20% 7.102 69.592 0.11% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 163691585.284op/s 165630773.426op/s ± 181122.559op/s 165655552.590op/s ± 50624.535op/s 165699655.916op/s 165777753.539op/s 165888488.221op/s 165954778.125op/s 0.18% -7.033 68.584 0.11% 12807.299op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.893µs 3.913µs ± 0.003µs 3.914µs ± 0.001µs 3.914µs 3.917µs 3.920µs 3.934µs 0.53% 0.053 21.073 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254180958.545op/s 255526062.772op/s ± 193545.601op/s 255523598.445op/s ± 66965.487op/s 255594332.199op/s 255788575.065op/s 255960924.809op/s 256847792.260op/s 0.52% -0.001 21.050 0.08% 13685.741op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.878µs 66.192µs ± 0.179µs 66.154µs ± 0.104µs 66.278µs 66.576µs 66.723µs 66.886µs 1.11% 0.992 0.905 0.27% 0.013µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 14950735.360op/s 15107620.476op/s ± 40808.296op/s 15116137.952op/s ± 23881.078op/s 15137267.383op/s 15157886.019op/s 15172231.993op/s 15179554.658op/s 0.42% -0.977 0.858 0.27% 2885.582op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 59.476µs 59.693µs ± 0.090µs 59.693µs ± 0.060µs 59.758µs 59.831µs 59.875µs 59.943µs 0.42% -0.073 -0.394 0.15% 0.006µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16682637.644op/s 16752313.213op/s ± 25228.538op/s 16752424.793op/s ± 16918.970op/s 16768431.757op/s 16797068.841op/s 16804462.720op/s 16813368.309op/s 0.36% 0.081 -0.395 0.15% 1783.927op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.900µs 3.913µs ± 0.002µs 3.913µs ± 0.001µs 3.914µs 3.916µs 3.918µs 3.926µs 0.34% -0.131 10.757 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254698570.818op/s 255549585.481op/s ± 148755.618op/s 255557973.491op/s ± 74968.380op/s 255618628.217op/s 255736093.871op/s 255928701.544op/s 256442310.413op/s 0.35% 0.154 10.772 0.06% 10518.611op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 56.285µs 56.805µs ± 0.179µs 56.824µs ± 0.123µs 56.934µs 57.062µs 57.150µs 57.174µs 0.62% -0.359 -0.306 0.32% 0.013µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17490410.660op/s 17604375.402op/s ± 55688.117op/s 17598148.980op/s ± 38190.887op/s 17645919.668op/s 17699353.795op/s 17733723.288op/s 17766735.412op/s 0.96% 0.374 -0.288 0.32% 3937.744op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 51.341µs 51.433µs ± 0.029µs 51.430µs ± 0.012µs 51.442µs 51.474µs 51.493µs 51.633µs 0.39% 2.083 13.554 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19367622.302op/s 19442751.321op/s ± 10792.007op/s 19443772.499op/s ± 4402.939op/s 19448049.398op/s 19454622.095op/s 19470182.137op/s 19477583.249op/s 0.17% -2.065 13.427 0.06% 763.110op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.029µs 6.038µs ± 0.006µs 6.037µs ± 0.001µs 6.039µs 6.043µs 6.056µs 6.110µs 1.20% 7.978 82.007 0.11% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 163670391.552op/s 165613751.322op/s ± 173376.992op/s 165637458.911op/s ± 38917.093op/s 165672320.116op/s 165726688.115op/s 165789721.664op/s 165863141.875op/s 0.14% -7.914 80.980 0.10% 12259.605op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.913µs; 3.914µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ throughput [255516986.134op/s; 255560062.738op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [82.624µs; 82.793µs] or [-0.102%; +0.102%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12078954.177op/s; 12103620.524op/s] or [-0.102%; +0.102%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [79.511µs; 79.622µs] or [-0.070%; +0.070%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12559605.584op/s; 12577240.172op/s] or [-0.070%; +0.070%] None None None
credit_card/is_card_number/37828224631 execution_time [3.913µs; 3.914µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255508212.617op/s; 255552903.548op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [76.247µs; 76.362µs] or [-0.075%; +0.075%] None None None
credit_card/is_card_number/378282246310005 throughput [13095874.542op/s; 13115599.462op/s] or [-0.075%; +0.075%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [51.424µs; 51.432µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19443330.948op/s; 19446253.584op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.037µs; 6.038µs] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/x371413321323331 throughput [165605671.581op/s; 165655875.271op/s] or [-0.015%; +0.015%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.913µs; 3.914µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255499239.213op/s; 255552886.331op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [66.167µs; 66.217µs] or [-0.038%; +0.038%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15101964.839op/s; 15113276.114op/s] or [-0.037%; +0.037%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [59.681µs; 59.706µs] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [16748816.781op/s; 16755809.646op/s] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.913µs; 3.913µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255528969.383op/s; 255570201.579op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [56.780µs; 56.829µs] or [-0.044%; +0.044%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [17596657.564op/s; 17612093.239op/s] or [-0.044%; +0.044%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [51.429µs; 51.437µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19441255.652op/s; 19444246.989op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.037µs; 6.039µs] or [-0.015%; +0.015%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165589722.939op/s; 165637779.706op/s] or [-0.015%; +0.015%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 450d437 1740662934 julio/APMSP-1446-add-v05-support
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 243.983ns 251.838ns ± 10.614ns 247.780ns ± 2.627ns 252.038ns 283.844ns 287.055ns 288.717ns 16.52% 2.291 4.360 4.20% 0.751ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [250.367ns; 253.309ns] or [-0.584%; +0.584%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 450d437 1740662934 julio/APMSP-1446-add-v05-support
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 32.572µs 33.107µs ± 0.923µs 32.679µs ± 0.043µs 32.792µs 35.067µs 35.089µs 36.233µs 10.87% 1.724 1.131 2.78% 0.065µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [32.979µs; 33.235µs] or [-0.386%; +0.386%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 450d437 1740662934 julio/APMSP-1446-add-v05-support
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.181µs 3.172µs ± 1.520µs 2.966µs ± 0.026µs 2.993µs 3.589µs 13.807µs 16.998µs 473.14% 7.625 59.548 47.78% 0.107µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.962µs; 3.383µs] or [-6.638%; +6.638%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 450d437 1740662934 julio/APMSP-1446-add-v05-support
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.801µs 25.720µs ± 11.074µs 18.003µs ± 0.162µs 35.026µs 43.603µs 55.826µs 98.553µs 447.43% 2.028 8.351 42.95% 0.783µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.185µs; 27.255µs] or [-5.967%; +5.967%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 450d437 1740662934 julio/APMSP-1446-add-v05-support
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.411µs 2.445µs ± 0.037µs 2.435µs ± 0.009µs 2.448µs 2.506µs 2.657µs 2.664µs 9.40% 3.977 18.892 1.51% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.440µs; 2.450µs] or [-0.210%; +0.210%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 450d437 1740662934 julio/APMSP-1446-add-v05-support
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 208.582µs 209.040µs ± 0.155µs 209.026µs ± 0.092µs 209.135µs 209.348µs 209.404µs 209.456µs 0.21% 0.209 0.405 0.07% 0.011µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4774276.200op/s 4783785.242op/s ± 3550.703op/s 4784094.798op/s ± 2116.446op/s 4785953.228op/s 4789158.401op/s 4791822.450op/s 4794282.658op/s 0.21% -0.203 0.405 0.07% 251.073op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.255µs 18.330µs ± 0.036µs 18.327µs ± 0.024µs 18.355µs 18.389µs 18.431µs 18.443µs 0.63% 0.343 0.383 0.20% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 54219903.170op/s 54554967.453op/s ± 107174.940op/s 54563340.819op/s ± 72032.065op/s 54621262.934op/s 54725195.255op/s 54778169.451op/s 54780949.856op/s 0.40% -0.330 0.366 0.20% 7578.413op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.753µs 10.819µs ± 0.122µs 10.808µs ± 0.027µs 10.834µs 10.869µs 10.889µs 12.468µs 15.36% 12.407 165.155 1.13% 0.009µs 1 200
normalization/normalize_name/normalize_name/good throughput 80204385.452op/s 92439246.636op/s ± 917316.823op/s 92527447.994op/s ± 233378.367op/s 92769889.515op/s 92900404.607op/s 92961304.684op/s 92995041.218op/s 0.51% -11.942 156.847 0.99% 64864.095op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [209.018µs; 209.061µs] or [-0.010%; +0.010%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4783293.149op/s; 4784277.336op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.325µs; 18.335µs] or [-0.027%; +0.027%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54540114.037op/s; 54569820.869op/s] or [-0.027%; +0.027%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.802µs; 10.836µs] or [-0.156%; +0.156%] None None None
normalization/normalize_name/normalize_name/good throughput [92312115.346op/s; 92566377.925op/s] or [-0.138%; +0.138%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 450d437 1740662934 julio/APMSP-1446-add-v05-support
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 149.108µs 149.929µs ± 0.392µs 149.844µs ± 0.150µs 150.035µs 150.481µs 151.377µs 153.411µs 2.38% 4.214 31.189 0.26% 0.028µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [149.874µs; 149.983µs] or [-0.036%; +0.036%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 450d437 1740662934 julio/APMSP-1446-add-v05-support
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 504.422µs 505.615µs ± 0.490µs 505.607µs ± 0.229µs 505.839µs 506.234µs 506.610µs 509.930µs 0.86% 3.297 28.744 0.10% 0.035µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1961051.769op/s 1977789.518op/s ± 1909.018op/s 1977819.197op/s ± 894.482op/s 1978692.233op/s 1980492.632op/s 1981504.246op/s 1982466.188op/s 0.23% -3.240 28.131 0.10% 134.988op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 452.390µs 453.245µs ± 0.343µs 453.227µs ± 0.225µs 453.452µs 453.812µs 454.192µs 454.362µs 0.25% 0.512 0.813 0.08% 0.024µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2200887.552op/s 2206314.552op/s ± 1667.723op/s 2206400.857op/s ± 1096.018op/s 2207497.539op/s 2209076.060op/s 2209762.853op/s 2210484.305op/s 0.19% -0.506 0.803 0.08% 117.926op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 175.152µs 176.402µs ± 0.288µs 176.409µs ± 0.208µs 176.635µs 176.787µs 176.856µs 177.049µs 0.36% -0.711 0.914 0.16% 0.020µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5648150.010op/s 5668891.532op/s ± 9277.811op/s 5668635.622op/s ± 6670.446op/s 5674735.577op/s 5685118.166op/s 5692442.706op/s 5709341.862op/s 0.72% 0.723 0.955 0.16% 656.040op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.593µs 37.689µs ± 0.044µs 37.684µs ± 0.027µs 37.715µs 37.771µs 37.814µs 37.831µs 0.39% 0.710 0.626 0.12% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26433254.879op/s 26533272.949op/s ± 31202.072op/s 26536170.422op/s ± 19034.375op/s 26555023.379op/s 26577259.119op/s 26589539.811op/s 26600873.839op/s 0.24% -0.703 0.612 0.12% 2206.320op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.107µs 48.329µs ± 0.207µs 48.303µs ± 0.187µs 48.534µs 48.650µs 48.689µs 48.728µs 0.88% 0.289 -1.511 0.43% 0.015µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20522035.479op/s 20692030.941op/s ± 88562.736op/s 20702721.482op/s ± 80279.211op/s 20782573.515op/s 20784629.351op/s 20786087.005op/s 20786829.465op/s 0.41% -0.284 -1.517 0.43% 6262.331op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [505.548µs; 505.683µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1977524.946op/s; 1978054.089op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [453.197µs; 453.292µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2206083.422op/s; 2206545.683op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [176.362µs; 176.442µs] or [-0.023%; +0.023%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5667605.717op/s; 5670177.348op/s] or [-0.023%; +0.023%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.682µs; 37.695µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26528948.642op/s; 26537597.256op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [48.300µs; 48.357µs] or [-0.059%; +0.059%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20679756.998op/s; 20704304.885op/s] or [-0.059%; +0.059%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 450d437 1740662934 julio/APMSP-1446-add-v05-support
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.986µs 5.066µs ± 0.051µs 5.071µs ± 0.054µs 5.093µs 5.154µs 5.157µs 5.160µs 1.74% 0.221 -1.035 1.01% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.059µs; 5.074µs] or [-0.140%; +0.140%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 450d437 1740662934 julio/APMSP-1446-add-v05-support
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 54.607ms 54.899ms ± 0.223ms 54.856ms ± 0.126ms 54.993ms 55.272ms 55.721ms 55.907ms 1.92% 1.676 3.820 0.40% 0.016ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [54.868ms; 54.930ms] or [-0.056%; +0.056%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 450d437 1740662934 julio/APMSP-1446-add-v05-support
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 5.998ms 6.009ms ± 0.007ms 6.008ms ± 0.003ms 6.011ms 6.017ms 6.023ms 6.079ms 1.18% 5.536 47.455 0.12% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [6.008ms; 6.010ms] or [-0.017%; +0.017%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 450d437 1740662934 julio/APMSP-1446-add-v05-support
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 65.629µs 65.810µs ± 0.253µs 65.771µs ± 0.043µs 65.819µs 65.999µs 66.443µs 68.705µs 4.46% 8.838 91.389 0.38% 0.018µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [65.775µs; 65.845µs] or [-0.053%; +0.053%] None None None

Baseline

Omitted due to size.

@hoolioh hoolioh force-pushed the julio/APMSP-1446-add-v05-support branch 2 times, most recently from d477afd to fee95f3 Compare February 27, 2025 09:56
@hoolioh
Integrate v05 decoding/encoding in the trace exporter.
450d437 
* Use TraceChunkSpan as a common placeholder for v04 and v05 incoming payloads.
* Add support for V05 payloads in TracerPayloadCollection.
@hoolioh hoolioh force-pushed the julio/APMSP-1446-add-v05-support branch from fee95f3 to 450d437 Compare February 27, 2025 13:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@hoolioh