Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(ci): add benchmarks-walltime job to run additional performance benchmarks #65

Merged
merged 1 commit into from
Jan 28, 2025

Conversation

art049
Copy link
Member

@art049 art049 commented Jan 9, 2025

No description provided.

@art049 art049 force-pushed the feat/run-both-walltime-and-instrumentation branch 4 times, most recently from daacd05 to f5e7319 Compare January 14, 2025 20:43
@CodSpeedHQ CodSpeedHQ deleted a comment from avalanche-staging bot Jan 17, 2025
@CodSpeedHQ CodSpeedHQ deleted a comment from avalanche-local bot Jan 17, 2025
@CodSpeedHQ CodSpeedHQ deleted a comment from avalanche-staging bot Jan 17, 2025
@CodSpeedHQ CodSpeedHQ deleted a comment from avalanche-staging bot Jan 17, 2025
@adriencaccia adriencaccia force-pushed the feat/run-both-walltime-and-instrumentation branch from 363ee6c to 8dd91c2 Compare January 17, 2025 11:02
@CodSpeedHQ CodSpeedHQ deleted a comment from codspeed-hq bot Jan 17, 2025
@CodSpeedHQ CodSpeedHQ deleted a comment from avalanche-staging bot Jan 17, 2025
@CodSpeedHQ CodSpeedHQ deleted a comment from avalanche-staging bot Jan 17, 2025
Copy link

codspeed-hq bot commented Jan 17, 2025

CodSpeed Instrumentation Performance Report

Merging #65 will degrade performances by 2.26%

Comparing feat/run-both-walltime-and-instrumentation (003c3b4) with master (768b5b8)

Summary

❌ 1 regressions
✅ 46 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Benchmarks breakdown

Benchmark BASE HEAD Change
test_combination_lists[4-2] 30.2 µs 30.9 µs -2.26%

Copy link

codspeed-hq bot commented Jan 17, 2025

CodSpeed Walltime Performance Report

Merging #65 will degrade performances by 2.47%

Comparing feat/run-both-walltime-and-instrumentation (003c3b4) with master (003c3b4)

Summary

⚡ 13 improvements
❌ 1 regressions
✅ 33 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Benchmarks breakdown

Benchmark BASE HEAD Change
test_color[graph0-3] 27.1 µs 26.2 µs +3.62%
test_depth_first_search[4] 27.9 µs 26.9 µs +3.8%
test_generate_all_combinations[0-0] 1.2 µs 1.2 µs +2.02%
test_generate_all_combinations[4-2] 5.9 µs 5.6 µs +5.35%
test_generate_all_combinations[5-4] 8.2 µs 7.8 µs +5.21%
test_get_valid_pos[pos0-4] 2.8 µs 2.9 µs -2.47%
test_is_safe[board0-1-1] 10.1 µs 9.7 µs +4.34%
test_match_word_pattern[aba-GraphTreesGraph] 90.3 µs 87.8 µs +2.82%
test_minimax[scores0] 8.4 µs 7.9 µs +5.45%
test_iterative_fibo_10 1.2 µs 1.2 µs +3%
test_recursive_cached_fibo_10 6.6 µs 6.5 µs +2.41%
test_noop_ellipsis_decorated 540 ns 516 ns +4.65%
test_noop_lambda_decorated 876 ns 852 ns +2.82%
test_noop_pass 444 ns 420 ns +5.71%

@art049 art049 force-pushed the feat/run-both-walltime-and-instrumentation branch from 4244ff8 to 003c3b4 Compare January 28, 2025 17:34
@art049 art049 merged commit 003c3b4 into master Jan 28, 2025
23 checks passed
@art049 art049 deleted the feat/run-both-walltime-and-instrumentation branch January 28, 2025 17:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant