Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: removed missing_recommended_column and related annotation + changed missing_timepoint_value notice description #1963

Merged
merged 4 commits into from
Feb 4, 2025

Conversation

cka-y
Copy link
Contributor

@cka-y cka-y commented Feb 4, 2025

Summary:

Closes #1908
This PR involves the removal of the MissingRecommendedColumnNotice class and associated logic for handling recommended columns throughout the codebase.

image

Please make sure these boxes are checked before submitting your pull request - thanks!

  • Run the unit tests with gradle test to make sure you didn't break anything
  • Add or update any needed documentation to the repo
  • Format the title like "feat: [new feature short description]". Title must follow the Conventional Commit Specification(https://www.conventionalcommits.org/en/v1.0.0/).
  • Linked all relevant issues
  • Include screenshot(s) showing how this pull request works and fixes the issue(s)

Copy link
Contributor

github-actions bot commented Feb 4, 2025

📝 Acceptance Test Report

📋 Summary

✅ The rule acceptance has passed for commit f8ea86f
Download the full acceptance test report here (report will disappear after 90 days).

📊 Notices Comparison

New Errors (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Errors (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

New Warnings (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Warnings (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

🛡️ Corruption Check

0 out of 1801 sources (~0 %) are corrupted.

⏱️ Performance Assessment

📈 Validation Time

Assess the performance in terms of seconds taken for the validation process.

Time Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 3.67 3.76 ⬆️+0.09
Median -- 1.37 1.41 ⬆️+0.04
Standard Deviation -- 10.44 10.60 ⬆️+0.16
Minimum in References Reports us-oregon-high-desert-point-gtfs-636 0.48 0.61 ⬆️+0.14
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 279.87 287.03 ⬆️+7.16
Minimum in Latest Reports us-michigan-detroit-people-mover-gtfs-417 0.50 0.51 ⬆️+0.01
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 279.87 287.03 ⬆️+7.16
📜 Memory Consumption
Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 465.45 MiB 468.32 MiB ⬆️+2.88 MiB
Median -- 333.92 MiB 332.38 MiB ⬇️-1.54 MiB
Standard Deviation -- 756.78 MiB 777.51 MiB ⬆️+20.73 MiB
Minimum in References Reports us-ohio-allen-county-regional-transit-authority-gtfs-210 39.51 MiB 52.27 MiB ⬆️+12.76 MiB
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.93 GiB 10.93 GiB ⬆️+5.38 MiB
Minimum in Latest Reports us-california-yubasutter-transit-gtfs-79 41.67 MiB 39.98 MiB ⬇️-1.69 MiB
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.93 GiB 10.93 GiB ⬆️+5.38 MiB

@davidgamez
Copy link
Member

As the notice and all associated code are removed, let's remove the RecommendedColumn annotation to make sure it is not used without the supporting code.

Copy link
Contributor

github-actions bot commented Feb 4, 2025

📝 Acceptance Test Report

📋 Summary

✅ The rule acceptance has passed for commit 9c3bb16
Download the full acceptance test report here (report will disappear after 90 days).

📊 Notices Comparison

New Errors (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Errors (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

New Warnings (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Warnings (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

🛡️ Corruption Check

0 out of 1801 sources (~0 %) are corrupted.

⏱️ Performance Assessment

📈 Validation Time

Assess the performance in terms of seconds taken for the validation process.

Time Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 3.64 3.67 ⬆️+0.04
Median -- 1.34 1.38 ⬆️+0.04
Standard Deviation -- 10.36 10.33 ⬇️-0.03
Minimum in References Reports us-oregon-high-desert-point-gtfs-636 0.47 0.49 ⬆️+0.01
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 281.85 277.55 ⬇️-4.30
Minimum in Latest Reports us-california-city-of-wasco-gtfs-1788 0.51 0.47 ⬇️-0.04
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 281.85 277.55 ⬇️-4.30
📜 Memory Consumption
Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 460.20 MiB 460.53 MiB ⬆️+338.28 KiB
Median -- 333.58 MiB 331.92 MiB ⬇️-1.66 MiB
Standard Deviation -- 735.28 MiB 750.26 MiB ⬆️+14.98 MiB
Minimum in References Reports ro-vrancea-consiliul-judetean-vrancea-gtfs-1984 38.22 MiB 40.05 MiB ⬆️+1.83 MiB
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.62 GiB 11.01 GiB ⬆️+399.15 MiB
Minimum in Latest Reports ca-prince-edward-island-t3-transit-gtfs-2132 411.92 MiB 39.57 MiB ⬇️-372.35 MiB
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.62 GiB 11.01 GiB ⬆️+399.15 MiB

Copy link
Member

@davidgamez davidgamez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@cka-y cka-y merged commit d0b5263 into master Feb 4, 2025
134 checks passed
@cka-y cka-y deleted the feat/1908-2 branch February 4, 2025 20:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Remove missing_recommended_column notice
2 participants