Skip to content

feat: standardize empty value on report.json #2004

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Mar 6, 2025
Merged

Conversation

davidgamez
Copy link
Member

@davidgamez davidgamez commented Mar 5, 2025

Summary:

This PR standardizes the empty strings by populating the values with "" instead of N/A in the generated report.json. The report.html will still render "N/A" for empty values.

Closes #2003

Expected behavior:

Empty values are actually empty in the generated report.json instead of "N/A".

Screenshot 2025-03-05 at 2 21 47 PM Screenshot 2025-03-05 at 2 21 25 PM

Please make sure these boxes are checked before submitting your pull request - thanks!

  • Run the unit tests with gradle test to make sure you didn't break anything
  • Add or update any needed documentation to the repo
  • Format the title like "feat: [new feature short description]". Title must follow the Conventional Commit Specification(https://www.conventionalcommits.org/en/v1.0.0/).
  • Linked all relevant issues
  • Include screenshot(s) showing how this pull request works and fixes the issue(s)

Copy link
Contributor

github-actions bot commented Mar 5, 2025

📝 Acceptance Test Report

📋 Summary

✅ The rule acceptance has passed for commit 1af08e9
Download the full acceptance test report here (report will disappear after 90 days).

📊 Notices Comparison

New Errors (0 out of 1824 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Errors (1 out of 1824 datasets, ~0%) ✅

Details of new errors due to code change, which is less than the provided threshold of 1%.

Dataset Notice Code
us-california-la-puente-link-gtfs-2250 missing_required_column
New Warnings (0 out of 1824 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Warnings (0 out of 1824 datasets, ~0%) ✅

No changes were detected due to the code change.

🛡️ Corruption Check

0 out of 1824 sources (~0 %) are corrupted.

⏱️ Performance Assessment

📈 Validation Time

Assess the performance in terms of seconds taken for the validation process.

Time Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 3.74 3.84 ⬆️+0.10
Median -- 1.36 1.42 ⬆️+0.06
Standard Deviation -- 10.95 11.11 ⬆️+0.16
Minimum in References Reports us-california-west-berkeley-shuttle-gtfs-2238 0.47 0.57 ⬆️+0.10
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 284.47 279.45 ⬇️-5.02
Minimum in Latest Reports us-california-taft-area-transit-gtfs-2236 0.60 0.50 ⬇️-0.10
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 284.47 279.45 ⬇️-5.02
📜 Memory Consumption
Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 465.11 MiB 457.31 MiB ⬇️-7.80 MiB
Median -- 335.92 MiB 335.92 MiB ⬇️0 bytes
Standard Deviation -- 771.81 MiB 726.44 MiB ⬇️-45.37 MiB
Minimum in References Reports us-oregon-lincoln-county-transit-lct-gtfs-23 39.70 MiB 46.34 MiB ⬆️+6.64 MiB
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.85 GiB 10.67 GiB ⬇️-179.84 MiB
Minimum in Latest Reports us-california-westcat-gtfs-78 46.19 MiB 39.73 MiB ⬇️-6.46 MiB
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.85 GiB 10.67 GiB ⬇️-179.84 MiB

Copy link
Contributor

github-actions bot commented Mar 5, 2025

📝 Acceptance Test Report

📋 Summary

✅ The rule acceptance has passed for commit 479d5e5
Download the full acceptance test report here (report will disappear after 90 days).

📊 Notices Comparison

New Errors (0 out of 1824 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Errors (1 out of 1824 datasets, ~0%) ✅

Details of new errors due to code change, which is less than the provided threshold of 1%.

Dataset Notice Code
fr-paris-ile-de-france-mobilite-gtfs-1026 missing_required_column
fr-paris-ile-de-france-mobilite-gtfs-1026 pathway_unreachable_location
New Warnings (0 out of 1824 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Warnings (1 out of 1824 datasets, ~0%) ✅

Details of new errors due to code change, which is less than the provided threshold of 1%.

Dataset Notice Code
fr-paris-ile-de-france-mobilite-gtfs-1026 duplicate_route_name
fr-paris-ile-de-france-mobilite-gtfs-1026 expired_calendar
fr-paris-ile-de-france-mobilite-gtfs-1026 fast_travel_between_consecutive_stops
fr-paris-ile-de-france-mobilite-gtfs-1026 fast_travel_between_far_stops
fr-paris-ile-de-france-mobilite-gtfs-1026 missing_recommended_file
fr-paris-ile-de-france-mobilite-gtfs-1026 mixed_case_recommended_field
fr-paris-ile-de-france-mobilite-gtfs-1026 route_color_contrast
fr-paris-ile-de-france-mobilite-gtfs-1026 route_long_name_contains_short_name
fr-paris-ile-de-france-mobilite-gtfs-1026 stop_without_stop_time

🛡️ Corruption Check

0 out of 1824 sources (~0 %) are corrupted.

⏱️ Performance Assessment

📈 Validation Time

Assess the performance in terms of seconds taken for the validation process.

Time Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 3.78 3.85 ⬆️+0.06
Median -- 1.44 1.49 ⬆️+0.05
Standard Deviation -- 10.82 10.84 ⬆️+0.02
Minimum in References Reports es-santa-cruz-de-tenerife-metropolitano-de-tenerife-gtfs-788 0.48 0.54 ⬆️+0.06
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 279.78 278.44 ⬇️-1.34
Minimum in Latest Reports au-tasmania-merseylink-gtfs-1251 0.48 0.48 ⬆️+0.00
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 279.78 278.44 ⬇️-1.34

⚠️ Warnings

The following dataset IDs are missing validation times either in reference or latest:
fr-paris-ile-de-france-mobilite-gtfs-1026

📜 Memory Consumption
Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 470.76 MiB 459.63 MiB ⬇️-11.14 MiB
Median -- 335.92 MiB 335.92 MiB ⬇️0 bytes
Standard Deviation -- 801.32 MiB 740.72 MiB ⬇️-60.60 MiB
Minimum in References Reports ro-vrancea-consiliul-judetean-vrancea-gtfs-1984 37.95 MiB 37.95 MiB ⬆️+3.02 KiB
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.66 GiB 10.58 GiB ⬇️-83.49 MiB
Minimum in Latest Reports us-pennsylvania-monroe-county-transportation-authority-mcta-gtfs-523 363.92 MiB 35.89 MiB ⬇️-328.03 MiB
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.66 GiB 10.58 GiB ⬇️-83.49 MiB

Copy link
Contributor

github-actions bot commented Mar 5, 2025

📝 Acceptance Test Report

📋 Summary

✅ The rule acceptance has passed for commit 79d526f
Download the full acceptance test report here (report will disappear after 90 days).

📊 Notices Comparison

New Errors (0 out of 1823 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Errors (0 out of 1823 datasets, ~0%) ✅

No changes were detected due to the code change.

New Warnings (0 out of 1823 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Warnings (0 out of 1823 datasets, ~0%) ✅

No changes were detected due to the code change.

🛡️ Corruption Check

0 out of 1823 sources (~0 %) are corrupted.

⏱️ Performance Assessment

📈 Validation Time

Assess the performance in terms of seconds taken for the validation process.

Time Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 3.73 3.81 ⬆️+0.08
Median -- 1.36 1.41 ⬆️+0.06
Standard Deviation -- 10.79 10.86 ⬆️+0.07
Minimum in References Reports us-oregon-high-desert-point-gtfs-636 0.46 0.51 ⬆️+0.05
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 276.80 278.15 ⬆️+1.35
Minimum in Latest Reports ph-unknown-hm-transport-inc-and-robinsons-malls-gtfs-1105 0.54 0.51 ⬇️-0.02
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 276.80 278.15 ⬆️+1.35
📜 Memory Consumption
Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 456.14 MiB 467.84 MiB ⬆️+11.70 MiB
Median -- 335.92 MiB 335.92 MiB ⬇️0 bytes
Standard Deviation -- 703.02 MiB 768.51 MiB ⬆️+65.49 MiB
Minimum in References Reports ro-vrancea-consiliul-judetean-vrancea-gtfs-1984 37.95 MiB 37.99 MiB ⬆️+42.38 KiB
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.65 GiB 10.67 GiB ⬆️+21.13 MiB
Minimum in Latest Reports ro-vrancea-consiliul-judetean-vrancea-gtfs-1984 37.95 MiB 37.99 MiB ⬆️+42.38 KiB
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.65 GiB 10.67 GiB ⬆️+21.13 MiB

This reverts commit e4b8b7b.
Copy link
Contributor

github-actions bot commented Mar 6, 2025

📝 Acceptance Test Report

📋 Summary

✅ The rule acceptance has passed for commit 1a5847b
Download the full acceptance test report here (report will disappear after 90 days).

📊 Notices Comparison

New Errors (0 out of 1823 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Errors (0 out of 1823 datasets, ~0%) ✅

No changes were detected due to the code change.

New Warnings (0 out of 1823 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Warnings (0 out of 1823 datasets, ~0%) ✅

No changes were detected due to the code change.

🛡️ Corruption Check

0 out of 1823 sources (~0 %) are corrupted.

⏱️ Performance Assessment

📈 Validation Time

Assess the performance in terms of seconds taken for the validation process.

Time Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 3.70 3.79 ⬆️+0.09
Median -- 1.36 1.43 ⬆️+0.07
Standard Deviation -- 10.79 10.86 ⬆️+0.07
Minimum in References Reports us-oregon-high-desert-point-gtfs-636 0.47 0.54 ⬆️+0.07
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 284.71 288.84 ⬆️+4.13
Minimum in Latest Reports us-california-taft-area-transit-gtfs-2236 0.61 0.50 ⬇️-0.11
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 284.71 288.84 ⬆️+4.13
📜 Memory Consumption
Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 470.07 MiB 456.79 MiB ⬇️-13.28 MiB
Median -- 335.92 MiB 335.92 MiB ⬇️0 bytes
Standard Deviation -- 777.98 MiB 742.00 MiB ⬇️-35.98 MiB
Minimum in References Reports us-pennsylvania-monroe-county-transportation-authority-mcta-gtfs-523 38.11 MiB 367.92 MiB ⬆️+329.81 MiB
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 11.01 GiB 10.70 GiB ⬇️-313.72 MiB
Minimum in Latest Reports us-iowa-sioux-city-transit-system-gtfs-191 411.92 MiB 39.01 MiB ⬇️-372.91 MiB
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 11.01 GiB 10.70 GiB ⬇️-313.72 MiB

@davidgamez davidgamez merged commit e9200c1 into master Mar 6, 2025
134 checks passed
@davidgamez davidgamez deleted the feat/report-json-na branch March 6, 2025 00:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Standardize empty value on report.json
2 participants