Skip to content
This repository has been archived by the owner on Oct 11, 2024. It is now read-only.

Fix nightly - 03/18/2024 #136

Merged
merged 6 commits into from
Mar 18, 2024

Conversation

varun-sundar-rabindranath

SUMMARY:
Miscellaneous changes to fix nightly:

  • Benchmarks:
    • Add a benchmark name so the alert-triggering is correct
    • Don't skip github-action-benchmark failure based on previous failure
    • Shorten metric names so github-action-benchmark doesn't hit the github comment size threshold
  • Nightly-SOLO:
    • Fix code-coverage artifact name
  • Misc:
    • Add extra information to github-action-benchmark JSON that is useful in the UI

TEST PLAN:
Manual testing

varun-sundar-rabindranath added a commit that referenced this pull request Mar 18, 2024
SUMMARY:
Reset data.js - #136 modifies
the datastore making it incompatible with the existing datastore

- Noteworthy changes:
- Add benchmark names : This groups the metrics by benchmark-names. The
existing version has a flat structure.
- Shorten metric names : Breaks the "constant metric name" guarantee
that the UI uses to match benchmarks between commits
- Add information to "extra" : This is not a breaking change - Just adds
additional information to the "extra" field. This information is very
useful for the UI (i.e. lets us filter charts by these values)

TEST PLAN:
No testing

---------

Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
@varun-sundar-rabindranath varun-sundar-rabindranath merged commit f90ec1c into main Mar 18, 2024
2 checks passed
@varun-sundar-rabindranath varun-sundar-rabindranath deleted the varun/fix-nightly-03-18-2024 branch March 18, 2024 23:58
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants