Skip to content

Update Past CI report script#19228

Merged
ydshieh merged 5 commits intomainfrom
update_past_ci_report_script
Sep 29, 2022
Merged

Update Past CI report script#19228
ydshieh merged 5 commits intomainfrom
update_past_ci_report_script

Conversation

@ydshieh
Copy link
Collaborator

@ydshieh ydshieh commented Sep 28, 2022

What does this PR do?

To make the fix process easier:

  • A single file errors.json (instead of 2 files) that contains line of error, error, failed test and job_link together for each element. See below.
  • The table for reporting on GitHub page get a new status column - in order to update the progress.

Elements in errors.json looks now

[
    "/transformers/src/transformers/configuration_utils.py:642",
    "OSError: gs555750 is not a valid git identifier (branch name, tag name or commit id) that exists for this model name. Check the model page at 'https://huggingface.co/bigscience/bloom-350m' for available revisions.",
    "tests/models/bloom/test_modeling_bloom.py::BloomModelTest::test_batch_generation",
    "https://github.com/huggingface/transformers/actions/runs/3145556680/jobs/5112996392"
],

Having a job link attached to each element, so we can click or copy/paste to go the the job run page for the full traceback. However, this information is not available yet. I will try to obtain them #19235 is for this goal.

header = "| no. | error |"
sep = "|-:|:-|"
header = "| no. | error | status |"
sep = "|-:|:-|:-|"
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Create this new column here, so we don't need to do it manually on Github page.

@ydshieh ydshieh requested a review from LysandreJik September 28, 2022 11:41
@ydshieh ydshieh force-pushed the update_past_ci_report_script branch from f1fe8ba to 1e86f62 Compare September 28, 2022 20:19
job_link = job_links.get(job_name, None)

# A list with elements of the form (line of error, error, failed test)
result = [x + [y] + [job_link] for x, y in zip(errors, failed_tests)]
Copy link
Collaborator Author

@ydshieh ydshieh Sep 28, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Combine the information instead of 2 separate lists previously.

Also add job links, so we can go the job run pages in order to see more information about the errors.

@HuggingFaceDocBuilderDev
Copy link

HuggingFaceDocBuilderDev commented Sep 28, 2022

The documentation is not available anymore as the PR was closed or merged.

Copy link
Member

@LysandreJik LysandreJik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @ydshieh!

@ydshieh ydshieh merged commit 1a1893e into main Sep 29, 2022
@ydshieh ydshieh deleted the update_past_ci_report_script branch September 29, 2022 17:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants