Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ProjectTracking]: automate detection of nayduck breakages #54

Open
marcelo-gonzalez opened this issue Mar 7, 2024 · 0 comments
Open

Comments

@marcelo-gonzalez
Copy link

Goals

Reduced time and effort needed to find the root causes of nayduck test failures, and hopefully fewer failures over time as a result.

Estimated effort

This would be taken by the node team, and might take a couple weeks

Currently nayduck failures are simply reported, and it's up to someone from the node team to investigate them and either fix them or make a reasonable effort to guess who might best be asked to look into it. This can be quite time consuming, and the effort needed can pile up, leading to a bad state of the nayduck test suite in general. One way to improve this might be to implement a feature in nayduck that will detect new failures and automatically re-run the test many times via git-bisect, hopefully finding the culprit. Then something we could consider is to have nayduck automatically generate a message tagging the breaking commit's author (maybe via zulip or email)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Ideas for projects
Development

No branches or pull requests

1 participant