Skip to content

xfail very flaky test #5245

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

max-sixty
Copy link
Collaborator

This consistently fails.

In general I think as soon as we see this happening, we should either fix immediately (but probably not that easy) or xfail it and if necessary open an issue. That keeps the main branch green, such that we can reliably use passing tests as an indicator of PRs.

Though as ever, very open to other thoughts. There's a reasonable argument that "keeping master green by removing any failing tests is missing the point a bit"...

@max-sixty
Copy link
Collaborator Author

I think this is wrong and it's actually these?

=========================== short test summary info ============================
FAILED xarray/tests/test_backends.py::TestPydapOnline::test_cmp_local_file - ...
FAILED xarray/tests/test_backends.py::TestPydapOnline::test_dask - webob.exc....
FAILED xarray/tests/test_backends.py::TestPydapOnline::test_compatible_to_netcdf

@shoyer
Copy link
Member

shoyer commented May 3, 2021

In general I think as soon as we see this happening, we should either fix immediately (but probably not that easy) or xfail it and if necessary open an issue. That keeps the main branch green, such that we can reliably use passing tests as an indicator of PRs.

Though as ever, very open to other thoughts. There's a reasonable argument that "keeping master green by removing any failing tests is missing the point a bit"...

👍

It does look like the "TestPydapOnline" tests are still a culprit here...

@max-sixty
Copy link
Collaborator Author

It does seem this is happening a fair amount, so I'll merge this — feel free to revert if I'm mistaken. I think it may be worth also xfailing the Pydap tests?

@max-sixty max-sixty changed the title xfail test that always fails xfail very flaky test May 3, 2021
@max-sixty max-sixty merged commit 73d7d6e into pydata:master May 3, 2021
@max-sixty max-sixty deleted the xfail-test-save-mfdataset-comute branch May 3, 2021 04:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants