Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix flaky test, remove high tolerance #7567

Merged
merged 2 commits into from
Nov 12, 2024
Merged

fix flaky test, remove high tolerance #7567

merged 2 commits into from
Nov 12, 2024

Conversation

bwengals
Copy link
Contributor

@bwengals bwengals commented Nov 11, 2024

Description

The multi-output GP test was flaky. Turns out that it was lucky that it was passing occasionally. It was testing whether two GP implementations were correct when they were subtly different. pm.gp.Latent.conditional was conditioning on the original gp f, and pm.gp.Marginal.conditional was conditioning on the observed data y. The fix is to condition pm.gp.Latent.conditional on y also in the test.

Related Issue

Checklist

Type of change

  • New feature / enhancement
  • Bug fix
  • Documentation
  • Maintenance
  • Other (please specify):

📚 Documentation preview 📚: https://pymc--7567.org.readthedocs.build/en/7567/

@github-actions github-actions bot added GP Gaussian Process tests labels Nov 11, 2024
@bwengals bwengals mentioned this pull request Nov 11, 2024
19 tasks
@ricardoV94
Copy link
Member

Failed in windows seems to need a bit more tolerance

@ricardoV94 ricardoV94 added maintenance no releasenotes Skipped in automatic release notes generation labels Nov 11, 2024
Copy link

codecov bot commented Nov 12, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 92.82%. Comparing base (f551718) to head (27058f3).
Report is 1 commits behind head on main.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             main    #7567      +/-   ##
==========================================
- Coverage   92.83%   92.82%   -0.01%     
==========================================
  Files         106      106              
  Lines       17669    17669              
==========================================
- Hits        16403    16402       -1     
- Misses       1266     1267       +1     

see 1 file with indirect coverage changes

@bwengals
Copy link
Contributor Author

oh windows. increased rtol a bit

@ricardoV94 ricardoV94 merged commit cbc54e0 into main Nov 12, 2024
23 checks passed
@ricardoV94
Copy link
Member

Thanks @bwengals

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
GP Gaussian Process maintenance no releasenotes Skipped in automatic release notes generation tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Flaky tests/gp/test_gp.py::TestMarginalVsLatent::testLatentMultioutput
2 participants