Skip to content

require codecov patch % to be 100% #13273

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Mar 6, 2025
Merged

Conversation

jakkdl
Copy link
Member

@jakkdl jakkdl commented Mar 5, 2025

The status quo is for patch coverage to be greater than or equal to the project% (currently 96.87%), which means that in practice it's 100% .. except if a PR is big enough, at which point a couple lines can sneak through.
I just merged #13192 which had 98.26% coverage for no reason, I'll add more tests and stuff in a followup to retroactively get it to 100%.

@jakkdl jakkdl requested a review from webknjaz March 5, 2025 16:37
@jakkdl jakkdl added the skip news used on prs to opt out of the changelog requirement label Mar 5, 2025
@jakkdl jakkdl merged commit 33c7b05 into pytest-dev:main Mar 6, 2025
28 checks passed
@jakkdl jakkdl deleted the codecov_target branch March 6, 2025 12:14
@nicoddemus
Copy link
Member

nicoddemus commented Mar 6, 2025

I recall in the past we did not use this configuration because codecov was proving to be unreliable, but that was many years ago so let's hope the experience is better this time. 🤞

@webknjaz
Copy link
Member

webknjaz commented Mar 6, 2025

It's much more stable these days, yes.

@Pierre-Sassoulas
Copy link
Member

It's possible to bypass with admin rights (for exemple if you remove a bunch of well covered code the coverage percentage decrease and it's ok).

@jakkdl
Copy link
Member Author

jakkdl commented Mar 7, 2025

I think even with unreliable codecov there's rarely gonna be difference between 96.87% and 100%, and yeah it's possible to override or rerun failed uploads. But 🤞 indeed

@RonnyPfannschmidt
Copy link
Member

#12017 just demonstrated this is a good idea

there was stuff i actually missed - and before it would have missed

also im under the impression sentry is slowly getting codecov better

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
skip news used on prs to opt out of the changelog requirement
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants