ci: switch repo to use pytest plugin v2

[romainkomorn-exdatadog]

This makes tweaks to run the new version of the pytest plugin on the dd-trace-py repostitory.

• the coverage collector is tweaked to only cover use code, and always ignore the coverage module itself
• ITR is disabled for the appsec suite
• _CI_DD_ENV is introduced as a way to override the DD_ENV from the environment (as setting it in our current CI breaks dozens of unrelated tests)
• the -s flag is added to pytest invocations for output to appear
• a test is refactored to account for the fact that ModuleWatchdog now has children classes that may be active

Checklist

• PR author has checked that all the criteria below are met
• The PR description includes an overview of the change
• The PR description articulates the motivation for the change
• The change includes tests OR the PR description describes a testing strategy
• The PR description notes risks associated with the change, if any
• Newly-added code is easy to change
• The change follows the library release note guidelines
• The change includes or references documentation updates if necessary
• Backport labels are set (if applicable)

Reviewer Checklist

• Reviewer has checked that all the criteria below are met
• Title is accurate
• All changes are related to the pull request's stated goal
• Avoids breaking API changes
• Testing strategy adequately addresses listed risks
• Newly-added code is easy to change
• Release note makes sense to a user of the library
• If necessary, author has acknowledged and discussed the performance implications of this PR as reported in the benchmarks PR comment
• Backport labels are set in a manner that is consistent with the release branch maintenance policy

[github-actions]

CODEOWNERS have been resolved as:

.gitlab/tests.yml                                                       @DataDog/python-guild @DataDog/apm-core-python
ddtrace/contrib/pytest/_plugin_v2.py                                    @DataDog/ci-app-libraries
ddtrace/internal/ci_visibility/recorder.py                              @DataDog/ci-app-libraries
ddtrace/internal/ci_visibility/writer.py                                @DataDog/ci-app-libraries
ddtrace/internal/coverage/code.py                                       @DataDog/apm-core-python @datadog/ci-app-libraries
riotfile.py                                                             @DataDog/apm-python
tests/internal/test_module.py                                           @DataDog/debugger-python @DataDog/apm-core-python

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 20.00000% with 8 lines in your changes missing coverage. Please review.

Project coverage is 13.91%. Comparing base (7ceea02) to head (d47ca80).
Report is 10 commits behind head on main.

Files with missing lines	Patch %	Lines
ddtrace/internal/coverage/code.py	0.00%	4 Missing ⚠️
tests/internal/test_module.py	0.00%	3 Missing ⚠️
...dtrace/internal/coverage/instrumentation_py3_10.py	0.00%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main   #11379      +/-   ##
==========================================
- Coverage   13.93%   13.91%   -0.02%     
==========================================
  Files        1520     1530      +10     
  Lines      131435   132660    +1225     
==========================================
+ Hits        18313    18463     +150     
- Misses     113122   114197    +1075     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[romainkomorn-exdatadog]

@christophe-papazian , mind taking a peek at the riotfile.py change for appsec ?

[pr-commenter]

Benchmarks

Benchmark execution time: 2024-11-14 17:21:28

Comparing candidate commit 6d139ad in PR branch romain.komorn/chore/enable_pytest_v2_plugin_for_repo with baseline commit c7246a4 in branch main.

Found 1 performance improvements and 0 performance regressions! Performance is the same for 387 metrics, 2 unstable metrics.

scenario:iast_aspects-ospathnormcase_aspect

• 🟩 execution_time [-221.150ns; -199.170ns] or [-8.272%; -7.450%]

[datadog-dd-trace-py-rkomorn]

Datadog Report

Branch report: romain.komorn/chore/enable_pytest_v2_plugin_for_repo
Commit report: 6d139ad
Test service: dd-trace-py

✅ 0 Failed, 14 Passed, 1454 Skipped, 1m 3.15s Total duration (35m 44.09s time saved)