[python] Bump capture time budget in ER scenarios

[P403n1x87]

Motivation

We bump the capture time budget in ER scenario to make sure that exceptions are captured fully and reduce flakiness.

Changes

Increase the capture time budget.

Workflow

1. ⚠️ Create your PR as draft ⚠️
2. Work on you PR until the CI passes
3. Mark it as ready for review
   • Tests, manifest, weblog are modified -> you'll need a review from system-tests-reviewers: ask to one of youre co-worker familiar with the tested feature.
   • Framework is modified, or non obvious usage of it -> get a review from system-tests-core (slack)

🚀 Once your PR is reviewed and the CI green, you can merge it!

🛟 #apm-shared-testing 🛟

[github-actions]

CODEOWNERS have been resolved as:

utils/_context/_scenarios/__init__.py                                   @DataDog/system-tests-core

[datadog-prod-us1-6]

 

❌ Errors

Your PR has failed checks. Please review the issues below and take necessary action before merging.

🚦 10 Pipeline jobs failed

Testing the test | System Tests (rust, dev) / End-to-end #2 / axum 2 — ❌ 10 tests failed

View more details · View in GitHub Actions

❌ tests.stats.test_stats.Test_Client_Stats.test_top_level_service[axum] from system_tests_suite

AssertionError: Should have at least one stats request
assert 0 > 0
 +  where 0 = len([])

self = <tests.stats.test_stats.Test_Client_Stats object at 0x7f2c69260260>

    def test_top_level_service(self):
        """Test that the top-level Service field in the stats payload matches the configured base service"""
        stats_requests = list(interfaces.library.get_data("/v0.6/stats"))
>       assert len(stats_requests) > 0, "Should have at least one stats request"
...

❌ tests.stats.test_stats.Test_Client_Stats_Future_Obfuscation_Version.test_no_obfuscation[axum] from system_tests_suite

AssertionError: Expected at least 4 distinct SQL stats entries because obfuscation was not applied client-side
assert 0 >= 4
 +  where 0 = len(set())

self = <tests.stats.test_stats.Test_Client_Stats_Future_Obfuscation_Version object at 0x7fc12c49b290>

    def test_no_obfuscation(self):
        """Test that the SDK does not obfuscate stats and does not send the obfuscation header
        when the agent reports an obfuscation_version higher than what the SDK supports (99).
    
...

❌ tests.stats.test_stats.Test_Client_Stats_Missing_Obfuscation_Version.test_no_obfuscation[axum] from system_tests_suite

AssertionError: Expected at least 4 distinct SQL stats entries because obfuscation was not applied client-side
assert 0 >= 4
 +  where 0 = len(set())

self = <tests.stats.test_stats.Test_Client_Stats_Missing_Obfuscation_Version object at 0x7f701c94a300>

    def test_no_obfuscation(self):
        """Test that the SDK does not obfuscate stats and does not send the obfuscation header
    
        Validates:
...

❌ tests.stats.test_stats.Test_Client_Stats_Obfuscation_Version_Zero.test_no_obfuscation[axum] from system_tests_suite

AssertionError: Expected at least 4 distinct SQL stats entries because obfuscation was not applied client-side
assert 0 >= 4
 +  where 0 = len(set())

self = <tests.stats.test_stats.Test_Client_Stats_Obfuscation_Version_Zero object at 0x7fa6d0e7caa0>

    def test_no_obfuscation(self):
        """Test that the SDK does not obfuscate stats and does not send the obfuscation header
        when the agent advertises obfuscation_version=0.
    
...

❌ tests.stats.test_stats.Test_Client_Stats_With_Client_Obfuscation.test_obfuscation[axum] from system_tests_suite

AssertionError: Datadog-Obfuscation-Version header not found on any stats payload
assert False

self = <tests.stats.test_stats.Test_Client_Stats_With_Client_Obfuscation object at 0x7f2c69263740>

    def test_obfuscation(self):
        """Test that SQL resources are obfuscated before stats aggregation.
    
        Validates:
        - Datadog-Obfuscation-Version header is present on stats payloads
...

↳ and 5 more — View all

Testing the test | System Tests (python_lambda, dev) / Build end-to-end (alb-multi) — 🔄 Retry may pass, looks flaky

View more details · View in GitHub Actions

Testing the test | System Tests (python_lambda, dev) / Build end-to-end (apigw-http) — 🔄 Retry may pass, looks flaky

View more details · View in GitHub Actions

View all 10 failed jobs.

ℹ️ Info

No other issues found (see more)

❄️ No new flaky tests detected

Useful? React with 👍 / 👎

_{This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 36de506 | Docs | View more details | Give us feedback!}