Skip to content

Conversation

@dargilco
Copy link
Member

@dargilco dargilco commented Dec 6, 2025

All Agent telemetry tests now have recordings, nothing is skipped:

tests\agents\telemetry\test_ai_agents_instrumentor.py .....................                                                                                                                                                                                                         [  7%]
tests\agents\telemetry\test_ai_agents_instrumentor_async.py ........                                                                                                                                                                                                                [ 10%]
tests\agents\telemetry\test_responses_instrumentor.py ............................................................                                                                                                                                                                  [ 31%]
tests\agents\telemetry\test_responses_instrumentor_async.py ..................................                                                                                                                                                                                      [ 43%]
tests\agents\telemetry\test_responses_instrumentor_metrics.py .....            

@dargilco dargilco self-assigned this Dec 6, 2025
Copilot AI review requested due to automatic review settings December 6, 2025 00:25
@dargilco dargilco enabled auto-merge (squash) December 6, 2025 00:29
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR enables 12 previously-skipped Agent tracing tests by adding test recordings and configuring appropriate transport mechanisms for recording. The tests were skipped because recordings were not working for the responses API, but that issue has now been resolved. The PR updates both synchronous and asynchronous test files to enable function tool and workflow agent tests with and without content recording.

Key changes:

  • Un-skipped 12 tests (6 in each test file) by commenting out @pytest.mark.skip decorators
  • Added dual transport configuration (RecordedTransport.AZURE_CORE, RecordedTransport.HTTPX) to @recorded_by_proxy decorators for tests that use both Azure AI Projects agents API and OpenAI responses API
  • Updated test assets tag to reference newly recorded test data

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated no comments.

File Description
sdk/ai/azure-ai-projects/tests/agents/telemetry/test_responses_instrumentor_async.py Enabled 6 async tests (4 function tool tests + 4 workflow agent tests) by removing skip markers and adding dual transport recording support
sdk/ai/azure-ai-projects/tests/agents/telemetry/test_responses_instrumentor.py Enabled 6 sync tests (4 function tool tests + 4 workflow agent tests) by removing skip markers and adding dual transport recording support
sdk/ai/azure-ai-projects/assets.json Updated test assets tag to point to new recordings for the newly enabled tests

@dargilco dargilco merged commit 46aef6a into main Dec 6, 2025
20 checks passed
@dargilco dargilco deleted the dargilco/add-recordings-to-agent-tracing-tests branch December 6, 2025 01:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants