Use filtered output in agent tool response streaming

[nathaliellenaa]

Description

Use filtered output in agent tool response streaming

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

• New functionality includes testing.
• New functionality has been documented.
• API changes companion pull request created.
• Commits are signed per the DCO using --signoff.
• Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[nathaliellenaa]

Can a maintainer help add backport 3.3 label? Thanks

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 80.10%. Comparing base (5964268) to head (b80434f).
⚠️ Report is 3 commits behind head on main.

Additional details and impacted files

@@             Coverage Diff              @@
##               main    #4335      +/-   ##
============================================
+ Coverage     80.09%   80.10%   +0.01%     
+ Complexity    10199    10197       -2     
============================================
  Files           855      855              
  Lines         44374    44406      +32     
  Branches       5135     5137       +2     
============================================
+ Hits          35540    35573      +33     
- Misses         6670     6672       +2     
+ Partials       2164     2161       -3     

Flag	Coverage Δ
ml-commons	80.10% <100.00%> (+0.01%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[nathaliellenaa]

Failing test seems unrelated

REPRODUCE WITH: gradlew ':opensearch-ml-plugin:test' --tests 'org.opensearch.ml.utils.IndexUtilsTests.testGetNumberOfDocumentsInIndex_SearchQuery' -Dtests.seed=35FE6356BDC20A38 -Dtests.security.manager=false -Dtests.locale=ff-Latn-NG -Dtests.timezone=America/Cayman -Druntime.java=21
IndexUtilsTests > testGetNumberOfDocumentsInIndex_SearchQuery FAILED
    ClusterManagerNotDiscoveredException[NodeNotConnectedException[[node_s0][127.0.0.1:53838] Node not connected]]; nested: NodeNotConnectedException[[node_s0][127.0.0.1:53838] Node not connected];
        at app//org.opensearch.action.support.clustermanager.TransportClusterManagerNodeAction$AsyncSingleAction$1.onTimeout(TransportClusterManagerNodeAction.java:326)
        at app//org.opensearch.cluster.ClusterStateObserver$ContextPreservingListener.onTimeout(ClusterStateObserver.java:394)
        at app//org.opensearch.cluster.ClusterStateObserver$ObserverClusterStateListener.onTimeout(ClusterStateObserver.java:294)
        at app//org.opensearch.cluster.service.ClusterApplierService$NotifyTimeout.run(ClusterApplierService.java:772)
        at app//org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:916)
        at java.base@21.0.9/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at java.base@21.0.9/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base@21.0.9/java.lang.Thread.run(Thread.java:1583)

[nathaliellenaa]

Failing tests due to expired security token

RestMLRAGSearchProcessorIT > testBM25WithBedrockConverseUsingLlmMessagesForDocumentChat FAILED
    org.opensearch.client.ResponseException: method [POST], host [http://[::1]:34197], URI [/test/_search?size=5&search_pipeline=pipeline_test], status line [HTTP/1.1 403 Forbidden]
    {"error":{"root_cause":[{"type":"status_exception","reason":"Error from remote service: {\"message\":\"The security token included in the request is expired\"}"}],"type":"status_exception","reason":"Error from remote service: {\"message\":\"The security token included in the request is expired\"}"},"status":403}