Skip to content
Flake8 Lint

[promptflow][release] 1.16.0 release branch merge back (#3791) #18542

Sign in to view logs

[promptflow][release] 1.16.0 release branch merge back (#3791)

[promptflow][release] 1.16.0 release branch merge back (#3791) #18542

Triggered via push October 2, 2024 00:51
@ninghuninghu
pushed 11ac34b
main
Status Success
Total duration 26s
Artifacts –

flake8.yml

on: push
flake8
18s
flake8
Fit to window
Zoom out
Zoom in

Annotations

245 warnings and 60 notices
flake8
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
flake8
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
All 4 runs failed: test_basic_flow_run_batch_and_eval (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 18s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 19s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 21s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 20s]
All 4 runs failed: test_submit_run_with_yaml (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 8s]
All 4 runs failed: test_pf_flow_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_pf_flow_with_variant (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_pf_flow_test_with_additional_includes (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_submit_run_from_yaml (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 8s]
All 4 runs failed: test_pf_flow_test_with_symbolic (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_flow_with_exception (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 16s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 13s]
2 out of 4 runs failed: test_chat_with_stream_output (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_flow_test_inputs_unknown[unknown_flow_inputs] (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 11s]
All 4 runs failed: test_experiment_start (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 20s]
All 4 runs failed: test_experiment_start_anonymous_experiment (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 9s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 10s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 11s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 9s]
All 4 runs failed: test_experiment_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_experiment_direct_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_pf_flow_test_with_detail (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_flow_run_resume_from (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 40s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 41s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 43s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 42s]
All 4 runs failed: test_get_details (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 11s]
All 4 runs failed: test_flow_run_resume_from_token (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 59s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 39s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 1m 0s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 1m 7s]
All 4 runs failed: test_run_local_storage_structure (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 11s]
All 4 runs failed: test_get_metrics_format (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 12s]
All 4 runs failed: test_pf_flow_test_with_collection (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_pf_test_flow (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 9s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_pf_test_flow_with_variant (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_pf_flow_test_with_symbolic (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_pf_flow_test_with_exception (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_evaluation_flow_serving_api (tests.sdk_cli_test.e2etests.test_flow_serve): tests.sdk_cli_test.e2etests.test_flow_serve#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 2s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_evaluation_flow_serving_api (tests.sdk_cli_test.e2etests.test_flow_serve_fastapi): tests.sdk_cli_test.e2etests.test_flow_serve_fastapi#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_flow_test_trace_enabled (tests.sdk_cli_test.e2etests.test_trace.TestTraceWithDevKit): tests.sdk_cli_test.e2etests.test_trace.TestTraceWithDevKit#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_flow_test_dag_flow (tests.sdk_cli_test.e2etests.test_trace.TestTraceLifeCycle): tests.sdk_cli_test.e2etests.test_trace.TestTraceLifeCycle#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 27s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 32s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 26s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 27s]
All 4 runs failed: test_flow_with_default_variant (tests.sdk_cli_test.e2etests.test_flow_as_func.TestFlowAsFunc): tests.sdk_cli_test.e2etests.test_flow_as_func.TestFlowAsFunc#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 10s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_experiment_start (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 30s]
All 4 runs failed: test_experiment_with_script_start (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 30s]
All 4 runs failed: test_experiment_start_from_nodes (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 50s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 50s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 50s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 50s]
All 4 runs failed: test_flow_test_with_experiment (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_experiment_test (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_experiment_test_with_script_node (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_experiment_with_script_run (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 14s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 14s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 13s]
test_otel_trace_with_llm[openai_chat_api_flow-inputs0-False-3] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
test_otel_trace_with_llm[openai_completion_api_flow-inputs2-False-3] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
test_otel_trace_with_llm[llm_tool-inputs4-False-4] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
test_otel_trace_with_llm[flow_with_async_llm_tasks-inputs5-False-6] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_basic_flow_run_batch_and_eval (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 21s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 19s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 20s]
All 4 runs failed: test_submit_run_with_yaml (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 8s]
All 4 runs failed: test_pf_flow_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_pf_flow_with_variant (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_pf_flow_test_with_additional_includes (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_submit_run_from_yaml (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 7s]
All 4 runs failed: test_pf_flow_test_with_symbolic (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_flow_with_exception (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 15s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 17s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 16s]
All 4 runs failed: test_flow_test_inputs_unknown[unknown_flow_inputs] (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_experiment_start (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 20s]
All 4 runs failed: test_experiment_start_anonymous_experiment (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 10s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 10s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 11s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 10s]
All 4 runs failed: test_experiment_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_experiment_direct_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 7s]
All 4 runs failed: test_pf_flow_test_with_detail (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 7s]
All 4 runs failed: test_flow_run_resume_from (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 46s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 42s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 44s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 45s]
All 4 runs failed: test_get_details (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 14s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 13s]
All 4 runs failed: test_flow_run_resume_from_token (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 1m 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 55s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 1m 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 52s]
All 4 runs failed: test_run_local_storage_structure (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 11s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 14s]
All 4 runs failed: test_get_metrics_format (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 13s]
All 4 runs failed: test_pf_flow_test_with_collection (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_pf_test_flow (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_pf_test_flow_with_variant (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_pf_flow_test_with_symbolic (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 7s]
All 4 runs failed: test_pf_flow_test_with_exception (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_evaluation_flow_serving_api (tests.sdk_cli_test.e2etests.test_flow_serve): tests.sdk_cli_test.e2etests.test_flow_serve#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_evaluation_flow_serving_api (tests.sdk_cli_test.e2etests.test_flow_serve_fastapi): tests.sdk_cli_test.e2etests.test_flow_serve_fastapi#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_flow_test_trace_enabled (tests.sdk_cli_test.e2etests.test_trace.TestTraceWithDevKit): tests.sdk_cli_test.e2etests.test_trace.TestTraceWithDevKit#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 9s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_flow_test_dag_flow (tests.sdk_cli_test.e2etests.test_trace.TestTraceLifeCycle): tests.sdk_cli_test.e2etests.test_trace.TestTraceLifeCycle#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 32s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 25s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 23s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 29s]
All 4 runs failed: test_flow_with_default_variant (tests.sdk_cli_test.e2etests.test_flow_as_func.TestFlowAsFunc): tests.sdk_cli_test.e2etests.test_flow_as_func.TestFlowAsFunc#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 7s]
All 4 runs failed: test_experiment_start (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 30s]
All 4 runs failed: test_experiment_with_script_start (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 30s]
All 4 runs failed: test_experiment_start_from_nodes (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 50s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 50s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 50s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 50s]
All 4 runs failed: test_flow_test_with_experiment (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_experiment_test (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_experiment_test_with_script_node (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_experiment_with_script_run (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 14s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 15s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 14s]
test_otel_trace_with_llm[openai_chat_api_flow-inputs0-False-3] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
test_otel_trace_with_llm[openai_completion_api_flow-inputs2-False-3] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
test_otel_trace_with_llm[llm_tool-inputs4-False-4] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
test_otel_trace_with_llm[flow_with_async_llm_tasks-inputs5-False-6] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_basic_flow_run_batch_and_eval (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 31s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 18s]
All 4 runs failed: test_submit_run_with_yaml (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 8s]
All 4 runs failed: test_pf_flow_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_pf_flow_with_variant (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_pf_flow_test_with_additional_includes (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_submit_run_from_yaml (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 9s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 7s]
All 4 runs failed: test_pf_flow_test_with_symbolic (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_flow_with_exception (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 14s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 12s]
All 4 runs failed: test_flow_test_inputs_unknown[unknown_flow_inputs] (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_experiment_start (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 20s]
All 4 runs failed: test_experiment_start_anonymous_experiment (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 9s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 10s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 11s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 9s]
All 4 runs failed: test_experiment_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_experiment_direct_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_pf_flow_test_with_detail (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_flow_run_resume_from (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 39s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 40s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 42s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 42s]
All 4 runs failed: test_get_details (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 12s]
All 4 runs failed: test_flow_run_resume_from_token (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 53s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 47s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 54s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 52s]
All 4 runs failed: test_run_local_storage_structure (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 11s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 14s]
All 4 runs failed: test_get_metrics_format (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 12s]
All 4 runs failed: test_pf_flow_test_with_collection (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_pf_test_flow (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_pf_test_flow_with_variant (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_pf_flow_test_with_symbolic (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_pf_flow_test_with_exception (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_evaluation_flow_serving_api (tests.sdk_cli_test.e2etests.test_flow_serve): tests.sdk_cli_test.e2etests.test_flow_serve#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_evaluation_flow_serving_api (tests.sdk_cli_test.e2etests.test_flow_serve_fastapi): tests.sdk_cli_test.e2etests.test_flow_serve_fastapi#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_flow_test_trace_enabled (tests.sdk_cli_test.e2etests.test_trace.TestTraceWithDevKit): tests.sdk_cli_test.e2etests.test_trace.TestTraceWithDevKit#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_flow_test_dag_flow (tests.sdk_cli_test.e2etests.test_trace.TestTraceLifeCycle): tests.sdk_cli_test.e2etests.test_trace.TestTraceLifeCycle#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 25s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 25s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 32s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 26s]
All 4 runs failed: test_flow_with_default_variant (tests.sdk_cli_test.e2etests.test_flow_as_func.TestFlowAsFunc): tests.sdk_cli_test.e2etests.test_flow_as_func.TestFlowAsFunc#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_experiment_start (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 30s]
All 4 runs failed: test_experiment_with_script_start (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 30s]
All 4 runs failed: test_experiment_start_from_nodes (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 50s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 50s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 50s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 50s]
All 4 runs failed: test_flow_test_with_experiment (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_experiment_test (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_experiment_test_with_script_node (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_experiment_with_script_run (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 14s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 13s]
test_otel_trace_with_llm[openai_chat_api_flow-inputs0-False-3] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
test_otel_trace_with_llm[openai_completion_api_flow-inputs2-False-3] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
test_otel_trace_with_llm[llm_tool-inputs4-False-4] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
test_otel_trace_with_llm[flow_with_async_llm_tasks-inputs5-False-6] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_basic_flow_run_batch_and_eval (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 19s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 18s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 19s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 20s]
All 4 runs failed: test_submit_run_with_yaml (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 8s]
All 4 runs failed: test_pf_flow_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_pf_flow_with_variant (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_submit_run_from_yaml (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 7s]
All 4 runs failed: test_pf_flow_test_with_additional_includes (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_pf_flow_test_with_symbolic (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_flow_with_exception (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 15s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 11s]
All 4 runs failed: test_flow_test_inputs_unknown[unknown_flow_inputs] (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 10s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_experiment_start (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 20s]
All 4 runs failed: test_experiment_start_anonymous_experiment (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 10s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 9s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 10s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 9s]
All 4 runs failed: test_experiment_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_experiment_direct_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_pf_flow_test_with_detail (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_flow_run_resume_from (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 38s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 41s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 37s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 42s]
All 4 runs failed: test_get_details (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 11s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 11s]
All 4 runs failed: test_flow_run_resume_from_token (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 47s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 40s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 44s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 41s]
All 4 runs failed: test_run_local_storage_structure (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 11s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 11s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 11s]
All 4 runs failed: test_get_metrics_format (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 11s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 11s]
All 4 runs failed: test_pf_flow_test_with_collection (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_pf_test_flow (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_pf_test_flow_with_variant (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_pf_flow_test_with_symbolic (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_pf_flow_test_with_exception (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_evaluation_flow_serving_api (tests.sdk_cli_test.e2etests.test_flow_serve): tests.sdk_cli_test.e2etests.test_flow_serve#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_evaluation_flow_serving_api (tests.sdk_cli_test.e2etests.test_flow_serve_fastapi): tests.sdk_cli_test.e2etests.test_flow_serve_fastapi#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 2s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_flow_test_trace_enabled (tests.sdk_cli_test.e2etests.test_trace.TestTraceWithDevKit): tests.sdk_cli_test.e2etests.test_trace.TestTraceWithDevKit#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_flow_test_dag_flow (tests.sdk_cli_test.e2etests.test_trace.TestTraceLifeCycle): tests.sdk_cli_test.e2etests.test_trace.TestTraceLifeCycle#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 24s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 31s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 26s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 25s]
All 4 runs failed: test_flow_with_default_variant (tests.sdk_cli_test.e2etests.test_flow_as_func.TestFlowAsFunc): tests.sdk_cli_test.e2etests.test_flow_as_func.TestFlowAsFunc#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_experiment_start (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 30s]
All 4 runs failed: test_experiment_with_script_start (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 30s]
All 4 runs failed: test_experiment_start_from_nodes (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 1m 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 50s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 50s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 50s]
All 4 runs failed: test_flow_test_with_experiment (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_experiment_test (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_experiment_test_with_script_node (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_experiment_with_script_run (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 12s]
test_otel_trace_with_llm[openai_chat_api_flow-inputs0-False-3] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
test_otel_trace_with_llm[openai_completion_api_flow-inputs2-False-3] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
test_otel_trace_with_llm[llm_tool-inputs4-False-4] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
test_otel_trace_with_llm[flow_with_async_llm_tasks-inputs5-False-6] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_basic_flow_run_batch_and_eval (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 19s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 23s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 19s]
All 4 runs failed: test_submit_run_with_yaml (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 7s]
All 4 runs failed: test_pf_flow_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_pf_flow_with_variant (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_submit_run_from_yaml (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 7s]
All 4 runs failed: test_pf_flow_test_with_additional_includes (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_pf_flow_test_with_symbolic (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_flow_with_exception (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 11s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 14s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 14s]
1 out of 4 runs failed: test_chat_with_stream_output (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_flow_test_inputs_unknown[unknown_flow_inputs] (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_experiment_start (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 20s]
All 4 runs failed: test_experiment_start_anonymous_experiment (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 9s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 9s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 9s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 10s]
All 4 runs failed: test_experiment_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_experiment_direct_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_pf_flow_test_with_detail (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_flow_run_resume_from (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 40s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 42s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 39s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 41s]
All 4 runs failed: test_get_details (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 11s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 11s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 12s]
All 4 runs failed: test_flow_run_resume_from_token (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 45s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 45s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 51s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 49s]
All 4 runs failed: test_run_local_storage_structure (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 11s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 11s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 11s]
All 4 runs failed: test_get_metrics_format (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 11s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 12s]
All 4 runs failed: test_pf_flow_test_with_collection (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_pf_test_flow (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_pf_test_flow_with_variant (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_pf_flow_test_with_symbolic (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_pf_flow_test_with_exception (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_evaluation_flow_serving_api (tests.sdk_cli_test.e2etests.test_flow_serve): tests.sdk_cli_test.e2etests.test_flow_serve#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 2s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_evaluation_flow_serving_api (tests.sdk_cli_test.e2etests.test_flow_serve_fastapi): tests.sdk_cli_test.e2etests.test_flow_serve_fastapi#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_flow_test_trace_enabled (tests.sdk_cli_test.e2etests.test_trace.TestTraceWithDevKit): tests.sdk_cli_test.e2etests.test_trace.TestTraceWithDevKit#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_flow_test_dag_flow (tests.sdk_cli_test.e2etests.test_trace.TestTraceLifeCycle): tests.sdk_cli_test.e2etests.test_trace.TestTraceLifeCycle#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 24s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 25s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 26s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 24s]
All 4 runs failed: test_flow_with_default_variant (tests.sdk_cli_test.e2etests.test_flow_as_func.TestFlowAsFunc): tests.sdk_cli_test.e2etests.test_flow_as_func.TestFlowAsFunc#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_experiment_start (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 30s]
All 4 runs failed: test_experiment_with_script_start (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 30s]
All 4 runs failed: test_experiment_start_from_nodes (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 50s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 50s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 50s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 50s]
All 4 runs failed: test_flow_test_with_experiment (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_experiment_test (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_experiment_test_with_script_node (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_experiment_with_script_run (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 12s]
test_otel_trace_with_llm[openai_chat_api_flow-inputs0-False-3] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
test_otel_trace_with_llm[openai_completion_api_flow-inputs2-False-3] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
test_otel_trace_with_llm[llm_tool-inputs4-False-4] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 8s]
test_otel_trace_with_llm[flow_with_async_llm_tasks-inputs5-False-6] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_basic_flow_run_batch_and_eval (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 21s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 22s]
All 4 runs failed: test_submit_run_with_yaml (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 7s]
All 4 runs failed: test_pf_flow_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_pf_flow_with_variant (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_pf_flow_test_with_additional_includes (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_pf_flow_test_with_symbolic (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 7s]
All 4 runs failed: test_submit_run_from_yaml (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 8s]
All 4 runs failed: test_flow_with_exception (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 15s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 14s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 14s]
2 out of 4 runs failed: test_chat_with_stream_output (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_flow_test_inputs_unknown[unknown_flow_inputs] (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_experiment_start (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 20s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 20s]
All 4 runs failed: test_experiment_start_anonymous_experiment (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 9s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 10s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 10s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 9s]
All 4 runs failed: test_experiment_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_experiment_direct_test (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_pf_flow_test_with_detail (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_flow_run_resume_from (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 43s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 46s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 41s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 43s]
All 4 runs failed: test_flow_run_resume_from_token (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 57s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 48s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 56s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 55s]
All 4 runs failed: test_get_details (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 13s]
All 4 runs failed: test_run_local_storage_structure (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 12s]
All 4 runs failed: test_pf_flow_test_with_collection (tests.sdk_cli_test.e2etests.test_cli.TestCli): tests.sdk_cli_test.e2etests.test_cli.TestCli#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_get_metrics_format (tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun): tests.sdk_cli_test.e2etests.test_flow_run.TestFlowRun#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 11s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 12s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 12s]
All 4 runs failed: test_pf_test_flow (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_pf_test_flow_with_variant (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_pf_flow_test_with_symbolic (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_pf_flow_test_with_exception (tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest): tests.sdk_cli_test.e2etests.test_flow_test.TestFlowTest#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 6s]
All 4 runs failed: test_evaluation_flow_serving_api (tests.sdk_cli_test.e2etests.test_flow_serve): tests.sdk_cli_test.e2etests.test_flow_serve#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_evaluation_flow_serving_api (tests.sdk_cli_test.e2etests.test_flow_serve_fastapi): tests.sdk_cli_test.e2etests.test_flow_serve_fastapi#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 3s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
All 4 runs failed: test_flow_test_trace_enabled (tests.sdk_cli_test.e2etests.test_trace.TestTraceWithDevKit): tests.sdk_cli_test.e2etests.test_trace.TestTraceWithDevKit#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 8s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 5s]
All 4 runs failed: test_flow_test_dag_flow (tests.sdk_cli_test.e2etests.test_trace.TestTraceLifeCycle): tests.sdk_cli_test.e2etests.test_trace.TestTraceLifeCycle#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 27s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 26s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 27s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 26s]
All 4 runs failed: test_flow_with_default_variant (tests.sdk_cli_test.e2etests.test_flow_as_func.TestFlowAsFunc): tests.sdk_cli_test.e2etests.test_flow_as_func.TestFlowAsFunc#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_experiment_start (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 30s]
All 4 runs failed: test_experiment_with_script_start (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 30s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 30s]
All 4 runs failed: test_experiment_start_from_nodes (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 50s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 50s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 50s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 50s]
All 4 runs failed: test_flow_test_with_experiment (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_experiment_test (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 4s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_experiment_test_with_script_node (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 7s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 5s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 6s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
All 4 runs failed: test_experiment_with_script_run (tests.sdk_cli_test.e2etests.test_experiment.TestExperiment): tests.sdk_cli_test.e2etests.test_experiment.TestExperiment#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 13s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results.xml [took 14s] artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 14s]
test_otel_trace_with_llm[openai_chat_api_flow-inputs0-False-3] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 4s]
test_otel_trace_with_llm[openai_completion_api_flow-inputs2-False-3] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
test_otel_trace_with_llm[llm_tool-inputs4-False-4] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
test_otel_trace_with_llm[flow_with_async_llm_tasks-inputs5-False-6] (tests.executor.e2etests.test_traces.TestOTelTracer) failed: tests.executor.e2etests.test_traces.TestOTelTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 3s]
125 tests found
There are 125 tests, see "Raw output" for the full list of tests.
62 tests found
There are 62 tests, see "Raw output" for the full list of tests.
6 tests found
There are 6 tests, see "Raw output" for the full list of tests.
11 skipped tests found
There are 11 skipped tests, see "Raw output" for the full list of skipped tests.
790 tests found (test 1 to 637)
There are 790 tests, see "Raw output" for the list of tests 1 to 637.
790 tests found (test 638 to 790)
There are 790 tests, see "Raw output" for the list of tests 638 to 790.
798 tests found (test 1 to 502)
There are 798 tests, see "Raw output" for the list of tests 1 to 502.
798 tests found (test 503 to 798)
There are 798 tests, see "Raw output" for the list of tests 503 to 798.
6 skipped tests found
There are 6 skipped tests, see "Raw output" for the full list of skipped tests.
246 tests found
There are 246 tests, see "Raw output" for the full list of tests.
125 tests found
There are 125 tests, see "Raw output" for the full list of tests.
62 tests found
There are 62 tests, see "Raw output" for the full list of tests.
6 tests found
There are 6 tests, see "Raw output" for the full list of tests.
11 skipped tests found
There are 11 skipped tests, see "Raw output" for the full list of skipped tests.
790 tests found (test 1 to 637)
There are 790 tests, see "Raw output" for the list of tests 1 to 637.
790 tests found (test 638 to 790)
There are 790 tests, see "Raw output" for the list of tests 638 to 790.
798 tests found (test 1 to 502)
There are 798 tests, see "Raw output" for the list of tests 1 to 502.
798 tests found (test 503 to 798)
There are 798 tests, see "Raw output" for the list of tests 503 to 798.
6 skipped tests found
There are 6 skipped tests, see "Raw output" for the full list of skipped tests.
246 tests found
There are 246 tests, see "Raw output" for the full list of tests.
125 tests found
There are 125 tests, see "Raw output" for the full list of tests.
62 tests found
There are 62 tests, see "Raw output" for the full list of tests.
6 tests found
There are 6 tests, see "Raw output" for the full list of tests.
11 skipped tests found
There are 11 skipped tests, see "Raw output" for the full list of skipped tests.
790 tests found (test 1 to 637)
There are 790 tests, see "Raw output" for the list of tests 1 to 637.
790 tests found (test 638 to 790)
There are 790 tests, see "Raw output" for the list of tests 638 to 790.
798 tests found (test 1 to 502)
There are 798 tests, see "Raw output" for the list of tests 1 to 502.
798 tests found (test 503 to 798)
There are 798 tests, see "Raw output" for the list of tests 503 to 798.
6 skipped tests found
There are 6 skipped tests, see "Raw output" for the full list of skipped tests.
246 tests found
There are 246 tests, see "Raw output" for the full list of tests.
125 tests found
There are 125 tests, see "Raw output" for the full list of tests.
62 tests found
There are 62 tests, see "Raw output" for the full list of tests.
6 tests found
There are 6 tests, see "Raw output" for the full list of tests.
11 skipped tests found
There are 11 skipped tests, see "Raw output" for the full list of skipped tests.
790 tests found (test 1 to 637)
There are 790 tests, see "Raw output" for the list of tests 1 to 637.
790 tests found (test 638 to 790)
There are 790 tests, see "Raw output" for the list of tests 638 to 790.
798 tests found (test 1 to 502)
There are 798 tests, see "Raw output" for the list of tests 1 to 502.
798 tests found (test 503 to 798)
There are 798 tests, see "Raw output" for the list of tests 503 to 798.
6 skipped tests found
There are 6 skipped tests, see "Raw output" for the full list of skipped tests.
246 tests found
There are 246 tests, see "Raw output" for the full list of tests.
125 tests found
There are 125 tests, see "Raw output" for the full list of tests.
62 tests found
There are 62 tests, see "Raw output" for the full list of tests.
6 tests found
There are 6 tests, see "Raw output" for the full list of tests.
11 skipped tests found
There are 11 skipped tests, see "Raw output" for the full list of skipped tests.
790 tests found (test 1 to 637)
There are 790 tests, see "Raw output" for the list of tests 1 to 637.
790 tests found (test 638 to 790)
There are 790 tests, see "Raw output" for the list of tests 638 to 790.
798 tests found (test 1 to 502)
There are 798 tests, see "Raw output" for the list of tests 1 to 502.
798 tests found (test 503 to 798)
There are 798 tests, see "Raw output" for the list of tests 503 to 798.
6 skipped tests found
There are 6 skipped tests, see "Raw output" for the full list of skipped tests.
246 tests found
There are 246 tests, see "Raw output" for the full list of tests.
125 tests found
There are 125 tests, see "Raw output" for the full list of tests.
62 tests found
There are 62 tests, see "Raw output" for the full list of tests.
6 tests found
There are 6 tests, see "Raw output" for the full list of tests.
11 skipped tests found
There are 11 skipped tests, see "Raw output" for the full list of skipped tests.
790 tests found (test 1 to 637)
There are 790 tests, see "Raw output" for the list of tests 1 to 637.
790 tests found (test 638 to 790)
There are 790 tests, see "Raw output" for the list of tests 638 to 790.
798 tests found (test 1 to 502)
There are 798 tests, see "Raw output" for the list of tests 1 to 502.
798 tests found (test 503 to 798)
There are 798 tests, see "Raw output" for the list of tests 503 to 798.
6 skipped tests found
There are 6 skipped tests, see "Raw output" for the full list of skipped tests.
246 tests found
There are 246 tests, see "Raw output" for the full list of tests.