Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Add optional flag to run all unit tests and fix tests #6672

Open
wants to merge 30 commits into
base: main
Choose a base branch
from

Conversation

ogabrielluiz
Copy link
Contributor

Introduce an 'all' flag in the Makefile to allow execution of all unit tests, removing the filter for 'not api_key_required' when set to true.

Modify the Makefile to support running all unit tests by introducing an 'all' flag. When set to true, the test filtering for 'not api_key_required' is removed, allowing all tests to be executed.
@dosubot dosubot bot added the size:XS This PR changes 0-9 lines, ignoring generated files. label Feb 17, 2025
Modify the Python test workflow to use the 'all=true' flag, enabling execution of all unit tests without filtering
Copy link
Member

@Cristhianzl Cristhianzl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Feb 17, 2025
Modify error handling in LCAgentComponent to only delete agent message if it has an ID attribute, preventing potential attribute errors
Modify the `map_outputs` method to automatically add a tool output if not already present, ensuring consistent output handling for components
Modify the test_component_tool_with_api_key test to:
- Use async_start() method for graph execution
- Add session ID to graph
- Improve result verification with vertex result tracking
- Update import path for ChatOutput component
Update test_cycles.py to:
- Add skip markers for tests that now require a LoopComponent
- Improve error message with snapshots for debugging
- Preserve existing test logic while marking as skipped
@dosubot dosubot bot added size:M This PR changes 30-99 lines, ignoring generated files. and removed size:XS This PR changes 0-9 lines, ignoring generated files. labels Feb 17, 2025
@ogabrielluiz ogabrielluiz changed the title chore: Add optional flag to run all unit tests chore: Add optional flag to run all unit tests and fix tests Feb 17, 2025
@dosubot dosubot bot added size:XXL This PR changes 1000+ lines, ignoring generated files. and removed size:M This PR changes 30-99 lines, ignoring generated files. labels Feb 17, 2025
Remove commented-out test methods for checking required inputs across various components, as these tests were not providing significant value and the inputs are dynamic
Copy link

codspeed-hq bot commented Feb 18, 2025

CodSpeed Performance Report

Merging #6672 will degrade performances by 41.22%

Comparing add-all-makefile (2edf89d) with main (7b3dc0b)

Summary

⚡ 1 improvements
❌ 1 regressions
✅ 17 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Benchmarks breakdown

Benchmark BASE HEAD Change
test_build_flow_invalid_job_id 8.2 ms 13.9 ms -41.22%
test_cancel_nonexistent_build 13 ms 8.8 ms +47.62%

Modify test_component_to_tool.py to use .to_toolkit method when converting a calculator component to a toolkit for an agent
@ogabrielluiz ogabrielluiz changed the title chore: Add optional flag to run all unit tests and fix tests fix: Add optional flag to run all unit tests and fix tests Feb 18, 2025
@github-actions github-actions bot added ignore-for-release bug Something isn't working and removed ignore-for-release labels Feb 18, 2025
@github-actions github-actions bot added bug Something isn't working and removed bug Something isn't working labels Feb 18, 2025
@dosubot dosubot bot added size:XL This PR changes 500-999 lines, ignoring generated files. and removed size:XXL This PR changes 1000+ lines, ignoring generated files. labels Feb 26, 2025
@github-actions github-actions bot added bug Something isn't working and removed bug Something isn't working labels Feb 26, 2025
@dosubot dosubot bot added size:XXL This PR changes 1000+ lines, ignoring generated files. and removed size:XL This PR changes 500-999 lines, ignoring generated files. labels Feb 26, 2025
@github-actions github-actions bot added bug Something isn't working and removed bug Something isn't working labels Feb 26, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working lgtm This PR has been approved by a maintainer size:XXL This PR changes 1000+ lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants