-
Notifications
You must be signed in to change notification settings - Fork 481
Events for handoffs #2093
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Events for handoffs #2093
Conversation
This comment has been minimized.
This comment has been minimized.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should ***** StringLLM OnCondition handoff (coordinator_agent): traffic_specialist *****
be a more suitable indicator for this particular handoff event message ,
" LLM-based OnCondition handoff (coordinator_agent): traffic_specialist "
I have 1 Question:
Since, these are triggered events , should these event also be update the chat.completion response json.
this will also allow to have a robust key : value trace , along with a message trace.
Thanks @priyansh4320 - I'm afraid we don't know if it has been derived from a
Thanks, can you expand on this a bit further with an example of what it may look like. My initial thoughts are that the events system is separate to the ChatCompletions (e.g. there are a lot of events that aren't part of ChatCompletions). |
@marklysze , can we use chat.history meta to add events, here is an example, |
|
im dealing with this as we speak. i would love some sort of event that could use that can tell me if my handoff is working properly |
@priyansh4320 thanks for noting these, the events system does include some of these events, if you'd like to check out agent events and see if there's anything missing we can add them in another PR. |
Codecov Report❌ Patch coverage is
... and 41 files with indirect coverage changes 🚀 New features to boost your workflow:
|
Why are these changes needed?
Events are not emitted for handoffs and these are useful to know so you can monitor your orchestrations and diagnose flows.
Handoff events so far for AfterWorks, OnContextCondition, LLM-based OnCondition, and ReplyResult transition.
Events are simple one-liners, e.g.:
***** AfterWork handoff (agent_b): agent_c ********** OnContextCondition handoff (coordinator_agent): weather_specialist ********** LLM-based OnCondition handoff (coordinator_agent): traffic_specialist *****Related issue number
N/A
Checks