Is InstructExecutor supported in ChatSessions? #1325
Unanswered
justinpierson
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I created an application to test local chat models, InteractiveExecutor works perfectly with a session and using the Session.ChatAsync I was trying to implement the same pattern using InstructExecutor and when I call ChatAsync on the session it throws the exception: Unable to cast object of type 'InstructExecutorState' to type 'InteractiveExecutorState'. From the examples it shows the Instruct working without a session and using InferAsync on the executor, is there a way to make Instuct work with sessions? If I have to abandon sessions to work with Instruct will I need to maintain a separate history and keep sending the whole chat plus anything new in order to maintain some kind of chat "memory"?
Beta Was this translation helpful? Give feedback.
All reactions