Anthropic partial chunking with tool calls #4392
Unanswered
revopscharlie
asked this question in
Help
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi there, I have been successfully using OpenAI as the model provider, and incorporated a basic RAG implementation using the examples provided on the AI SDK docs.
I wanted to test out Anthropic and installed and switched in my api/chat route - but for some reason when (and only when) the getInformation tool is called does the response come back in partial chunks as in the example below.
I switched back to OpenAI as the model and all is fine.
Anyone seen this before?
Let me check our knowledge base for any existing information about this Gong project.
I
I see
I see we
I see we have
I see we have some
I see we have some information
I see we have some information about
I see we have some information about a
I see we have some information about a CRM
I see we have some information about a CRM project,
I see we have some information about a CRM project, but
Beta Was this translation helpful? Give feedback.
All reactions