Ungraceful failure error when the anthropic api is overloaded

[TechNickAI]

Description

When anthropic api is busy/down, it responds with

{"type":"error","error":{"details":null,"type":"overloaded_error","message":"Overloaded"}}

Which causes an unhandled rejection

unhandledRejection: TypeValidationError [AI_TypeValidationError]: Type validation failed: Value: {"type":"error","error":{"details":null,"type":"overloaded_error","message":"Overloaded"}}.
Error message: [
{
"code": "invalid_union_discriminator",
"options": [
"message_start",
"content_block_start",
"content_block_delta",
"content_block_stop",
"message_delta",
"message_stop",
"ping"
],
"path": [
"type"
],
"message": "Invalid discriminator value. Expected 'message_start' | 'content_block_start' | 'content_block_delta' | 'content_block_stop' | 'message_delta' | 'message_stop' | 'ping'"
}
]
at safeValidateTypes (/Users/nick/src/cora-morphic/.next/server/chunks/ssr/node_modules_d8329a..js:2811:20)
at safeParseJSON (/Users/nick/src/cora-morphic/.next/server/chunks/ssr/node_modules_d8329a..js:2856:16)
... 5 lines matching cause stack trace ...
at process.processTicksAndRejections (node:internal/process/task_queues:95:5) {
cause: ZodError: [
{
"code": "invalid_union_discriminator",
"options": [
"message_start",
"content_block_start",
"content_block_delta",
"content_block_stop",
"message_delta",
"message_stop",
"ping"
],
"path": [
"type"
],
"message": "Invalid discriminator value. Expected 'message_start' | 'content_block_start' | 'content_block_delta' | 'content_block_stop' | 'message_delta' | 'message_stop' | 'ping'"
}
]
at get error (/Users/nick/src/cora-morphic/.next/server/chunks/ssr/node_modules_zod_lib_index_mjs_8e7072..js:665:31)
at safeValidateTypes (/Users/nick/src/cora-morphic/.next/server/chunks/ssr/node_modules_d8329a..js:2813:41)
at safeParseJSON (/Users/nick/src/cora-morphic/.next/server/chunks/ssr/node_modules_d8329a..js:2856:16)
at Object.transform (/Users/nick/src/cora-morphic/.next/server/chunks/ssr/node_modules_d8329a..js:3033:40)
at invokePromiseCallback (node:internal/webstreams/util:180:10)
at Object. (node:internal/webstreams/util:185:23)
at transformStreamDefaultControllerPerformTransform (node:internal/webstreams/transformstream:526:37)
at node:internal/webstreams/transformstream:567:16
at process.processTicksAndRejections (node:internal/process/task_queues:95:5) {
issues: [ [Object] ],
addIssue: [Function (anonymous)],
addIssues: [Function (anonymous)],
errors: [ [Object] ]
},
value: {
type: 'error',
error: { details: null, type: 'overloaded_error', message: 'Overloaded' }
}
}

Code example

No response

Additional context

No response

[arnab710]

Same issue faced.

[lgrammel]

#2457

[lgrammel]

Resolved in @ai-sdk/anthropic@0.0.34

[raulgupta]

{"type":"error","error":{"details":null,"type":"overloaded_error","message":"Overloaded"} }

[lgrammel]

@raulgupta on which version of the anthropic provider did this happen for you?

[mtrazzi]

happening with claude code

[addmorebass]

Fix your servers, Anthropic!!

[cacoos]

This is happening frequently, and setting maxRetries does not trigger a retry.

I'm happy to help contribute a fix. I understand that errors during streaming should generally be raised rather than retried, but perhaps we should maintain a list of exceptions that should be retried?

In particular, I’d like to retry Overloaded.

[soulbeast-tianmeng]

我今天也遇到了这个问题：

[blackge]

Has anyone got a workaround for this one? It basically makes using Anthropic with the AI SDK unusable. I'm getting this error on about 30-40% of requests at the moment.

BTW I agree with @addmorebass that this is really for Anthropic to fix their servers. I guess they are using it to force more people onto the Enterprise plans.