-
Notifications
You must be signed in to change notification settings - Fork 2.9k
Description
Newest model of Anthropic claude-sonnet-4.5 fails to generate an inference with error
Retrying Claude API: 0 400 {"type":"error","error":{"type":"invalid_request_error","message":"`top_p` cannot be set to -1 for this model."},"request_id":"XXX"} {"status":400,"headers":{},"requestID":"XXXXX","error":{"type":"error","error":{"type":"invalid_request_error","message":"`top_p` cannot be set to -1 for this model."},"request_id":"XXXXX"},"attemptNumber":1,"retriesLeft":0,"stack":"Error: 400 {\"type\":\"error\",\"error\":{\"type\":\"invalid_request_error\",\"message\":\"`top_p` cannot be set to -1 for this model.\"},
Even if we don't set topp
const model = new ChatAnthropic({
maxRetries: 0,
temperature: 1,
model: model,
apiKey,
maxTokens,
});
Error Message and Stack Trace (if applicable)
Retrying Claude API: 0 400 {"type":"error","error":{"type":"invalid_request_error","message":"top_p cannot be set to -1 for this model."},"request_id":"XXX"} {"status":400,"headers":{},"requestID":"XXXXX","error":{"type":"error","error":{"type":"invalid_request_error","message":"top_p cannot be set to -1 for this model."},"request_id":"XXXXX"},"attemptNumber":1,"retriesLeft":0,"stack":"Error: 400 {"type":"error","error":{"type":"invalid_request_error","message":"top_p cannot be set to -1 for this model."},
Description
Newest model of Anthropic claude-sonnet-4.5 fails to generate an inference due langchain setting topP even if its not defined.
System Info
node version v18.20.2
"@langchain/anthropic": "^0.3.28",
"@langchain/core": "^0.3.43",