Skip to content

@langchain/anthropic Sends topP for sonnet-4.5 and fails #9067

@nicogon

Description

@nicogon

Newest model of Anthropic claude-sonnet-4.5 fails to generate an inference with error

Retrying Claude API: 0 400 {"type":"error","error":{"type":"invalid_request_error","message":"`top_p` cannot be set to -1 for this model."},"request_id":"XXX"} {"status":400,"headers":{},"requestID":"XXXXX","error":{"type":"error","error":{"type":"invalid_request_error","message":"`top_p` cannot be set to -1 for this model."},"request_id":"XXXXX"},"attemptNumber":1,"retriesLeft":0,"stack":"Error: 400 {\"type\":\"error\",\"error\":{\"type\":\"invalid_request_error\",\"message\":\"`top_p` cannot be set to -1 for this model.\"},

Even if we don't set topp

    const model = new ChatAnthropic({
      maxRetries: 0,
      temperature: 1,
      model: model,
      apiKey,
      maxTokens,
    });

Error Message and Stack Trace (if applicable)

Retrying Claude API: 0 400 {"type":"error","error":{"type":"invalid_request_error","message":"top_p cannot be set to -1 for this model."},"request_id":"XXX"} {"status":400,"headers":{},"requestID":"XXXXX","error":{"type":"error","error":{"type":"invalid_request_error","message":"top_p cannot be set to -1 for this model."},"request_id":"XXXXX"},"attemptNumber":1,"retriesLeft":0,"stack":"Error: 400 {"type":"error","error":{"type":"invalid_request_error","message":"top_p cannot be set to -1 for this model."},

Description

Newest model of Anthropic claude-sonnet-4.5 fails to generate an inference due langchain setting topP even if its not defined.

System Info

node version v18.20.2
"@langchain/anthropic": "^0.3.28",
"@langchain/core": "^0.3.43",

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions