Cannot access claude models

[iryek219]

How can I set up ccproxy to access Claude models?
Do I need to add API key in config.yaml?

How are you today?
⎿ API Error (429 {"error":{"message":"No deployments available for selected model, Try again in 5 seconds. Passed model=claude-sonnet-4-20250514. pre-call-checks=False, cooldown_list=['62e7d76a21c5ace6e704c24e5c23b9ffb9562d900ba684ed9b2c2ab01d823ee6', '56a2e42f2d8c6d0e7ce733a4b10b1c8354c0fbacbc1bbf89543edd4e76f6b53a']","type":"None","param":"None","code":"429"}}) · Retrying in 1 seconds… (attempt 1/10)
⎿ API Error (429 {"error":{"message":"No deployments available for selected model, Try again in 5 seconds. Passed model=claude-sonnet-4-20250514. pre-call-checks=False, cooldown_list=['62e7d76a21c5ace6e704c24e5c23b9ffb9562d900ba684ed9b2c2ab01d823ee6', '56a2e42f2d8c6d0e7ce733a4b10b1c8354c0fbacbc1bbf89543edd4e76f6b53a']","type":"None","param":"None","code":"429"}}) · Retrying in 1 seconds… (attempt 2/10)

[starbaser]

API keys are not needed for api.anthropic.com if you are signed in with the subscription option. No deployments available for selected model means that the specified model does not have a deployment in config.yaml, please show the redacted contents of the yaml configs and log file in ~/.ccproxy and I'll diagnose the issue.

[iryek219]

Thanks for your quick response.
I'm not subscribed to Anthropic. Instead, I'm using API key on my Claude Code setup.
It appears that even though I've already set up the claude code with an API key, it is not working through ccproxy.

[starbaser]

You shouldn't need to include it in litellm's config as ccproxy is configured to pass through all client headers.
The error indicates to me that there is no deployment named claude-sonnet-4-20250514 for litellm to route to. Is your deployment named sonnet perhaps?

# config.yaml
- model_name: claude-sonnet-4-20250514 # claude code sends this for `/model sonnet`
  litellm_params:
      model: claude-sonnet-4-20250514 # provider model id

[iryek219]

Here's my config.yaml. Claude Code works fine with an API Key without using ccproxy.

model_list:
  - model_name: default
    litellm_params:
      model: claude-sonnet-4-20250514

  - model_name: background
    litellm_params:
      model: claude-3-5-haiku-20241022

  - model_name: think
    litellm_params:
      model: claude-opus-4-1-20250805

  - model_name: claude-sonnet-4-20250514
    litellm_params:
      model: anthropic/claude-sonnet-4-20250514
      api_base: https://api.anthropic.com

  - model_name: gemini-2.5-pro
    litellm_params:
      model: gemini/gemini-2.5-pro
      api_base: https://generativelanguage.googleapis.com
      api_key: os.environ/GEMINI_API_KEY


litellm_settings:
  callbacks:
    - ccproxy.handler

general_settings:
  forward_client_headers_to_llm_api: true

The error chages from "No deployment..." to "authentication error" at 5th retry like below:

"Hello?"
⎿ API Error (429 {"error":{"message":"No deployments available for selected model, Try again in 5 seconds. Passed model=claude-sonnet-4-20250514. pre-call-checks=False, cooldown_list=['62e7d76a21c5ace6e704c24e5c23b9ffb9562d900ba684ed9b2c2ab01d823ee6', '56a2e42f2d8c6d0e7ce733a4b10b1c8354c0fbacbc1bbf89543edd4e76f6b53a']","type":"None","param":"None","code":"429"}}) · Retrying in 1 seconds… (attempt 1/10)
⎿ API Error (429 {"error":{"message":"No deployments available for selected model, Try again in 5 seconds. Passed model=claude-sonnet-4-20250514. pre-call-checks=False, cooldown_list=['62e7d76a21c5ace6e704c24e5c23b9ffb9562d900ba684ed9b2c2ab01d823ee6', '56a2e42f2d8c6d0e7ce733a4b10b1c8354c0fbacbc1bbf89543edd4e76f6b53a']","type":"None","param":"None","code":"429"}}) · Retrying in 1 seconds… (attempt 2/10)
⎿ API Error (429 {"error":{"message":"No deployments available for selected model, Try again in 5 seconds. Passed model=claude-sonnet-4-20250514. pre-call-checks=False, cooldown_list=['62e7d76a21c5ace6e704c24e5c23b9ffb9562d900ba684ed9b2c2ab01d823ee6']","type":"None","param":"None","code":"429"}}) · Retrying in 2 seconds… (attempt 3/10)
⎿ API Error (429 {"error":{"message":"No deployments available for selected model, Try again in 5 seconds. Passed model=claude-sonnet-4-20250514. pre-call-checks=False, cooldown_list=['62e7d76a21c5ace6e704c24e5c23b9ffb9562d900ba684ed9b2c2ab01d823ee6', '56a2e42f2d8c6d0e7ce733a4b10b1c8354c0fbacbc1bbf89543edd4e76f6b53a']","type":"None","param":"None","code":"429"}}) · Retrying in 4 seconds… (attempt 4/10)
⎿ API Error (401 {"error":{"message":"{"type":"error","error":{"type":"authentication_error","message":"x-api-key header is required"},"request_id":"req_011CTHPUvmPih7GmnvWx3sX5"}. Received Model Group=claude-sonnet-4-20250514\nAvailable Model Group Fallbacks=None","type":"None","param":"None","code":"401"}}) · Retrying in 9 seconds… (attempt 5/10)
⎿ API Error (401 {"error":{"message":"{"type":"error","error":{"type":"authentication_error","message":"x-api-key header is required"},"request_id":"req_011CTHPVeBX71BzwzVTqR81C"}. Received Model Group=claude-sonnet-4-20250514\nAvailable Model Group Fallbacks=None","type":"None","param":"None","code":"401"}}) · Retrying in 19 seconds… (attempt 6/10)

$ ccproxy log

INFO: Uvicorn running on http://0.0.0.0:3356 (Press CTRL+C to quit)
INFO: Started parent process [1408734]
INFO: Started server process [1408739]
INFO: Waiting for application startup.

██╗ ██╗████████╗███████╗██╗ ██╗ ███╗ ███╗
██║ ██║╚══██╔══╝██╔════╝██║ ██║ ████╗ ████║
██║ ██║ ██║ █████╗ ██║ ██║ ██╔████╔██║
██║ ██║ ██║ ██╔══╝ ██║ ██║ ██║╚██╔╝██║
███████╗██║ ██║ ███████╗███████╗███████╗██║ ╚═╝ ██║
╚══════╝╚═╝ ╚═╝ ╚══════╝╚══════╝╚══════╝╚═╝ ╚═╝

[starbaser]

Thank you for waiting, I will work on reproducing this and try to get back to you today

[starbaser]

Sorry for the extremely long delay, I actually reproduced this and the resolution is to use the API key in your litellm config.yaml. I think a better solution would be checking the api key prefix for api or oat and handle appropriately. Just in case, I'll wait for a bit in case you had anything else you want to add from when the issue was opened until now