Integration Issues with BeWildCard as API Proxy for OpenAI and Anthropic in LibreChat

[hayschan]

Hello LibreChat Community,

I am currently working on integrating BeWildCard as an API proxy for both OpenAI and Anthropic APIs within LibreChat. BeWildCard specifically requires changing the base addresses of these APIs to their proxy address. Despite following their instructions, I've encountered errors that I'm unable to resolve. Here's a breakdown of what I've configured and the issues I'm facing.

Configuration

BeWildCard instructions required me to:

• Replace the OpenAI API base address (https://api.openai.com) with https://api.gptsapi.net.
• Replace the Claude API base address (https://api.anthropic.com) with https://api.gptsapi.net.

Based on these requirements, here’s how I have set up my .env file:

# OpenAI
OPENAI_API_KEY=my_bewildcard_openai_key
OPENAI_REVERSE_PROXY=https://api.gptsapi.net

# Anthropic
ANTHROPIC_API_KEY=my_bewildcard_anthropic_key
ANTHROPIC_REVERSE_PROXY=https://api.gptsapi.net

Errors Encountered

1. Anthropic (Claude) API Error:
   Using the Claude 3 Haiku model, I received an error about the organization being disabled, despite charges appearing on my BeWildCard account:

   LibreChat | 2024-07-20 02:48:46 error: [AnthropicClient] There was an issue generating the title 400 {"type":"error","error":{"type":"invalid_request_error","message":"This organization has been disabled."}}
   

2. OpenAI API Error:
   No charges by BeWildCard for GPT-4o, but LibreChat reported:

   LibreChat | 2024-07-20 02:50:56 warn: [OpenAIClient.chatCompletion][stream] API error
   LibreChat | 2024-07-20 02:50:56 error: [handleAbortError] AI response error; aborting request: 404 "Not Found"
   

Questions for the Community

1. Configuration of Reverse Proxy:
   Is setting the reverse proxy to https://api.gptsapi.net for BeWildCard the correct approach, or should this configuration be applied differently in LibreChat (perhaps through another variable or config file)?

2. Error Diagnosis:
   Assuming the reverse proxy is correctly set, what might be the reasons for these errors? Could there be an issue with how BeWildCard is handling these requests, or might it be a problem with my API keys or account settings?

Any insights or suggestions would be greatly appreciated as I navigate this integration challenge. Thank you for your help!

[hayschan]

I wanted to follow up on my post regarding the issues I was facing while integrating BeWildCard, a third-party API proxy provider, with LibreChat. I've managed to resolve the problem and would like to share the solution here so that it might help others who encounter a similar issue in the future.

The Solution

The key to resolving the issue was adjusting the reverse proxy URL to include /v1 at the end, to mirror the base URL pattern used by the APIs. This detail was overlooked initially.

In LibreChat's source code, the OpenAI base URL is set as follows:

const openaiBaseURL = 'https://api.openai.com/v1';

Given this structure, the reverse proxy should similarly reflect the /v1 to correctly route requests. Here’s the corrected configuration in the .env file:

# OpenAI
OPENAI_API_KEY=your_bewildcard_openai_key
- OPENAI_REVERSE_PROXY=https://api.gptsapi.net
+ OPENAI_REVERSE_PROXY=https://api.gptsapi.net/v1

# Anthropic
ANTHROPIC_API_KEY=your_bewildcard_anthropic_key
- ANTHROPIC_REVERSE_PROXY=https://api.gptsapi.net
+ ANTHROPIC_REVERSE_PROXY=https://api.gptsapi.net/v1

Conclusion

By aligning the reverse proxy URL with the base URL structure of the APIs (including the /v1 path), both the OpenAI and Anthropic services began functioning as expected through the BeWildCard proxy.

I hope this solution can save time for anyone who might run into the same or similar configuration issue. Thanks to everyone who took the time to consider and respond to my initial query!

[hayschan]

Hello LibreChat Community,

Despite the successful attempt for OpenAI, I am still experiencing issues integrating the Anthropic API through the BeWildCard proxy within LibreChat. I wanted to share an update and seek further assistance from the community.

Current Configuration and Errors

Configuration Changes Made:

• Tried setting the reverse proxy to both https://api.gptsapi.net and https://api.gptsapi.net/v1.
• Ensured my API keys are active and the organization is in good standing directly from Anthropic and BeWildCard.

Errors Encountered:

1. With https://api.gptsapi.net:

   • Encountered error responses stating "This organization has been disabled." Here are the logs:

     LibreChat         | 2024-07-20 05:06:41 warn: User: 669a13ec61567fa5dd5a6501 | Anthropic Request 1 failed: 400 {"type":"error","error":{"type":"invalid_request_error","message":"This organization has been disabled."}}
     LibreChat         | 2024-07-20 05:06:46 warn: User: 669a13ec61567fa5dd5a6501 | Anthropic Request 2 failed: 400 {"type":"error","error":{"type":"invalid_request_error","message":"This organization has been disabled."}}
     LibreChat         | 2024-07-20 05:06:57 error: [AnthropicClient] There was an issue generating the title 400 {"type":"error","error":{"type":"invalid_request_error","message":"This organization has been disabled."}}
     

2. With https://api.gptsapi.net/v1:

   • No errors are reported in the LibreChat console, but replies from Claude are empty, even though BeWildCard still deducts fees, suggesting that requests are being made successfully but responses are not being forwarded or parsed correctly.

Request for Help

Given these persistent issues, I'm looking for any guidance or suggestions on how to address this:

• Has anyone successfully integrated Anthropic through a third-party proxy like BeWildCard within LibreChat?
• Are there additional configuration settings or modifications within LibreChat that could be affecting how responses are handled from proxied APIs?
• Any specific logs or debugging tools that could help pinpoint where the issue lies in the response handling?

Your insights or any similar experiences would be immensely helpful as I continue to resolve this integration challenge. Thank you in advance for your assistance!

[danny-avila]

it looks like a server-side issue on your proxy's part

[hayschan]

But on another client the method works. For example, this is the NextChat client. So, I wonder if there is something I have configured wrong on the LibreChat.