Service request failed , Status: 404 (Not Found) For custom end points

[gauravaroa]

Service

OpenAI

Describe the bug

I have setup custom end point for our in-house model

here getting below error on

ChatMessageContent responseText = chatCompletionResult.Value.Content;

Stack Trace "OpenAI: Service request failed.
Status: 404 (Not Found)

at OpenAI.ClientPipelineExtensions.ProcessMessageAsync(ClientPipeline pipeline, PipelineMessage message, RequestOptions options)
at OpenAI.Chat.ChatClient.CompleteChatAsync(BinaryContent content, RequestOptions options)
at OpenAI.Chat.ChatClient.CompleteChatAsync(IEnumerable`1 messages, ChatCompletionOptions options, CancellationToken cancellationToken)"

but same CompletionEndpoint on trying with CURL working fine

Steps to reproduce

see error

Code snippets

protected virtual OpenAI.OpenAIClient CreateOpenAIClient(string authToken, Uri endpoint)
{
    return new OpenAI.OpenAIClient(
        new ApiKeyCredential(authToken),
        new OpenAIClientOptions
        {
            Endpoint = endpoint,
            NetworkTimeout = TimeSpan.FromSeconds(60),
        });
}

  // Get authentication token
  string authToken = await GetAuthTokenAsync();
  
  // Create OpenAI client with custom endpoint and auth token
  var openAiClient = CreateOpenAIClient(authToken, new Uri(_options.CompletionEndpoint));

  var messages = new List<ChatMessage>
  {
      new SystemChatMessage(systemPrompt),
      new UserChatMessage(userPrompt)
  };

  var chatClient = openAiClient.GetChatClient(model ?? "gpt-4");

var chatCompletionResult = chatClient.CompleteChat(messages, options);
ChatMessageContent responseText = chatCompletionResult.Value.Content;

OS

winOS

.NET version

8

Library version

2.0.0

[joseharriaga]

Thank you for reaching out, @gauravaroa ! The way the Endpoint property in OpenAIClientOptions works is that it replaces the initial part of the URL. For example, for chat completions, instead of having:

https://api.openai.com/v1/chat/completions

You would have:

<custom endpoint>/chat/completions

Does your custom endpoint follow this pattern?

[gauravaroa]

Thank you for reaching out, @gauravaroa ! The way the Endpoint property in OpenAIClientOptions works is that it replaces the initial part of the URL. For example, for chat completions, instead of having:

https://api.openai.com/v1/chat/completions

You would have:

<custom endpoint>/chat/completions

Does your custom endpoint follow this pattern?

yes it's in same pattern , and same i have tried working with CURL

[joseharriaga]

If it's the same pattern (including the way that the /v1/ path parameter is handled), it should work. Could you provide more information?