[Feature Request]: New model inference api providers integration

[elricwan]

Is there an existing issue for the same feature request?

• I have checked the existing issues.

Is your feature request related to a problem?

Describe the feature you'd like

It is great to have the inference providers that allowing people to use the model easily. And I know other model providers also want to cooperate with ragflow to create easy, stable, and affordable services to the community. How can they add their api to the ragflow? Is there any instruction to do it? Thank you.

Describe implementation you've considered

No response

Documentation, adoption, use case

Additional information

No response

[KevinHuSh]

What about using this only for OpenAI compatible?

[elricwan]

Hi Kevin, thanks for replying. In the image you share, you have OpenAI-API-Compatible, but you also has model api provider like OpenRouter, TogetherAI, and more. If other model providers also want to join here, just like Together AI, OpenRouter shown in your image, what do they need to do?

[KevinHuSh]