Skip to content

[Feature]: more local llm support other than ollama #203

@cadslab

Description

@cadslab

Summary

support more openai compatible services such as vllm or sglang

Problem to solve

support more openai compatible services such as vllm or sglang

Proposed solution

support more openai compatible services such as vllm or sglang

Alternatives considered

No response

Impact

Dailiy

Evidence/examples

No response

Additional information

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions