Skip to content

Endpoints code requires an OpenAI API compatible server (llama.cpp incompatability) #133

Open
Open
Endpoints code requires an OpenAI API compatible server (llama.cpp incompatability)#133
Labels
area: clientEndpoint client, HTTP, transport, ZMQpriority: P2Medium — address within quartertype: bugSomething isn't working
@merlinf31

Description

@merlinf31
merlinf31
opened on Feb 24, 2026

If I try to run llama.cpp as a host (in this case using MLC2) I get this error.

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    area: clientEndpoint client, HTTP, transport, ZMQpriority: P2Medium — address within quartertype: bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions