Skip to content

Extend Dev Proxy with LLM #745

Closed
@waldekmastykarz

Description

@waldekmastykarz
  • extend Dev Proxy config with new properties
    • llmUrl (optional, default null)
    • model (optional, default to phi3)
  • extend ProxyContext with an LLM class responsible for communicating with an LLM, as specified in the config. The class exposes the GenerateCompletion method which calls to LLM to get a completion for the specified prompt. If calling an LLM failed, it returns null.
  • extend the OpenApiSpecGeneratorPlugin to use LLM for:
    • generating operationId from the operation path and method
    • generating operation description from the operation path and method
    • generating API description from the list of operations and methods
  • publish docs to explain how to use an LLM with Dev Proxy

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions