Skip to content

[JS] [Go] Add simulated tool support middleware #2668

Open
@apascal07

Description

@apascal07

Describe the bug
Some models don't support native tool calling support (e.g. Gemma 3) but it could be implemented via a middleware that modifies the request with injected tool definition instructions and parses the response into simulated tool responses.

Metadata

Metadata

Assignees

Labels

bugSomething isn't workinggo

Type

No type

Projects

Status

No status

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions