Skip to content

[Feature]: Integrate with AICI #3714

Closed as not planned
Closed as not planned
@simon-mo

Description

@simon-mo

🚀 The feature, motivation and pitch

#2888 added a prototype for AI Controller Interface, which is a WASM based runtime for guided generation. We would like to integrate this into our existing guided decoding stack properly.

Related is lm-format-enforcer #3713.

We should tell the users strength of each framework and let the user choose.

Alternatives

No response

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    feature requestNew feature or requeststaleOver 90 days of inactivity

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions