Skip to content

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

High level typed interface #528

Closed
AriMKatz opened this issue Jan 11, 2024 · 0 comments
Closed

High level typed interface #528

AriMKatz opened this issue Jan 11, 2024 · 0 comments
Labels

Comments

@AriMKatz
Copy link

AriMKatz commented Jan 11, 2024

Opening per @remic33 in https://twitter.com/lateinteraction/status/1736804963760976092?t=5Pypu6f6AWPljWiWUbWM8g&s=19

I really like outlines. I also really like https://github.com/shroominic/funcchain

A library that provides high level pythonic abstractions like typed functions dynamically compiling grammars for return pydantic structs (funcchain) that would also allow you to drop down to customize generation (outlines )either within or around these functions would be amazing. High level mypy Typed boundaries around outlines programs.

Analogy would be Pytorch:triton::funcchain/equivalent:outlines

Aside from the funcchain feature, for my use case I'd love to see:

  1. Custom unpacking of pydantic structs: Looping/ programmatically accessing fields into prompts
  2. Customizing generation of pydantic output structs
  3. Mixing and matching regular python types and pydantic inputs and outputs
  4. Stretch goal: Some sort of single dispatch (class based) or multiple dispatch polymorphism (https://github.com/beartype/plum)

Our baseline MVP will be using OpenAI models initially. For this to be computationally feasible, I think we'd need function calling, which seems to be planned?

Related to: #508

@rlouf rlouf added the question label Jan 16, 2024
@dottxt-ai dottxt-ai locked and limited conversation to collaborators Jan 18, 2024
@rlouf rlouf converted this issue into discussion #558 Jan 18, 2024

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

Labels
Projects
None yet
Development

No branches or pull requests

2 participants