Bee AI Platform Integration

[nrfulton]

The Bee AI Platform (BAIP) is open-source GUI for chat interfaces agentic stuff. We spoke with some folks on the Bee team and feel this could be a good solution for rapid prototyping of chat-based user interfaces to mellea programs.

Background Reading

• Documentation
• Quick start for local inference

Advantages

Integrating with Bee AI allows us to benefit from:

1. the GUI work that the Bee AI Platform team is doing
2. the devops / deployment workflow is owned by Bee AI

Alternatives

The obvious alternative is webchatui. Reasons to prefer Bee Platform:

1. integration with webchatui is a heavier lift because of the architecture of the system.
2. webchatui is targeted to direct model calling (as opposed to agents or higher-level programs).
3. Bee AI Platform has a really nice "traces" notion in its ui that corresponds nicely to Mellea programs

Tasks

• Figure out the best way to add "hooks" between Mellea and BAIP. It should be possible to specify the level of granularity at which trace info is passed along, and ideally there should be sensible defaults that come "for free". This seems relatively doable with some simple meta-programming.
• Add an m gui --chat command that spins up a local instance
• Add a manual/tutorial for prod hosting with vllm / watsonx. Should include a "client brings their own credentials" solution.

[rockenman1234]

Hey @nrfulton - I think I can get this done! So far, i've got a partly working BeeAI backend and test suite here - it needs more work, but I think I can get you a PR before Friday to review: https://github.com/rockenman1234/mellea

This is just something I'm doing for fun, so I ask that you please excuse any stupid mistakes I might have made.

Thanks! 😄