Skip to content
This repository was archived by the owner on Jul 16, 2025. It is now read-only.

Conversation

@chr-hertel
Copy link
Member

@chr-hertel chr-hertel commented Oct 13, 2024

this PR focusses on shaping the model and platform concept.

  • models are only state objects now and the service character got killed in favor of Platform extension points ResponseFactory and ResponseConverter => decoupling => way better testability
  • opens up the platform requests to be quite generic => leeway to supporting large platforms like ollama, huggingface or replicate in a generic manner
  • bridge namespace heavily inspired by Symfony

Only thing missing right now is fixing embedding by bringing support for parallel calls on Platform back

best to review in IDE

@chr-hertel chr-hertel force-pushed the refactor-platform-layer branch 2 times, most recently from ee5f92d to ef7f3e0 Compare October 13, 2024 21:34
@chr-hertel chr-hertel changed the base branch from feat-replicate-llama to main October 13, 2024 21:41
@chr-hertel chr-hertel changed the base branch from main to feat-replicate-llama October 13, 2024 21:41
@chr-hertel chr-hertel force-pushed the refactor-platform-layer branch from ef7f3e0 to 84f0546 Compare October 13, 2024 22:25
@chr-hertel chr-hertel force-pushed the refactor-platform-layer branch from 84f0546 to 57262da Compare October 19, 2024 19:11
@OskarStark
Copy link
Contributor

Sorry for being not so active, I am a little bit busy right now.
I didn't find time to check this PR in detail

@OskarStark OskarStark added the enhancement New feature or request label Oct 19, 2024
@chr-hertel
Copy link
Member Author

@OskarStark no worries at all Oskar - i'm currently finishing up those 4 MRs and will try them in my demo app with the bundle to get them merged 👍

@OskarStark
Copy link
Contributor

Thanks, if my response format is working for tools, I could also switch entirely to our bundle/lib

@chr-hertel chr-hertel force-pushed the refactor-platform-layer branch 3 times, most recently from f2a2d57 to 91ec520 Compare October 19, 2024 20:33
@chr-hertel chr-hertel force-pushed the refactor-platform-layer branch from 91ec520 to 31a28d9 Compare November 23, 2024 10:09
@chr-hertel chr-hertel marked this pull request as ready for review November 23, 2024 10:09
Base automatically changed from feat-replicate-llama to main November 23, 2024 10:17
@chr-hertel chr-hertel force-pushed the refactor-platform-layer branch from 31a28d9 to 56deee0 Compare November 23, 2024 10:18
@chr-hertel chr-hertel merged commit 1799ed4 into main Nov 23, 2024
7 checks passed
@chr-hertel chr-hertel deleted the refactor-platform-layer branch November 23, 2024 10:20
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

enhancement New feature or request refactor

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants