Description
- I have looked for existing issues (including closed) about this
Feature Request
Agentic chains (which we refer to as "pipelines") in Rig as it stands at the moment are currently a bit limited and arguably difficult to extend.
By leveraging recursively stacking types, we can create a pipeline system that is much more extendable and less reliant on macros(!) than our current pipeline system. Once we have reached feature parity with this and the feature has been rolled out, we can then deprecate the old pipeline module.
Motivation
Better DX, better scalability, better everything. We might need to ensure we implement a macro at some point for better debugging though, if users start trying to implement their own layers.
Proposal
Use the tower crate and create several layers/services that will effectively have parity with the current pipeline system.
Alternatives
Not really. We could extend the current pipeline system, but it doesn't seem very easy to do so.