LLama-Stack Demo Distribution

A demo distribution descriptor to be used with LlamaChat Can be made to work with the community LlamaStack Operator on Openshift/K8s with minimal effort. Still not tested though.

Build Stack

1. Create venv

$ uv venv -p <python environment> .venv
$ uv add llama-stack

2. Build llama stack distribution

$ uv run llama stack build --template starter --image-type venv --config llama-stack-config.yaml

3. Run Stack

$ uv run llama stack run --image-type venv llama-stack-config.yaml

TODO

• Proper build instructions
• Run via Podman
• Update to latest llama-stack package