KAgent + Ollama Integration

This repository provides Kubernetes manifests and configuration to integrate KAgent with a locally hosted Ollama instance. The setup enables you to run and manage LLMs (such as orca-mini and hermes-2-pro-llama-3-8b) on your Kubernetes cluster and interact with them via KAgent.

A complete walkthrough has been published on Medium here

Repository Structure

• kagent/: KAgent Helm values and configuration manifests.
• ollama-operator/: CRDs and model manifests for Ollama Operator.

---

Quick Start

1. Create Namespaces

kubectl create namespace ollama-apps
kubectl create namespace kagent

2. Install Ollama Operator CRDs

kubectl apply --server-side=true -f https://raw.githubusercontent.com/nekomeowww/ollama-operator/v0.10.1/dist/install.yaml

3. Deploy Ollama Models

Apply the model manifests for Ollama:

kubectl apply -f ollama-operator/models/orca-mini.yaml
kubectl apply -f ollama-operator/models/hermes2.yaml
kubectl apply -f ollama-operator/models/models/llama3.2.yaml

4. Configure and Deploy KAgent

You can install KAgent using Helm or the CLI. See kagent/README.md for details.

Example with Helm:

helm install kagent-crds oci://ghcr.io/kagent-dev/kagent/helm/kagent-crds --namespace kagent --create-namespace
helm install kagent oci://ghcr.io/kagent-dev/kagent/helm/kagent --namespace kagent --values values.yaml

Or apply the provided manifests in kagent/ for custom configuration.

---

Configuration Overview

• Ollama Models: Defined in ollama-operator/models/ (e.g., orca-mini.yaml, hermes2.yaml).
• KAgent: Values and model config in kagent/values.yaml and kagent/llama3.2-config.yaml. Example agent in kagent/kagent-agent.yaml.

---

References

• KAgent Documentation
• Ollama Operator
• LiteLLM Docs
• Ollama Supported Models

---

License

See LICENSE.

Star History