Skip to content

Agent with naive RAG support#185

Merged
orpiske merged 1 commit intoKaotoIO:mainfrom
JiriOndrusek:naive-RAG-support-03
Feb 6, 2026
Merged

Agent with naive RAG support#185
orpiske merged 1 commit intoKaotoIO:mainfrom
JiriOndrusek:naive-RAG-support-03

Conversation

@JiriOndrusek
Copy link
Contributor

@JiriOndrusek JiriOndrusek commented Feb 5, 2026

fixes #183

This PR adds a Forage support of RAG into AI agent. The example of configuration of in memory naive RAG is:

forage.ollama.agent.model.kind=ollama
forage.ollama.agent.model.name=granite4:3b
forage.ollama.agent.base.url=http://localhost:11434

#RAG

forage.ollama.agent.embedding.model.name=nomic-embed-text
forage.ollama.agent.embedding.model.base.url=http://localhost:11434
forage.ollama.agent.embedding.model.timeout=PT30S
forage.ollama.agent.in.memory.store.file.source=company-knowledge-base.txt
forage.ollama.agent.in.memory.store.max.size=300
forage.ollama.agent.in.memory.store.overlap.size=100

forage.ollama.agent.rag.max.results=3
forage.ollama.agent.rag.min.score=0.6

(also proivided as an example: KaotoIO/forage-examples#15)

PR adds configurations of:

  • embeddingModel (currently only Ollama, but should be extended in future)
  • embeddingStore (vectordb) of in memory store
  • default RetrievalAugmentor

if agent contains configuration of embeddingModel, embeddingStore and contains mvn:io.kaoto.forage:forage-default-retrieval-augmentor then DefaultRetrievalAugmentor is created and injected into chat model.

Copy link
Contributor

@orpiske orpiske left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I left one comment about the headers, but overall it LGTM. Thanks!

@JiriOndrusek JiriOndrusek removed the request for review from Croway February 5, 2026 13:58
@orpiske orpiske merged commit 5f78606 into KaotoIO:main Feb 6, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

AI RAG: the way of configuring the RAG into a simple agent is missing

2 participants