Skip to content

Conversation

@xhr15
Copy link
Member

@xhr15 xhr15 commented Mar 12, 2025

See A RAG Library for Elixir

We want to turn chatbot_ex into a RAG system that answers question about (ecto)[https://hex.pm/packages/ecto]. Out of the box, chatbot_ex knows nothing about ecto.

In Step one, we ran the generator.

Removing the LLM serving

chatbot_ex is using Ollama for text generation. Ollama is kind of a package manager for LLMs. It is easy to install and allows you to switch between models easily. Therefore, we can remove the Nx.Serving for text generation.

@xhr15 xhr15 force-pushed the rag/rag-transition-2 branch from d11a6fd to 64937d0 Compare March 12, 2025 11:25
@xhr15 xhr15 added BLOG POST EXAMPLE see [A RAG Library for Elixir](https://bitcrowd.dev/a-rag-library-for-elixir#build-your-rag-system) do not merge labels Mar 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

BLOG POST EXAMPLE see [A RAG Library for Elixir](https://bitcrowd.dev/a-rag-library-for-elixir#build-your-rag-system) do not merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants