UTN, Minería de Texto, Mg.Ana Bach

Project Description

Chatbot for QA on close-domain data.

Source code adapted from: "Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A" link

Tools

• LangChain: Framework for developing applications powered by language models
• C Transformers: Python bindings for the Transformer models implemented in C/C++ using GGML library
• FAISS: Open-source library for efficient similarity search and clustering of dense vectors.
• Sentence-Transformers (all-MiniLM-L6-v2): Open-source pre-trained transformer model for embedding text to a 384-dimensional dense vector space for tasks like clustering or semantic search.
• Llama-2-7B-Chat: Open-source fine-tuned Llama 2 model designed for chat dialogue. Leverages publicly available instruction datasets and over 1 million human annotations.

To Do:

• Experiment with slightly larger LLMs like the Llama 13B Chat model.