data-detective

An app that leverages LLMs to process documents, extract relevant information and provide a summary specific to financial data

Setup

Installing the correct version of llama-cpp-python
Resource

for NVIDIA GPU
CMAKE_ARGS="-DLLAMA_CUDA=on" pip install llama-cpp-python
for Apple silicon
CMAKE_ARGS="-DLLAMA_METAL=on" pip install llama-cpp-python
for CPU
CMAKE_ARGS="-DLLAMA_BLAS=ON -DLLAMA_BLAS_VENDOR=OpenBLAS" pip install llama-cpp-python

Installing requirements \

pip install -r requirements.txt