Dart Llama Lib

A library that pack Llama.cpp to work on Dart.

Run any .gguf model file on Linux, Windows and Android.

[IMPORTANT]

This project is on alfa preview and can have unespected bugs!
It is not fully implemented!

How to use

A Dart/Flutter instalation.
A C/C++ and CMake instalation.
Clone this repository.
Clone the Llama.cpp project inside dart_llama_lib/src/llama.cpp.
Inside dart_llama_lib/your_platform run the folowing comands:

cmake .

and

cmake --build .

Put the resultant files (*.dll, *.so) inside dart_llama_lib/lib/bin.

Source Projects and References

Ggerganov's Llama.cpp project.
Netdur's llama_cpp_dart project.
Dane Madsen's maid_llm project.

Licence

This project is licensed under the MIT License - see the LICENSE.md file for details.