Dart Llama Lib

A library that pack Llama.cpp to work on Dart.

Run any .gguf model file on Linux, Windows and Android.

[IMPORTANT]

• This project is on alfa preview and can have unespected bugs!
• It is not fully implemented!

How to use

• A Dart/Flutter instalation.
• A C/C++ and CMake instalation.
• Clone this repository.
• Clone the Llama.cpp project inside dart_llama_lib/src/llama.cpp.
• Inside dart_llama_lib/src run the folowing comands:

cmake .

and

cmake --build .

• Put the resultant files (*.dll, *.so) somewhere your code can access.

Source Projects and References

• Ggerganov's Llama.cpp project.
• Netdur's llama_cpp_dart project.
• Dane Madsen's maid_llm project.

Licence

This project is licensed under the MIT License - see the LICENSE.md file for details.