Skip to content

Run LLM models locally with an HTTP API

License

Notifications You must be signed in to change notification settings

sachaarbonel/ModelRunner

 
 

Repository files navigation

ModelRunner

Note

Some models require that you agree to their terms of service on Hugging Face before you can use them. This requires you to create a file containing your Hugging Face API key in your home directory under .cache/huggingface/token (on windows). See here for more info.

About

Run LLM models locally with an HTTP API

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Rust 97.1%
  • Makefile 1.8%
  • Dockerfile 1.1%