Skip to content

Local API that receives requests and runs different machine learning models locally, enabling quick testing and experimentation without external dependencies.

Notifications You must be signed in to change notification settings

CosminGorun/Local_multi_models_server

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Local Multi AI Models API


How to Run

Run the runner.py script.
This will execute the command:
uvicorn.run("api:app", host="0.0.0.0", port=8000, reload=True)
and start a server on port 8000.

The API uses FastAPI. This project is a work in progress.


Available Classes

1) custom_model

This class imports and uses a pre-installed model from Hugging Face.
It provides the following endpoints:

  • POST:
    • /initModel – loads the model into memory.
    • /delModel – frees the model from memory.
  • GET:
    • /getResponse – returns a string with the model's response.

2) generator3D

Generates a 3D object from text or image using Shap-E.

3) openrouter_deepseek

Calls the DeepSeek free model using OpenRouter.


Status

This project is under active development. The code may change, so this README might refer to an older version.
All dependencies are listed in the requirements.txt file.

About

Local API that receives requests and runs different machine learning models locally, enabling quick testing and experimentation without external dependencies.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages