Skip to content

Uses pydantic schema and prompting to use tool calling effectively with open source llms (tested with Llama3 using HF inference API)I

License

Notifications You must be signed in to change notification settings

msamylea/open_source_llm_tool_use

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Example use

See app.py for example use.

Set api_type as "ollama", "anthropic", "llama-cpp", "watsonx", "lm-studio" to use the langchain prompt/invocation associated with that provider.

Default api_type is openai and doesn't need to be set.

**Have not tested anthropic, llama-cpp, watsonx, or lm-studio. Ollama and OpenAI working on 5/28/2024.

About

Uses pydantic schema and prompting to use tool calling effectively with open source llms (tested with Llama3 using HF inference API)I

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages