-
Notifications
You must be signed in to change notification settings - Fork 1
Closed
Labels
llmLLM provider relatedLLM provider related
Description
Parent Epic
Depends On
Summary
Override list_models_remote in OllamaProvider to query Ollama's tag listing endpoint.
Endpoint
GET {base_url}/api/tags
No authentication required.
Response Shape (Ollama API)
{
"models": [
{
"name": "llama3.2:latest",
"model": "llama3.2:latest",
"modified_at": "2025-09-12T...",
"size": 2019393189,
"details": {
"parameter_size": "3.2B",
"quantization_level": "Q4_K_M",
"family": "llama"
}
}
]
}Implementation Notes
- Map
name→ModelInfo::id,details.parameter_size→display_name. ollama_rscrate may already expose alist_local_models()method — check before
writing raw HTTP. If available, prefer that over manual reqwest call.- Cache with provider slug
"ollama". - If Ollama is unreachable, return
LlmError::Unavailable(do not cache error).
Acceptance Criteria
-
OllamaProvider::list_models_remotereturns all pulled models. -
display_nameincludes parameter size when available (e.g."llama3.2 3.2B Q4_K_M"). - Result is cached; second call within TTL returns cached data without HTTP.
- Unreachable Ollama returns
Err, does not overwrite valid cache. - Unit test with mock HTTP server or
ollama_rsmock.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
llmLLM provider relatedLLM provider related