OCI's models shown even if retired #263
Description
Checklist
- I have searched the existing issues for similar issues.
- I added a very descriptive title to this issue.
- I have provided sufficient information below to help reproduce this issue.
Summary
Getting all models from us-chicago-1, some of them, like: meta.llama-3.1-70b-instruct are in the list, but running a chat I've got this issue:
2025-Sep-18 10:22:38 (v1.1.5.dev70+g84afaa275) - INFO - (LiteLLM):
LiteLLM completion() model= meta.llama-3.1-70b-instruct; provider = oci
Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new
LiteLLM.Info: If you need to debug this error, use `litellm._turn_on_debug()'.
2025-Sep-18 10:22:39 (v1.1.5.dev70+g84afaa275) - ERROR - (server.agents.chatbot): Failed to grade; marking all results relevant: litellm.APIConnectionError: OciException - { "code": "400", "message": "Model meta.llama-3.1-70b-instruct 1.0.0 is retired" }
2025-Sep-18 10:22:39 (v1.1.5.dev70+g84afaa275) - INFO - (server.agents.chatbot): Streaming completion...
2025-Sep-18 10:22:39 (v1.1.5.dev70+g84afaa275) - INFO - (LiteLLM):
LiteLLM completion() model= meta.llama-3.1-70b-instruct; provider = oci
Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new
LiteLLM.Info: If you need to debug this error, use `litellm._turn_on_debug()'.
2025-Sep-18 10:22:40 (v1.1.5.dev70+g84afaa275) - ERROR - (server.agents.chatbot): litellm.APIConnectionError: OciException - { "code": "400", "message": "Model meta.llama-3.1-70b-instruct 1.0.0 is retired" }
Steps To Reproduce
No response
Expected Behavior
No response
Current Behavior
No response
Is this a regression?
- Yes, this used to work in a previous version.
Debug info
- Version:
- Python version:
- Operating System:
- Browser:
Additional Information
No response
Metadata
Metadata
Assignees
Labels
No labels