[Docs] store_model_in_db Release Docs#21863
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
Greptile SummaryThis documentation-only PR adds three things: (1) a new doc page for the
Confidence Score: 3/5
|
| Filename | Overview |
|---|---|
| docs/my-website/docs/proxy/ui_store_model_db_setting.md | New documentation page for store_model_in_db UI setting. Contains two broken "Related Documentation" links (ui_overview.md and models_and_endpoints.md don't exist) and unused Tabs/TabItem imports. |
| docs/my-website/release_notes/v1.81.14.md | Release notes updated with Store Model in DB feature entry. The new section is inserted in a position that disrupts the existing guardrails section structure, causing "Eval results" to appear under the wrong heading. |
| docs/my-website/blog/server_root_path/index.md | Well-written incident report blog post documenting the SERVER_ROOT_PATH regression. Includes clear timeline, root cause analysis, remediation steps, and CI workflow details. No issues found. |
| docs/my-website/sidebars.js | Sidebar entry added for the new ui_store_model_db_setting page under the "Models" category. Placement is appropriate alongside existing model-related UI docs. |
| docs/my-website/img/ui_store_model_in_db.png | Screenshot image for the store_model_in_db UI feature documentation. File exists and is referenced correctly. |
Flowchart
%%{init: {'theme': 'neutral'}}%%
flowchart TD
A["Admin UI: Models + Endpoints"] --> B["Click Settings Icon"]
B --> C["Toggle store_model_in_db"]
C -->|Enabled| D["Model definitions stored in DB"]
C -->|Disabled| E["Models read from config only"]
D --> F["No proxy restart needed"]
E --> F
F --> G["Setting takes effect immediately"]
style D fill:#d4edda,stroke:#28a745
style E fill:#fff3cd,stroke:#ffc107
style G fill:#d1ecf1,stroke:#0dcaf0
Last reviewed commit: cb4b638
| - [Admin UI Overview](./ui_overview.md) – General guide to the LiteLLM Admin UI | ||
| - [Models and Endpoints](./models_and_endpoints.md) – Managing models and API endpoints | ||
| - [Config Settings](./config_settings.md) – `store_model_in_db` in `general_settings` |
There was a problem hiding this comment.
Broken links to non-existent docs
Two of the three "Related Documentation" links point to files that do not exist in the repository:
./ui_overview.md— no file atdocs/my-website/docs/proxy/ui_overview.md./models_and_endpoints.md— no file atdocs/my-website/docs/proxy/models_and_endpoints.md
Only ./config_settings.md exists. These broken links will cause 404 errors in the published docs. Either create the referenced pages, or update these links to point to existing documentation pages.
| ## Store Model in DB Settings via UI | ||
|
|
||
| Previously, the `store_model_in_db` setting could only be configured in `proxy_config.yaml` under `general_settings`, requiring a proxy restart to take effect. Now you can enable or disable this setting directly from the Admin UI without any restarts. This is especially useful for cloud deployments where you don't have direct access to config files or want to avoid downtime. Enable `store_model_in_db` to move model definitions from your YAML into the database—reducing config complexity, improving scalability, and enabling dynamic model management across multiple proxy instances. |
There was a problem hiding this comment.
New section misplaced before "Eval results"
The "## Store Model in DB Settings via UI" section is inserted immediately before ### Eval results (line 70), which was originally a subsection under the guardrails / "3 New Built-in Guardrails" section. As a result, "Eval results" now appears to be a subsection of "Store Model in DB Settings via UI" rather than the guardrails section where it belongs.
Consider moving this new section either after the "Eval results" table (after the paragraph ending on what was previously line 79) or to a different location in the release notes where it won't break the guardrails section's structure.
| import Tabs from '@theme/Tabs'; | ||
| import TabItem from '@theme/TabItem'; |
There was a problem hiding this comment.
Unused imports
Tabs and TabItem are imported but never used in this document. Remove these unused imports to keep the file clean.
| import Tabs from '@theme/Tabs'; | |
| import TabItem from '@theme/TabItem'; |
Relevant issues
Pre-Submission checklist
Please complete all items before asking a LiteLLM maintainer to review your PR
tests/litellm/directory, Adding at least 1 test is a hard requirement - see detailsmake test-unit@greptileaiand received a Confidence Score of at least 4/5 before requesting a maintainer reviewCI (LiteLLM team)
Branch creation CI run
Link:
CI run for the last commit
Link:
Merge / cherry-pick CI run
Links:
Type
📖 Documentation
Changes