Skip to content

Commit

Permalink
(fix) docs litellm helm chart
Browse files Browse the repository at this point in the history
  • Loading branch information
ishaan-jaff committed Mar 15, 2024
1 parent 21202a3 commit 4a33c53
Show file tree
Hide file tree
Showing 2 changed files with 11 additions and 4 deletions.
2 changes: 1 addition & 1 deletion deploy/charts/litellm/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

## Prerequisites

- Kubernetes 1.23+
- Kubernetes 1.21+
- Helm 3.8.0+

If `db.deployStandalone` is used:
Expand Down
13 changes: 10 additions & 3 deletions docs/my-website/docs/proxy/deploy.md
Original file line number Diff line number Diff line change
Expand Up @@ -150,17 +150,20 @@ To avoid issues with predictability, difficulties in rollback, and inconsistent


## Deploy with Database
### Docker, Kubernetes, Helm Chart

We maintain a [seperate Dockerfile](https://github.com/BerriAI/litellm/pkgs/container/litellm-database) for reducing build time when running LiteLLM proxy with a connected Postgres Database

<Tabs>

<TabItem value="docker-deploy" label="Dockerfile">

```
We maintain a [seperate Dockerfile](https://github.com/BerriAI/litellm/pkgs/container/litellm-database) for reducing build time when running LiteLLM proxy with a connected Postgres Database

```shell
docker pull docker pull ghcr.io/berriai/litellm-database:main-latest
```

```
```shell
docker run --name litellm-proxy \
-e DATABASE_URL=postgresql://<user>:<password>@<host>:<port>/<dbname> \
-p 4000:4000 \
Expand Down Expand Up @@ -233,6 +236,8 @@ Your OpenAI proxy server is now running on `http://0.0.0.0:4000`.
</TabItem>
<TabItem value="helm-deploy" label="Helm">
Use this to deploy litellm using a helm chart. Link to [the LiteLLM Helm Chart](https://github.com/BerriAI/litellm/tree/main/deploy/charts/litellm)
#### Step 1. Clone the repository
```bash
Expand All @@ -241,6 +246,8 @@ git clone https://github.com/BerriAI/litellm.git

#### Step 2. Deploy with Helm

Run the following command in the root of your `litellm` repo

```bash
helm install \
--set masterkey=SuPeRsEcReT \
Expand Down

0 comments on commit 4a33c53

Please sign in to comment.