Skip to content

Commit d890fec

Browse files
authored
docs(llm): add docs for azure openai (#55)
1 parent 31b9db3 commit d890fec

File tree

1 file changed

+18
-0
lines changed

1 file changed

+18
-0
lines changed

docs/how-to/llms/litellm.md

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -48,6 +48,24 @@ Integrate db-ally with your LLM vendor.
4848
llm=LiteLLM(model_name="anyscale/meta-llama/Llama-2-70b-chat-hf")
4949
```
5050

51+
=== "Azure OpenAI"
52+
53+
```python
54+
import os
55+
from dbally.llms.litellm import LiteLLM
56+
57+
## set ENV variables
58+
os.environ["AZURE_API_KEY"] = "your-api-key"
59+
os.environ["AZURE_API_BASE"] = "your-api-base-url"
60+
os.environ["AZURE_API_VERSION"] = "your-api-version"
61+
62+
# optional
63+
os.environ["AZURE_AD_TOKEN"] = ""
64+
os.environ["AZURE_API_TYPE"] = ""
65+
66+
llm = LiteLLM(model_name="azure/<your_deployment_name>")
67+
```
68+
5169
Use LLM in your collection.
5270

5371
```python

0 commit comments

Comments
 (0)