We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 31b9db3 commit d890fecCopy full SHA for d890fec
docs/how-to/llms/litellm.md
@@ -48,6 +48,24 @@ Integrate db-ally with your LLM vendor.
48
llm=LiteLLM(model_name="anyscale/meta-llama/Llama-2-70b-chat-hf")
49
```
50
51
+=== "Azure OpenAI"
52
+
53
+ ```python
54
+ import os
55
+ from dbally.llms.litellm import LiteLLM
56
57
+ ## set ENV variables
58
+ os.environ["AZURE_API_KEY"] = "your-api-key"
59
+ os.environ["AZURE_API_BASE"] = "your-api-base-url"
60
+ os.environ["AZURE_API_VERSION"] = "your-api-version"
61
62
+ # optional
63
+ os.environ["AZURE_AD_TOKEN"] = ""
64
+ os.environ["AZURE_API_TYPE"] = ""
65
66
+ llm = LiteLLM(model_name="azure/<your_deployment_name>")
67
+ ```
68
69
Use LLM in your collection.
70
71
```python
0 commit comments