Skip to content

Commit

Permalink
Enablement of REST API Usage within Google Colab Free Tier (lm-sys#2940)
Browse files Browse the repository at this point in the history
  • Loading branch information
ggcr authored and zhanghao.smooth committed Jan 26, 2024
1 parent 2c1ff12 commit 58805b3
Show file tree
Hide file tree
Showing 2 changed files with 349 additions and 0 deletions.
2 changes: 2 additions & 0 deletions docs/openai_api.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,8 @@ The following OpenAI APIs are supported:
- Completions. (Reference: https://platform.openai.com/docs/api-reference/completions)
- Embeddings. (Reference: https://platform.openai.com/docs/api-reference/embeddings)

The REST API can be seamlessly operated from Google Colab, as demonstrated in the [FastChat_API_GoogleColab.ipynb](https://github.com/lm-sys/FastChat/blob/main/playground/FastChat_API_GoogleColab.ipynb) notebook, available in our repository. This notebook provides a practical example of how to utilize the API effectively within the Google Colab environment.

## RESTful API Server
First, launch the controller

Expand Down
347 changes: 347 additions & 0 deletions playground/FastChat_API_GoogleColab.ipynb

Large diffs are not rendered by default.

0 comments on commit 58805b3

Please sign in to comment.