We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent e5fe2c8 commit 1c30df9Copy full SHA for 1c30df9
colossalai/inference/server/api_server.py
@@ -6,7 +6,7 @@
6
Usage: (for local user)
7
- First, Lauch an API locally. `python3 -m colossalai.inference.server.api_server --model path of your llama2 model`
8
- Second, you can turn to the page `http://127.0.0.1:8000/docs` to check the api
9
- - For completion service, you can invoke it by using `curl -X POST http://127.0.0.1:8000/v1/completion \
+ - For completion service, you can invoke it by using `curl -X POST http://127.0.0.1:8000/completion \
10
-H 'Content-Type: application/json' \
11
-d '{"prompt":"hello, who are you? ","stream":"False"}'`
12
Version: V1.0
0 commit comments