Skip to content

Commit

Permalink
Connect engine healthcheck to openai server (vllm-project#3260)
Browse files Browse the repository at this point in the history
  • Loading branch information
njhill authored Mar 8, 2024
1 parent 249eef0 commit 0e36560
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions vllm/entrypoints/openai/api_server.py
Original file line number Diff line number Diff line change
Expand Up @@ -160,6 +160,7 @@ async def validation_exception_handler(_, exc):
@app.get("/health")
async def health() -> Response:
"""Health check."""
await openai_serving_chat.engine.check_health()
return Response(status_code=200)


Expand Down

0 comments on commit 0e36560

Please sign in to comment.