-
Notifications
You must be signed in to change notification settings - Fork 144
Issues: Lightning-AI/LitServe
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Support for async requests or webhooks
enhancement
New feature or request
#348
opened Oct 29, 2024 by
brian316
LitServe server doesn't crash when there is a failure in setup
enhancement
New feature or request
help wanted
Extra attention is needed
#347
opened Oct 28, 2024 by
tchaton
Improve the debugging experience of LitServe
enhancement
New feature or request
#344
opened Oct 25, 2024 by
tchaton
Add custom path option for healthcheck
enhancement
New feature or request
#341
opened Oct 23, 2024 by
akuma12
Websocket Support for Streaming Input and Output
enhancement
New feature or request
question
Further information is requested
#320
opened Oct 3, 2024 by
ChenghaoMou
Embedding model support with openai spec
enhancement
New feature or request
help wanted
Extra attention is needed
question
Further information is requested
#305
opened Sep 30, 2024 by
riyajatar37003
Add Keep-Alive Functionality for GPU Resource Optimization in LitServe
enhancement
New feature or request
#304
opened Sep 29, 2024 by
skyking363
terminate early if accelerator is missing
enhancement
New feature or request
#292
opened Sep 24, 2024 by
Borda
Handle case when Logger.process is stuck
enhancement
New feature or request
#289
opened Sep 23, 2024 by
aniketmaurya
Is it possible to support multiple endpoints for one server?
enhancement
New feature or request
help wanted
Extra attention is needed
question
Further information is requested
#271
opened Sep 6, 2024 by
arkohut
Feature Request: Customize FastAPI Metadata
enhancement
New feature or request
help wanted
Extra attention is needed
#270
opened Sep 6, 2024 by
bhimrazy
First attempt at monitoring metrics using prometheus_client
enhancement
New feature or request
#262
opened Sep 2, 2024 by
AdolfoVillalobos
•
Draft
1 of 4 tasks
Map New feature or request
help wanted
Extra attention is needed
decode_request
during dynamic batching using a threadpool
enhancement
#166
opened Jul 8, 2024 by
aniketmaurya
Evict requests if the client has disconnected
enhancement
New feature or request
help wanted
Extra attention is needed
#165
opened Jul 8, 2024 by
aniketmaurya
Feat: Add support for fastapi lifespan events
enhancement
New feature or request
help wanted
Extra attention is needed
#110
opened May 23, 2024 by
robTheBuildr
enable users to override the default api endpoint path
enhancement
New feature or request
help wanted
Extra attention is needed
#90
opened May 16, 2024 by
aniketmaurya
Add a detached mode
enhancement
New feature or request
help wanted
Extra attention is needed
#56
opened Apr 22, 2024 by
rasbt
ProTip!
Adding no:label will show everything without a label.