What's Changed
- test LitAPI decode-encode methods by @aniketmaurya in #244
- fix readme code sanity check by @aniketmaurya in #246
- add e2e test for simple streaming server by @AdolfoVillalobos in #247
- separate loops to new module
loops.py
by @aniketmaurya in #249 - feat: middlewares in LitServer. by @lorenzomassimiani in #241
- test LitServer.run by @aniketmaurya in #248
- fix flaky test_collate_requests by @aniketmaurya in #250
- remove dead code by @aniketmaurya in #251
- add litserve.api tests by @aniketmaurya in #252
- add Starlette middleware support by @aniketmaurya in #253
- Add test for
litserve.examples
by @aniketmaurya in #254 - rename examples to test_examples by @aniketmaurya in #255
- add
litserve.connector
tests by @aniketmaurya in #256 - chore: adds Qwen2-VL Lightning Studio example by @bhimrazy in #259
- Bump mypy from 1.11.1 to 1.11.2 by @dependabot in #261
- Bump Lightning-AI/utilities from 0.11.6 to 0.11.7 by @dependabot in #264
- [pre-commit.ci] pre-commit suggestions by @pre-commit-ci in #266
- add
litserve.loops
tests by @aniketmaurya in #257 - ci: drop dependabot by @Borda in #268
- add perf test CI 1/3 by @aniketmaurya in #269
- install uvloop with uvcorn by @aniketmaurya in #274
- chore: adds Parler TTS Studio example by @bhimrazy in #277
- minor LitServer code clean up by @aniketmaurya in #279
- [Chore] rename setup_server to register_endpoints by @aniketmaurya in #281
- Callback system v0 by @aniketmaurya in #278
- add streaming no-batch speed test by @aniketmaurya in #283
- fix: callbacks EventType typo by @aniketmaurya in #285
- [Feat]: add Logger API by @aniketmaurya in #284
- fix flaky Logger test by @aniketmaurya in #288
- handle exceptions for logger processing by @aniketmaurya in #287
- docs: update feat template / readability by @Borda in #295
- update PR template with hiding instructions by @Borda in #297
- add links to forum and reduce opening issues for docs by @Borda in #296
- update ask a question link to reddit by @aniketmaurya in #299
- Add warning for unexpected model output in batched prediction by @grumpyp in #300
- fix custom HTTPException with argument names by @aniketmaurya in #302
- fix vLLM capitalization by @aniketmaurya in #303
- generate Dockerfile with CLI by @aniketmaurya in #298
- add jsonargparse in requirements by @aniketmaurya in #306
- add codeowners for requirements by @aniketmaurya in #308
- Enable gpu docker image generation by @aniketmaurya in #311
- Pyright linting fixes by @grumpyp in #314
- add Ethan as codeowner by @aniketmaurya in #313
- update
dockerize
CLI success msg copy by @aniketmaurya in #312 - switch to
argparse
for CLI by @aniketmaurya in #309 - fix dockerize CLI test by @aniketmaurya in #318
- fix(Logger): handle unpickleable Logger by @aniketmaurya in #319
- add example usage for
dockerize
CLI by @aniketmaurya in #315 - Release 0.2.3 by @aniketmaurya in #317
New Contributors
- @AdolfoVillalobos made their first contribution in #247
- @lorenzomassimiani made their first contribution in #241
- @grumpyp made their first contribution in #300
Full Changelog: v0.2.2...v0.2.3