Skip to content

Conversation

@michaelfeil
Copy link
Owner

  • adds new dependency (orjson) for faster response serialization - 300%
  • uses torch.inference_mode() and delayed moving to CPU - 10%
  • adds uvicorn[standard] - slightly faster 2-5%?

Updates readme

@codecov-commenter
Copy link

Welcome to Codecov 🎉

Once merged to your default branch, Codecov will compare your coverage reports and display the results in this comment.

Thanks for integrating Codecov - We've got you covered ☂️

@michaelfeil michaelfeil merged commit 3ed24bb into main Oct 12, 2023
@michaelfeil michaelfeil deleted the 1-docs-json-validation branch October 12, 2023 01:44
michaelfeil pushed a commit that referenced this pull request Nov 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants