v0.2.4

What's Changed

• Dynamically grab port number by @grantgasser in #307
• test generate client file by @aniketmaurya in #322
• avoid client generation if already exist by @aniketmaurya in #324
• move middlewares to a module by @aniketmaurya in #326
• enable isort by @aniketmaurya in #327
• Feat: track number of active requests by @aniketmaurya in #325
• aggregate requests across uvicorn processes by @aniketmaurya in #328
• lint: emergency docformatter bump by @aniketmaurya in #331
• update(lint): prune config by @Borda in #332
• Avoiding counting active requests in /health and /metrics by @vrdn-23 in #334
• Host param by @grumpyp in #335
• improve error handling from inference worker processes by @aniketmaurya in #337
• Fix Docker Argument Handling by @aniketmaurya in #338
• Add dockerization to feature list by @aniketmaurya in #346
• stream tool calling by @whisper-bye in #349
• Release 0.2.4 by @aniketmaurya in #351

New Contributors

• @grantgasser made their first contribution in #307
• @vrdn-23 made their first contribution in #334
• @whisper-bye made their first contribution in #349

Full Changelog: v0.2.3...v0.2.4