v1.9.13

What's Changed

• feat(guardrails): add lasso security guardrails by @raskanskyz-lasso in #971
• chore: add default status codes only when retry attempts are configured by @VisargD in #1010
• feat: add logprobs support for fireworks by @VisargD in #1009
• fix: handle 246 status code for stream responses by @VisargD in #1008
• Feat: anthropic thinking json to stream transform by @VisargD in #1014
• chore: add strict status code checks for mapping 246 response code by @VisargD in #1015
• 1.9.13 by @VisargD in #1016

New Contributors

• @raskanskyz-lasso made their first contribution in #971

Full Changelog: v1.9.12...v1.9.13

v1.9.12

What's Changed

• feat: Add Snowflake Cortex LLM API by @Ajay-Satish-01 in #988
• Feature: Changes for anthropic thinking by @narengogi in #1001
• 1.9.12 by @VisargD in #1004

Full Changelog: v1.9.11...v1.9.12

v1.9.11

What's Changed

• fix: use bedrock job_id and job_arn for response by @b4s36t4 in #958
• docs: add ec2 quicklaunch cloudformation template by @code-crusher in #978
• Add labels parameter in Vertex AI by @elentaure in #984
• fix: logging error with more than 1k characters by @urbanonymous in #970
• fix: bedrock guardrail handling update by @b4s36t4 in #990
• chore: vertex finetune and batches cleanup by @b4s36t4 in #989
• feat: kms key support for put requests in bedrock by @narengogi in #977
• handle thinking messages for anthropic by @narengogi in #987
• fix: remove conditional for bedrock list/get endpoints, date fixes by @b4s36t4 in #993
• Providers/ncompass by @vineye25 in #983
• fix: handle null content for tool use assistant message for bedrock by @VisargD in #992
• fix: add handling to detect all errors in retry handler by @VisargD in #991
• feat: add support for default guardrails by @VisargD in #986
• support passing image url for anthropic and vertex anthropic by @narengogi in #976
• support search mode param from pplx by @narengogi in #998
• changes to support cached streaming in grounding requests by @narengogi in #994
• 1.9.11 by @VisargD in #999

New Contributors

• @code-crusher made their first contribution in #978
• @urbanonymous made their first contribution in #970
• @vineye25 made their first contribution in #983

Full Changelog: v1.9.10...v1.9.11

v1.9.10

What's Changed

• add webm support for vertex prompting with images and videos by @narengogi in #967
• acuvity integration: fix guards and return data. by @abhijitherekar in #966
• chore: map usage object in openrouter stream chunk by @VisargD in #973
• 1.9.10 by @VisargD in #974

Full Changelog: v1.9.9...v1.9.10

v1.9.9

What's Changed

• chore: add acuvity scan handler in plugin mapping by @VisargD in #960
• chore: increase json to stream chunk size to avoid unnecessary extra … by @VisargD in #961
• 1.9.9 by @VisargD in #963

Full Changelog: v1.9.8...v1.9.9

v1.9.8

What's Changed

• fix: cleanups for batch & finetune by @b4s36t4 in #946
• Acuvity-portkey integration. by @abhijitherekar in #913
• Remove beta from Pangea AI-Guard path by @pangea-andrest in #948
• cache vertex generated token by @narengogi in #916
• fix: update logic for parsing errors while streaming in anthropic by @narengogi in #949
• Feat/finetune unified api by @sk-portkey in #943
• Added request json as params to conditional routing by @roh26it in #947
• fix: CVE-2024-21538 by @sk-portkey in #951
• fix: cleanup vertex batch output changes by @b4s36t4 in #956
• 1.9.8 by @VisargD in #957

New Contributors

• @abhijitherekar made their first contribution in #913

Full Changelog: v1.9.7...v1.9.8

v1.9.7

What's Changed

• feat: allow mutations in webhook plugin by @VisargD in #938
• feat: make timeout configurable for plugins by @VisargD in #940
• chore: add stream options param mapping for azure by @VisargD in #941
• 1.9.7 by @VisargD in #942

Full Changelog: v1.9.6...v1.9.7

v1.9.6

What's Changed

• add support for reasoning_effort in openai by @narengogi in #912
• docs: update mistral.md typo by @ethanknights in #909
• feat: azure files support by @b4s36t4 in #919
• fix: use correct param azure file id by @b4s36t4 in #924
• Fix fail condition in link checker by @mre in #917
• add support for google search tool by @narengogi in #923
• handle usage chunk in streaming responses and map model in gemini model response by @narengogi in #930
• chore: only add body for requests with content type by @VisargD in #935
• handle tool_calls mapping in gemini responses when there is one part tool call and one part text by @narengogi in #932
• 1.9.6 by @VisargD in #936

New Contributors

• @ethanknights made their first contribution in #909
• @mre made their first contribution in #917

Full Changelog: v1.9.5...v1.9.6

v1.9.5

What's Changed

• chore: transform request even for before request hooks failure by @VisargD in #900
• docs: Update readme.cn other deployment choices by @taosu0216 in #887
• feat: map usage object returned in pplx stream chunk by @VisargD in #903
• Chore: return transformed flag in redaction check result by @VisargD in #904
• Feat: support assumedRole auth type in bedrock guardrail plugin by @VisargD in #906
• chore: allow azure-ai to accept the extra-params from the headers by @b4s36t4 in #901
• 1.9.5 by @VisargD in #908

New Contributors

• @taosu0216 made their first contribution in #887

Full Changelog: v1.9.4...v1.9.5

v1.9.4

What's Changed

• support replicate as provider (proxy only) by @narengogi in #885
• chore: streamline bedrock plugin creds naming convention by @VisargD in #895
• fix: logprops for vertex and deepinfra streaming response by @narengogi in #896
• chore: streamline hooks result response generation logic by @VisargD in #898
• 1.9.4 by @VisargD in #899

Full Changelog: v1.9.3...v1.9.4