Portkey Practitioners' Cookbooks

Strategies and examples for tackling the production challenges of LLMs with Portkey Gateway

Table of Contents

Please use the below table of contents to navigate through the cookbook.

Latest Notebooks

• Use models from Nvidia NIM with AI Gateway
• Monitor Llama Agents with Portkey!
• Create Synthetic Datasets using Nemotron-340B
• Comparing Top 10 LMSYS Models with AI Gateway.

getting-started

• Gentle introduction to Portkey Gateway
• Use Portkey cache to save LLM cost & time
• Retry automatically on LLM failures
• Image generation with Gateway
• Writing your first Gateway Config
• Automatically Fallback from OpenAI to Azure

View the official docs

providers

• OpenAI
• Anthropic
• Mistral
• Vercel AI
• Groq
• Mistral
• Deepinfra
• Segmind
• Nvidia

View the full list of providers here.

integrations

• Langchain
• Llama Index
• Instructor
• Phidata

View the full list of integrations here.

monitoring-agents

• Autogen
• CrewAI
• Llama Agents
• ControlFlow

contributing

This is a community-driven resource! We welcome ideas, improvements, quick fixes, and deeper contributions that help the community.

Request Cookbooks here. Check out our contribution guidelines here.