Portkey Features

Explore the powerful features of Portkey

AI Gateway

Connect to 250+ AI models using a single consistent API. Set up load balancers, automated fallbacks, caching, conditional routing, and more, seamlessly.

🌐 Universal API

Integrate with multiple AI models through a single API

💾 Caching

Implement simple and semantic caching for improved performance

🔄 Fallbacks

Set up automated fallbacks for enhanced reliability

🔀 Multimodal Capabilities

Handle various data types with multimodal AI capabilities

🔁 Automatic Retries

Implement automatic retries for improved resilience

🔌 Circuit Breaker

Configure per-strategy circuit protection and failure handling

⚖️ Load Balancing

Distribute workload efficiently across multiple models

🔑 Integrations

Manage access to LLMs

⏱️ Request Timeouts

Set and manage request timeouts

🐤 Canary Tests

Implement canary testing for safe deployments

🚦 Conditional Routing

Route requests based on specific conditions

💳 Budget Limits

Set and manage budget limits

Observability & Logs

Gain real-time insights, track key metrics, and streamline debugging with our OpenTelemetry-compliant system.

📜 Logs

Access and analyze detailed logs

🕵️ Tracing

Implement distributed tracing for request flows

📊 Analytics

Gain insights through comprehensive analytics

🧪 Filters

Apply filters for targeted analysis

🏷️ Metadata

Manage and utilize metadata effectively

💬 Feedback

Collect and analyze user feedback

Prompt Library

Collaborate with team members to create, templatize, and version prompt templates easily. Experiment across 250+ LLMs with a strong Publish/Release flow to deploy the prompts.

🧩 Prompt Templates

Create and manage reusable prompt templates

✂️ Prompt Partials

Utilize modular prompt components

{ } JSON Mode Prompting

Advanced prompting with JSON mode

Guardrails

Enforce Real-Time LLM Behavior with 50+ state-of-the-art AI guardrails, so that you can synchronously run Guardrails on your requests and route them with precision.

🛡️ Deterministic Guardrails

Implement rule-based safety checks

🤖 LLM-based Guardrails

Leverage AI for advanced content filtering

🤝 Partner Guardrails

Integrate third-party safety solutions

🎒 Bring Your Own

Customize guardrails to your needs

Agents

Natively integrate Portkey’s gateway, guardrails, and observability suite with leading agent frameworks and take them to production.

🤖 Autogen

👥 CrewAI

🔗 Langchain Agents

🦙 Llama Agents

φ PhiData

🔀 ControlFlow

🕸️ LangGraph

More Resources

📋 Portkey Plans

Compare different Portkey subscription plans

💬 Developer Forum

Join our community of developers

📚 API Reference

Explore our comprehensive API documentation

🏢 Portkey Enterprise

Learn about our enterprise solutions

🌐 Portkey Open Source

Contribute to our open-source projects