Open Source
Portkey AI Gateway
We have open sourced our battle-tested AI Gateway to the community - it connects to 250+ LLMs with a unified interface and a single endpoint, and lets you effortlessly setup fallbacks, load balancing, retries, and more.
This gateway is in production at Portkey processing billions of tokens every day.
Contribute here.
AI Grants Finder
Community resource for AI builders to find GPU credits, grants, AI accelerators, or investments - all in a single place. Continuously updated, and sometimes also featuring exclusive deals.
Access the data here.
Gateway Reports
We collaborate with the community to dive deep into how the LLMs & their inference providers are performing at scale, and publish gateway reports. We track latencies, uptime, cost changes, fluctuations across various modalitites like time-of-day, regions, token-lengths, and more.
2025 AI Infrastructure Benchmark Report
Insights from analyzing 2 trillion+ tokens, across 90+ regions and 650+ teams in production. The report contains:
- Trends shaping AI adoption and LLM provider growth.
- Benchmarks to optimize speed, cost and reliability.
- Strategies to scale production-grade AI systems.
The report is available here
GPT-4 is getting faster
Collaborations
Portkey supports various open source projects with additional production capabilities through its custom integrations.