> ## Documentation Index
> Fetch the complete documentation index at: https://docs.portkey.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# November

**Portkey in November ❄️**

![](https://mintcdn.com/portkey-docs/QFjngWBmb6CT7QXC/images/changelog/netapp.jpeg?fit=max\&auto=format\&n=QFjngWBmb6CT7QXC\&q=85\&s=c948c6fd6f4c1d13ecd354ebe01de0d0)

We [won](https://www.linkedin.com/posts/1rohitagarwal_we-just-won-the-best-growth-strategy-award-activity-7272134964110868480-_mvc/?utm_source=share\&utm_medium=member_desktop) the NetApp Excellerator Award, launched [prompt.new](https://prompt.new/) for faster development, added folder organization and AI suggestions for prompt templates, introduced multi-workspace analytics.

Plus, there's now support for OpenAI's Realtime API and much more. Let's dive in!

## Summary

| Area | Key Updates |
| :- | :- |
| Platform | • See multi-workspace analytics & logs on a single dashboard • Support for Realtime API across OpenAI and Azure OpenAI • More granular security & access control settings • Organize your prompts in folders |
| Integrations | • Route to AWS Sagemaker models through Portkey • Support for xAI provider and Llama 3.3 & Gemini 2.0 Flash models • New `strictOpenAiCompliance` flag on the Gateway |
| Enterprise | • Support for AWS STS with IMDS/IRSA auth • Support for Azure Entra (formerly Active Directory) to manage Azure auth • Set budget limits with periodic resets • Support for any S3-compatible store for logging |
| Community | • Won NetApp's Best Growth Strategy Award • Hosted first Practitioners Dinner in Singapore • Weekly AI Engineering Office Hours |

#### Enterprise Spotlight

**When API Gateways Don't Cut It**\

As AI infrastructure becomes increasingly critical for enterprises, technology leaders are choosing Portkey's AI Gateway for their AI operations.

![](https://mintcdn.com/portkey-docs/QFjngWBmb6CT7QXC/images/changelog/premera-testimonial.jpeg?fit=max\&auto=format\&n=QFjngWBmb6CT7QXC\&q=85\&s=0a3e80474b9bc5f9520a84a4d7530ec2)

Akshay Darbari, Director of Platform Engineering at Premera Blue Cross

When Premera Blue Cross’ Director of Platform Engineering needed an AI Gateway, they chose Portkey. Why? Because traditional API gateways [weren’t built](https://portkey.ai/blog/ai-gateway-vs-api-gateway) for AI-first companies. Are you in the same boat? Schedule an \[expert consultation here]\([https://www.paloaltonetworks.com/ai-security/ai-gateway#:\~:text=See%20Prisma%20AIRS%20AI%20Gateway%20in%20Action](https://www.paloaltonetworks.com/ai-security/ai-gateway#:~:text=See%20Prisma%20AIRS%20AI%20Gateway%20in%20Action)

***

## Platform

#### Prompt Management

* Type [prompt.new](https://prompt.new) in your browser to spin up a new prompt playground! [Try it now →](https://prompt.new)
* Organize your prompt templates with folders and subfolders:

[https://www.youtube.com/embed/Edn4UBkVZZk](https://www.youtube.com/embed/Edn4UBkVZZk)

* Use AI to write and improve your prompts - right inside the playground:

[https://www.youtube.com/embed/1oU1oY0q9Ok](https://www.youtube.com/embed/1oU1oY0q9Ok)

* Add custom tags/labels like `staging`, `production` to any prompt version to track changes, and call them directly:

![](https://mintcdn.com/portkey-docs/nDVSDSKLH6tq-r5C/images/changelog/prompt-labels.gif?s=f52fb9e4b737f1b6f016c1b1b26bb4c8)

```ts @staging {2} theme={"system"}
const promptCompletion = portkey.prompts.completions.create({
    promptID: "pp-article-xx@staging",
    variables: {"":""}
})
```

```ts @dev {2} theme={"system"}
const promptCompletion = portkey.prompts.completions.create({
    promptID: "pp-article-xx@dev",
    variables: {"":""}
})
```

```ts @prod {2} theme={"system"}
const promptCompletion = portkey.prompts.completions.create({
    promptID: "pp-article-xx@prod",
    variables: {"":""}
})
```

* Each response inside the playground now gives metrics to monitor LLM throughput and latency

![](https://mintcdn.com/portkey-docs/QFjngWBmb6CT7QXC/images/changelog/prompt-metrics.png?fit=max\&auto=format\&n=QFjngWBmb6CT7QXC\&q=85\&s=920518a1108f399d49bb8150667a68ca)

#### Analytics

**Org-wide Executive Reports**\


![](https://mintcdn.com/portkey-docs/QFjngWBmb6CT7QXC/images/changelog/multi-workspace%202.gif?s=521163ff23200ded06f19c6d526b435d)

Monitor analytics and logs across all workspaces in your organization through a unified dashboard. This centralized view provides comprehensive insights into cost, performance, and accuracy metrics for your deployed AI applications.

* Track token usage patterns across requests & responses

![](https://mintcdn.com/portkey-docs/QFjngWBmb6CT7QXC/images/changelog/tokens-request-response.png?fit=max\&auto=format\&n=QFjngWBmb6CT7QXC\&q=85\&s=e6d988a9c2c0dd492d02ca79dc260720)

* You can now filter logs and analytics with specific Portkey API keys. This is useful if you are tying a particular key to an internal user and want to see their usage!

#### Enterprise

We've strengthened our enterprise authentication capabilities with comprehensive cloud provider integrations.

* Expanded AWS authentication options, for adding your Bedrock models or Sagemaker deployments:
  * IMDS-based auth (recommended for AWS environments)
  * IRSA-based auth for Kubernetes workloads
  * Role-based auth for non-AWS environments
  * STS integration with assumed roles
* Also expanded the Azure Integration:
  * Azure Entra (formerly Active Directory)
  * Managed identity support
* Granular access permissions for API Keys and Virtual Keys across your organization
* Support for sending Azure `deploymentConfig` while making Virtual Keys through API. [Docs](https://docs.portkey.ai/docs/api-reference/admin-api/control-plane/virtual-keys/create-virtual-key.md)

![](https://mintcdn.com/portkey-docs/QFjngWBmb6CT7QXC/images/changelog/security-settings.png?fit=max\&auto=format\&n=QFjngWBmb6CT7QXC\&q=85\&s=c2535939e4f921750fae1cb990adaba0)

***

#### More Customer Love

Felipe & team are building [beconfident](https://beconfident.app/), and here's what they had to say about Portkey:

> "Now that we've seen positive results, we're going to move all our prompts to Portkey."

![](https://mintcdn.com/portkey-docs/Hf1XgyjG_b79ym4Q/images/changelog/felipe-testimonial.jpeg?fit=max\&auto=format\&n=Hf1XgyjG_b79ym4Q\&q=85\&s=32651b124231d73d97f28ac82f8e85dc)

***

## Integrations

#### Providers

> [card] [AWS Sagemaker](https://docs.portkey.ai/docs/integrations/llms/aws-sagemaker.md)
>
> Add your Sagemaker deployments to Portkey easily

> [card] [xAI](https://docs.portkey.ai/docs/integrations/llms/x-ai.md)
>
> Call Grok models through Portkey!

> [card] [Ollama Tools](https://docs.portkey.ai/docs/integrations/llms/ollama.md)
>
> Tool calls are now supported on Ollama!

> [card] [Vertex AI Controlled Generations](https://docs.portkey.ai/docs/integrations/llms/vertex-ai.md)
>
> The Controlled Generations (read: `Structured Outputs`) feature on Vertex AI is now supported!

#### Libraries

> [card] [OpenAI Swarm](https://docs.portkey.ai/docs/integrations/agents/openai-swarm.md)
>
> Complete observability for Swarm agents

> [card] [Supabase](https://docs.portkey.ai/docs/integrations/libraries/supabase.md)
>
> Add LLM features to your Supabase apps

> [card] [Semantic Kernel](https://docs.portkey.ai/docs/api-reference/inference-api/sdks/c-sharp.md#microsoft-semantic-kernel-example)
>
> Use Portkey in your Microsoft Semantic Kernel apps to easily observe your requests and make them reliable

#### Guardrails

> [card] [Pangea](https://docs.portkey.ai/docs/product/guardrails/pangea.md)
>
> Enhanced security with PII detection and content moderation

## Resources

Essential reading for your AI infrastructure:

* [What is an LLM Gateway?](https://portkey.ai/blog/what-is-an-llm-gateway/): Complete introduction
* [O1 Models Analysis](https://portkey.ai/blog/openai-o1-model-card-analysis/): Understanding OpenAI's latest
* [LLM Gateway Guide](https://portkey.ai/blog/build-vs-buy-llm-gateways/): Making infrastructure choices
* [Chat platform Comparison](https://portkey.ai/blog/librechat-vs-openwebui/): LibreChat vs OpenWebUI
* [AI vs API Gateway](https://portkey.ai/blog/ai-gateway-vs-api-gateway/): Key differences
* [FinOps for GenAI](https://portkey.ai/blog/finops-to-optimize-genai-costs/): Optimization strategies

## Community

> [card] [Our Scaling Story](https://www.youtube.com/watch?v=9VbjUBze9Y0)
>
> Building our billion-request architecture

#### Office Hour

One thing we keep hearing from the Portkey community: you want to learn how other teams are solving production challenges and get the most out of the platform. Not through docs or tutorials, but through real conversations with fellow practitioners.

That's why we've started a new series of **AI Engineering Hours** since last week to bring the Portkey community together to discuss exactly this!

> [card] [Link to join the next office hour](https://docs.portkey.ai/docs/changelog/office-hour)

#### Practitioners' Dinner

We [hosted](https://www.linkedin.com/posts/vrushank-vyas_coming-back-from-the-first-portkey-practitioners-activity-7267647180188860416-a5Fs/?utm_source=share\&utm_medium=member_desktop) some of Singapore's leading Gen AI engineers & leaders for a roundtable conversation - one profound insight emerged: Companies serious about Gen AI have realized it's as much a platform engineering challenge as it is an AI challenge.

Curious what we mean? Read the [meetup note here](https://www.linkedin.com/posts/vrushank-vyas_coming-back-from-the-first-portkey-practitioners-activity-7267647180188860416-a5Fs/?utm_source=share\&utm_medium=member_desktop).

## Improvements

#### Providers

* Gemini: Enhanced message and media handling
* Bedrock: Improved message formatting
* Vertex AI: Added Zod validation

#### SDK

* Stream support for assistant threads
* Enhanced Pydantic compatibility
* Fixed semantic cache behavior
* Resolved Python Httpx proxy issues

***

## Support

> [card] [Need Help?](https://github.com/Portkey-AI/gateway/issues)
>
> Open an issue on GitHub

Special thanks to [harupy](https://github.com/harupy) and [Ignacio Gleser](https://www.linkedin.com/in/ignacio-gleser-3499b33a/) for their contributions!

***

> [card] [Portkey is now PRISMA AIRS AI Gateway. See it in action.](https://www.paloaltonetworks.in/ai-security/ai-gateway?utm_source=portkey\&utm_medium=referral\&utm_campaign=prisma_airs\&utm_content=docs_nav#contact)
>
> Contact Us


## Related topics

- [November](https://docs.portkey.ai/docs/changelog/2025/november.md)


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.