> ## Documentation Index
> Fetch the complete documentation index at: https://docs.portkey.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Overview

> Portkey connects with all major LLM providers and orchestration frameworks.

## Supported AI Providers

> [card] [OpenAI](https://docs.portkey.ai/docs/integrations/llms/openai.md)
>
> ![OpenAI](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/open-ai.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=b3b08a70cb73b31b1ed7bcafd21914db)

> [card] [Anthropic](https://docs.portkey.ai/docs/integrations/llms/anthropic.md)
>
> ![Anthropic](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/anthroic.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=b6ebc1679e55265655e79f1b2746b979)

> [card] [Azure OpenAI](https://docs.portkey.ai/docs/integrations/llms/azure-openai)
>
> ![Azure OpenAI](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/microsoft-assure.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=73f00317e6b24e9cde291b82f562f4ce)

> [card] [AWS Bedrock](https://docs.portkey.ai/docs/integrations/llms/aws-bedrock.md)
>
> ![AWS Bedrock](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/amazon.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=4a656bea056e147919d00319cc2830c5)

> [card] [Cerebras](https://docs.portkey.ai/docs/integrations/llms/cerebras.md)
>
> ![Cerebras](https://mintcdn.com/portkey-docs/090EMiR1_abG1plb/images/llms/cerebras.avif?fit=max\&auto=format\&n=090EMiR1_abG1plb\&q=85\&s=164d0b7b191c60fe46a2a18b2546f599)

> [card] [TypeSafe](https://docs.portkey.ai/docs/integrations/llms/typesafe.md)

> [card] [Google Gemini](https://docs.portkey.ai/docs/integrations/llms/gemini.md)
>
> ![Google Gemini](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/google-gemini.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=51ef69a71735169452388eaa38b7c2c7)

> [card] [Vertex AI](https://docs.portkey.ai/docs/integrations/llms/vertex-ai.md)
>
> ![Vertex AI](https://mintcdn.com/portkey-docs/TEsf28na2t53tvAY/images/supported-llm/vertex-ai.avif?fit=max\&auto=format\&n=TEsf28na2t53tvAY\&q=85\&s=165393b50c8c2518174f43717e9ea911)

> [card] [Cohere](https://docs.portkey.ai/docs/integrations/llms/cohere.md)
>
> ![Cohere](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/cohere.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=7b944707e1ba5589ee45a22233cea3d0)

> [card] [Perplexity AI](https://docs.portkey.ai/docs/integrations/llms/perplexity-ai.md)
>
> ![Perplexity AI](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/perplexity-ai.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=2eebcd1ca7795345898264808ff8adfa)

> [card] [AI21](https://docs.portkey.ai/docs/integrations/llms/ai21.md)
>
> ![AI21](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/ai21.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=1906335c8cf815a389679c649d8c70cb)

> [card] [Anyscale](https://docs.portkey.ai/docs/integrations/llms/anyscale-llama2-mistral-zephyr.md)
>
> ![Anyscale](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/anyscale.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=6cec37d0138bbc1a8ea018a375a5666e)

> [card] [Byollm](https://docs.portkey.ai/docs/integrations/llms/byollm.md)

> [card] [Dashscope](https://docs.portkey.ai/docs/integrations/llms/dashscope.md)
>
> ![Dashscope](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/dashscope.jpeg?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=9937e40f16146a814d60ba36f65cfb53)

> [card] [Deepbricks](https://docs.portkey.ai/docs/integrations/llms/deepbricks.md)
>
> ![Deepbricks](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/deepbricks.jpeg?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=b25e766887024b2a9dcc0f92ed6a9324)

> [card] [DeepInfra](https://docs.portkey.ai/docs/integrations/llms/deepinfra.md)
>
> ![DeepInfra](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/deepinfa.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=38edaeef2bd21746e18f572c69ad2b6a)

> [card] [DeepSeek](https://docs.portkey.ai/docs/integrations/llms/deepseek.md)
>
> ![DeepSeek](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/deepseek.webp?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=6fa32ca2df1f4394e1edf052c789f8d1)

> [card] [Fireworks AI](https://docs.portkey.ai/docs/integrations/llms/fireworks.md)
>
> ![Fireworks AI](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/fireworks.png?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=27e6bf1dc637592157e1a8adfed01b6b)

> [card] [Featherless AI](https://docs.portkey.ai/docs/integrations/llms/featherless.md)
>
> ![featherless-AI](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/featherless.png?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=b455634dcd126e0638217210cc5063b5)

> [card] [Github Models](https://docs.portkey.ai/docs/integrations/llms/github.md)
>
> ![Github](https://mintcdn.com/portkey-docs/wAHXB_jjwLt8bYcN/images/llms/github.png?fit=max\&auto=format\&n=wAHXB_jjwLt8bYcN\&q=85\&s=da3ad35c78699ef0420a6ae389a654b6)

> [card] [Google Palm](https://docs.portkey.ai/docs/integrations/llms/google-palm)
>
> ![Google Palm](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/google-palm.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=2f42cdc1c3375d07251d12aa7df41141)

> [card] [Groq](https://docs.portkey.ai/docs/integrations/llms/groq.md)
>
> ![Groq](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/groq.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=a12c4b98c75ccedf64fb0e245cbde15b)

> [card] [Jina AI](https://docs.portkey.ai/docs/integrations/llms/jina-ai.md)
>
> ![Jina AI](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/jina.png?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=e0b949fb2d21c2e20b2538a94410c424)

> [card] [Lambda](https://docs.portkey.ai/docs/integrations/llms/lambda.md)
>
> ![Lambda](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/lambda.png?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=8f2e5c7c7f0294c9d070b24a9764ceb8)

> [card] [Lemonfox AI](https://docs.portkey.ai/docs/integrations/llms/lemon-fox.md)
>
> ![Lemonfox AI](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/lemonfox-ai.png?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=b59457d8ad0bd864d69fd1006c5f1579)

> [card] [Lepton AI](https://docs.portkey.ai/docs/integrations/llms/lepton.md)
>
> ![Lepton AI](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/lepton.png?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=b61553c06b032e533c4c8099c7d554d3)

> [card] [Lingyi (01.ai)](https://docs.portkey.ai/docs/integrations/llms/lingyi-01.ai.md)
>
> ![Lingyi (01.ai)](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/lingyi.png?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=6a4f12ad76372b490cf9c90be043b132)

> [card] [LocalAI](https://docs.portkey.ai/docs/integrations/llms/local-ai.md)
>
> ![LocalAI](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/local.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=66a5a531868f78cc36e9ca8a02926a00)

> [card] [Mistral AI](https://docs.portkey.ai/docs/integrations/llms/mistral-ai.md)
>
> ![Mistral AI](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/mistral.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=34742b6abe583105eb11c9714d540be2)

> [card] [MonsterAPI](https://docs.portkey.ai/docs/integrations/llms/monster-api.md)
>
> ![MonsterAPI](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/monster.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=b4114bedc5a31fc5aa22f6424af7e094)

> [card] [Moonshot](https://docs.portkey.ai/docs/integrations/llms/moonshot.md)
>
> ![Moonshot](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/moonshoot.jpg?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=a1dcc84a24ecf115890e1bdcf839e2d5)

> [card] [nCompass](https://docs.portkey.ai/docs/integrations/llms/ncompass.md)
>
> ![nCompass](https://mintcdn.com/portkey-docs/wAHXB_jjwLt8bYcN/images/llms/ncompass.jpeg?fit=max\&auto=format\&n=wAHXB_jjwLt8bYcN\&q=85\&s=bb627878e4b4509c242a59f97a36a5de)

> [card] [Nebius](https://docs.portkey.ai/docs/integrations/llms/nebius.md)
>
> ![Nebius](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/nebius.jpeg?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=61eeb5dc5e66b8d71f69b8820599b434)

> [card] [Nomic AI](https://docs.portkey.ai/docs/integrations/llms/nomic.md)
>
> ![Nomic AI](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/nomic.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=50d0e9f727f1e24163af23cc97623ebc)

> [card] [Nscale](https://docs.portkey.ai/docs/integrations/llms/nscale.md)
>
> ![Nscale](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/nscale.jpeg?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=a63e1df5e079bc23d83a7a4c6be6d603)

> [card] [Ollama](https://docs.portkey.ai/docs/integrations/llms/ollama.md)
>
> ![Ollama](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/ollama.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=052070a60a7ebded38bdbf932797a00e)

> [card] [Openrouter](https://docs.portkey.ai/docs/integrations/llms/openrouter.md)
>
> ![Openrouter](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/openrouter.png?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=567caf524d96bfc8b1be46c4000e9183)

> [card] [Predibase](https://docs.portkey.ai/docs/integrations/llms/predibase.md)
>
> ![Predibase](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/predise.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=950b1363409807723c365f9d705336a0)

> [card] [Recraft AI](https://docs.portkey.ai/docs/integrations/llms/recraft-ai.md)
>
> ![Recraft](https://mintcdn.com/portkey-docs/wAHXB_jjwLt8bYcN/images/llms/recraft.jpeg?fit=max\&auto=format\&n=wAHXB_jjwLt8bYcN\&q=85\&s=7e61e28c9d2c4b96146bdbc34e9bbc8e)

> [card] [Siliconflow](https://docs.portkey.ai/docs/integrations/llms/siliconflow.md)
>
> ![Siliconflow](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/siliconflow.jpeg?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=5d3dcf010909733083f2b9404a92eac8)

> [card] [Snowflake Cortex](https://docs.portkey.ai/docs/integrations/llms/snowflake-cortex.md)
>
> ![Snowflake](https://mintcdn.com/portkey-docs/wAHXB_jjwLt8bYcN/images/llms/Snowflake%20Cortex%20Logo.png?fit=max\&auto=format\&n=wAHXB_jjwLt8bYcN\&q=85\&s=ea73d544bb6f1fd0c65a66706837626c)

> [card] [Stability AI](https://docs.portkey.ai/docs/integrations/llms/stability-ai.md)
>
> ![Stability AI](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/stability.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=de45dd855ab16b0348b25f723debeb5d)

> [card] [Together AI](https://docs.portkey.ai/docs/integrations/llms/together-ai.md)
>
> ![Together AI](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/together-ai.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=67f3ada48b6cca14ec05b6c192ee5ea8)

> [card] [Triton](https://docs.portkey.ai/docs/integrations/llms/triton.md)
>
> ![Triton](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/triton.png?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=ffe6fa4565f1a72c6107a840e6538550)

> [card] [Upstage](https://docs.portkey.ai/docs/integrations/llms/upstage.md)
>
> ![Upstage](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/upstage.jpeg?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=4d34772603a2eec35a47d82aeb424832)

> [card] [Voyage-AI](https://docs.portkey.ai/docs/integrations/llms/voyage-ai.md)
>
> ![Voyage-AI](https://mintcdn.com/portkey-docs/TEsf28na2t53tvAY/images/supported-llm/voyage.png?fit=max\&auto=format\&n=TEsf28na2t53tvAY\&q=85\&s=2e7aa450fb317389c1a37c216b55b073)

> [card] [Workers AI](https://docs.portkey.ai/docs/integrations/llms/workers-ai.md)
>
> ![Workers AI](https://mintcdn.com/portkey-docs/TEsf28na2t53tvAY/images/supported-llm/worksai.jpg?fit=max\&auto=format\&n=TEsf28na2t53tvAY\&q=85\&s=a6662000ffbf1198bcc8a9c00e0ea490)

> [card] [ZhipuAI](https://docs.portkey.ai/docs/integrations/llms/zhipu.md)
>
> ![ZhipuAI](https://mintcdn.com/portkey-docs/TEsf28na2t53tvAY/images/supported-llm/zhipu.avif?fit=max\&auto=format\&n=TEsf28na2t53tvAY\&q=85\&s=2ab3d315f23aee447d7b24a7569fc43a)

> [card] [Z AI](https://docs.portkey.ai/docs/integrations/llms/z-ai.md)
>
> ![Z-AI](https://mintcdn.com/portkey-docs/P3MBrqELkG0-6o96/images/supported-llm/z-ai.png?fit=max\&auto=format\&n=P3MBrqELkG0-6o96\&q=85\&s=63002883cccdeebe385afd0a09d75f88)

## Endpoints Supported

For a detailed breakdown of supported endpoints and features per provider, refer to the table below:

> [card] [Supported Providers](https://docs.portkey.ai/docs/provider-endpoints/supported-providers.md)

## Supported Frameworks

Portkey has native integrations with the following frameworks. Click to read their getting started guides.

> [card] [Langchain](https://docs.portkey.ai/docs/integrations/libraries/langchain-python.md)
>
> ![Langchain](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/langchain.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=619d8c26d49eaf96101813d18f4f51db)

> [card] [LlamaIndex](https://docs.portkey.ai/docs/integrations/libraries/llama-index-python.md)
>
> ![LlamaIndex](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/llama.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=18fb6bdddaa967390878b417579aaf49)

> [card] [Autogen](https://docs.portkey.ai/docs/integrations/libraries/autogen.md)
>
> ![Autogen](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/autogen.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=36a09d02cf6daed473a53223c58f88fb)

> [card] [Vercel](https://docs.portkey.ai/docs/integrations/libraries/vercel.md)
>
> ![Vercel](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/vercel.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=13d9d11ee227e346df5cbf6721ad894c)

> [card] [Instructor](https://docs.portkey.ai/docs/integrations/libraries/instructor.md)
>
> ![Instructor](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/instructor.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=1a2b0f166fa1403a8ed6fca9403c1dc2)

> [card] [DSPy](https://docs.portkey.ai/docs/integrations/libraries/dspy.md)
>
> ![DSPy](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/dspy.png?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=fd2772924a2e23547d777ecfd1041dbd)

> [card] [Promptfoo](https://docs.portkey.ai/docs/integrations/libraries/promptfoo.md)
>
> ![Promptfoo](https://mintcdn.com/portkey-docs/5HryU7OAng7DdvDd/images/supported-llm/prompftoo.avif?fit=max\&auto=format\&n=5HryU7OAng7DdvDd\&q=85\&s=a6a7dfc964c52ed8d25e96e17653634c)

Have a suggestion for an integration with Portkey? Drop us a message via [Portkey support](https://support.portkey.ai/forms/customer-portal-ticket-form).

While you're here, why not [give us a star](https://git.new/ai-gateway-docs)? It helps us a lot!

***

> [card] [Portkey is now PRISMA AIRS AI Gateway. See it in action.](https://www.paloaltonetworks.in/ai-security/ai-gateway?utm_source=portkey\&utm_medium=referral\&utm_campaign=prisma_airs\&utm_content=docs_nav#contact)
>
> Contact Us


## Related topics

- [Overview](https://docs.portkey.ai/docs/guides/integrations.md)


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.