Gateway to Other APIs

Access any custom provider endpoint through Portkey API

This feature is available on all Portkey plans.

Portkey API has first-class support for monitoring and routing your requests to 10+ provider endpoints, like /chat/completions, /audio, /embeddings, etc. We also make these endpoints work across 250+ different LLMs.

However, there are still many endpoints like Cohere’s /rerank or Deepgram’s /listen that are uncommon or have niche use cases.

With the Gateway to Other APIs feature, you can route to any custom provider endpoint using Portkey (including the ones hosted on your private setups) and get complete logging & monitoring for all your requests.

Supported HTTP Methods

POST

GET

PUT

DELETE

Both the REST API and Portkey SDKs (Python, NodeJS) support all of these HTTP methods.

How to Integrate

1. Get your Portkey API key
2. Add your provider details to Portkey
3. Make your request using Portkey’s API or SDK

1. Get Portkey API Key

Create or log in to your Portkey account. Grab your account’s API key from the “API Keys” page.

2. Add Provider Details

Choose one of these authentication methods:

Option 1. Generate a Virtual Key (Recommended)

Portkey integrates with 40+ LLM providers. Add your provider credentials (such as API key) to Portkey, and get a virtual key that you can use to authenticate and send your requests.

cURL

curl https://api.portkey.ai/v1/rerank \
  -H "Content-Type: application/json" \
  -H "x-portkey-api-key: $PORTKEY_API_KEY" \
  -H "x-portkey-virtual-key: $PORTKEY_PROVIDER" \

Creating virtual keys lets you:

• Manage all credentials in one place
• Rotate between different provider keys
• Set custom budget limits & rate limits per key

Option 2. Direct Provider Auth

Set the provider name from one of Portkey’s 40+ supported providers list and use your provider credentials directly with each request.

cURL

curl https://api.portkey.ai/v1/rerank \
  -H "Content-Type: application/json" \
  -H "x-portkey-api-key: $PORTKEY_API_KEY" \
  -H "x-portkey-provider: cohere" \
  -H "Authorization: Bearer $COHERE_API_KEY" \

Option 3. Custom Hosted Endpoint

Route to your privately hosted model endpoints.

• Choose a compatible provider type (e.g., openai, cohere)
• Provide your endpoint URL with customHost
• Include Authentication if needed

cURL

curl https://api.portkey.ai/v1/rerank \
  -H "Content-Type: application/json" \
  -H "x-portkey-api-key: $PORTKEY_API_KEY" \
  -H "x-portkey-provider: cohere" \
  -H "x-portkey-custom-host: https://182.145.24.5:8080/v1" \
  -H "Authorization: Bearer $COHERE_API_KEY" \

3. Make Requests

cURL

Construct your request URL:

1. Portkey Gateway base URL remains same: https://api.portkey.ai/v1
2. Append your custom endpoint at the end of the URL: https://api.portkey.ai/v1/{provider-endpoint}

POST

curl --request POST \
     --url https://api.portkey.ai/v1/rerank \
     --header 'Content-Type: application/json' \
     --header 'x-portkey-api-key: $PORTKEY_API_KEY' \
     --header 'x-portkey-virtual-key: $COHERE_VIRTUAL_KEY' \
     --data '{
       "model": "rerank-english-v2.0",
       "query": "What is machine learning?",
       "documents": [
         "Machine learning is a branch of AI focused on building systems that learn from data.",
         "Data science involves analyzing and interpreting complex data sets."
       ]
     }'

End-to-end Example

Cohere Rerank Integration

A complete example showing document reranking with Cohere:

from portkey_ai import Portkey

portkey = Portkey(
    api_key="PORTKEY_API_KEY",
    provider="@COHERE_VIRTUAL_KEY"
)

response = portkey.post(
    '/rerank',
    return_documents=False,
    max_chunks_per_doc=10,
    model="rerank-english-v2.0",
    query="What is the capital of the United States?",
    documents=[
        "Carson City is the capital city of the American state of Nevada.",
        "Washington, D.C. is the capital of the United States.",
        "Capital punishment has existed in the United States since before its founding."
    ]
)

Caveats & Considerations

• Response objects are returned exactly as received from the provider, without Portkey transformations
• REST API supports all HTTP methods: POST, GET, PUT, and DELETE
• SDK supports all HTTP methods: POST, GET, PUT, and DELETE
• There are no limitations on which provider endpoints can be proxied
• All requests are logged and monitored through your Portkey dashboard

Support

Need help? Join our Developer Forum for support and discussions.