xAI (Grok)

Use xAI’s Grok models through Portkey for chat completions, function calling, and vision capabilities.

Quick Start

Get started with xAI in under 2 minutes:

Python

from portkey_ai import Portkey

# 1. Install: pip install portkey-ai
# 2. Add @x-ai provider in model catalog
# 3. Use it:

portkey = Portkey(api_key="PORTKEY_API_KEY")

response = portkey.chat.completions.create(
    model="@x-ai/grok-beta",
    messages=[{"role": "user", "content": "Hello!"}]
)

print(response.choices[0].message.content)

Add Provider in Model Catalog

Before making requests, add xAI to your Model Catalog:

1. Go to Model Catalog → Add Provider
2. Select xAI
3. Enter your xAI API key
4. Name your provider (e.g., x-ai)

Complete Setup Guide

See all setup options and detailed configuration instructions

---

xAI Capabilities

Tool Calling (Function Calling)

Python

from portkey_ai import Portkey

portkey = Portkey(api_key="PORTKEY_API_KEY")

tools = [{
    "type": "function",
    "function": {
        "name": "getWeather",
        "description": "Get the current weather",
        "parameters": {
            "type": "object",
            "properties": {
                "location": {"type": "string", "description": "City and state"},
                "unit": {"type": "string", "enum": ["celsius", "fahrenheit"]}
            },
            "required": ["location"]
        }
    }
}]

response = portkey.chat.completions.create(
    model="@x-ai/grok-beta",
    messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "What's the weather like in Delhi?"}
    ],
    tools=tools,
    tool_choice="auto"
)

print(response.choices[0].finish_reason)

Vision

Process images with Grok’s vision capabilities:

Python

from portkey_ai import Portkey

portkey = Portkey(api_key="PORTKEY_API_KEY")

response = portkey.chat.completions.create(
    model="@x-ai/grok-beta",
    messages=[{
            "role": "user",
            "content": [
                {"type": "text", "text": "What's in this image?"},
                {
                    "type": "image_url",
                "image_url": "https://upload.wikimedia.org/wikipedia/commons/thumb/d/dd/Gfp-wisconsin-madison-the-nature-boardwalk.jpg/2560px-Gfp-wisconsin-madison-the-nature-boardwalk.jpg"
        }
        ]
    }],
    max_tokens=300
)

print(response.choices[0].message.content)

---

Supported Models

xAI offers powerful models through Grok:

Model	Context Length	Description
grok-beta	131,072 tokens	Latest Grok model with enhanced capabilities
grok-2-1212	32,768 tokens	Previous generation Grok model

Check xAI’s documentation for the latest model information.

---

Next Steps

Gateway Configs

Add fallbacks, load balancing, and more

Observability

Monitor and trace your xAI requests

Guardrails

Enforce input/output checks on requests

Prompt Library

Manage and version your prompts

For complete SDK documentation:

SDK Reference

Complete Portkey SDK documentation

---

FAQs

How do I get an xAI API key?

Sign up at xAI and generate your API key from the console.

Is the xAI API free to use?

xAI typically provides free credits to start. Contact their support team for additional credits.

How do I handle xAI rate limits?

Check your current rate limits in the xAI console. Use Portkey’s load balancing to distribute requests across multiple providers.