Novita AI

Use Novita AI’s inference platform through Portkey for diverse model access.

Quick Start

Get started with Novita AI in under 2 minutes:

Python

from portkey_ai import Portkey

# 1. Install: pip install portkey-ai
# 2. Add @novita-ai provider in model catalog
# 3. Use it:

portkey = Portkey(api_key="PORTKEY_API_KEY")

response = portkey.chat.completions.create(
    model="@novita-ai/Nous-Hermes-2-Mixtral-8x7B-DPO",
    messages=[{"role": "user", "content": "Hello!"}]
)

print(response.choices[0].message.content)

Add Provider in Model Catalog

Before making requests, add Novita AI to your Model Catalog:

1. Go to Model Catalog → Add Provider
2. Select Novita AI
3. Enter your Novita AI API key
4. Name your provider (e.g., novita-ai)

Complete Setup Guide

See all setup options and detailed configuration instructions

---

Supported Models

Novita AI provides access to diverse models:

Check Novita AI’s documentation for the complete model list.

---

Next Steps

Gateway Configs

Add fallbacks, load balancing, and more

Observability

Monitor and trace your Novita AI requests

Prompt Library

Manage and version your prompts

Metadata

Add custom metadata to requests

For complete SDK documentation:

SDK Reference

Complete Portkey SDK documentation