OpenRouter

OpenRouter is a unified API that provides access to hundreds of models from providers like Anthropic, Google, Meta, Mistral, and more through a single endpoint.

Even though OpenRouter is a built-in provider, it still requires you to bring your own key because ngrok.ai inference is not available for it at this time.

Setup

Create an access key

Follow the quickstart to create an access key in app.ngrok.ai.

Store your OpenRouter API key

Create an account at openrouter.ai and generate an API key from your dashboard. Then add a provider key.

Create a configuration

Create an access key configuration with an openrouter routing rule and allow OpenRouter in the access scope.

Assign and send requests

Assign the configuration to your access key and send requests with your access key:

from openai import OpenAI

client = OpenAI(
    base_url="https://gateway.ngrok.ai/v1",
    api_key="ng-xxxxx-g1-xxxxx",
)

response = client.chat.completions.create(
    model="openrouter:anthropic/claude-3.5-sonnet",
    messages=[{"role": "user", "content": "Hello!"}]
)

Model names

Always prefix OpenRouter model IDs with openrouter:. Without the prefix, the gateway may route to the native provider instead of OpenRouter.

OpenRouter uses a provider/model format for its model IDs. When calling through the ngrok AI Gateway, prefix with openrouter::

What you want	Model string to use
Anthropic Claude via OpenRouter	`openrouter:anthropic/claude-3.5-sonnet`
Google Gemini via OpenRouter	`openrouter:google/gemini-2.0-flash-001`
Meta Llama via OpenRouter	`openrouter:meta-llama/llama-3.1-8b-instruct`
Mistral via OpenRouter	`openrouter:mistralai/mistral-7b-instruct`

The openrouter: prefix tells the gateway to route to OpenRouter specifically, not to the native provider. Without it, anthropic/claude-3.5-sonnet would fail—the gateway doesn’t recognize the slash-separated format as a valid model without the provider prefix. For the full list of models OpenRouter supports, see openrouter.ai/models.

Available models

See the model catalog.

Next steps

Provider Keys
Access Key Configurations
Multi-provider failover: failover patterns
Choose a model: model IDs and provider prefixes

Anthropic Google

Concepts

Getting Started With

SDKs

Guides

Observability

Examples

Reference

API Reference

Setup

Model names

Available models

Next steps

​Setup

​Model names

​Available models

​Next steps

Setup

Model names

Available models

Next steps