InceptionLabs

InceptionLabs develops diffusion-based language models for fast, efficient text generation.

Even though InceptionLabs is a built-in provider, it still requires you to bring your own key because ngrok.ai inference is not available for it at this time.

Setup

Create an access key

Follow the quickstart to create an access key in app.ngrok.ai.

Store your InceptionLabs API key

Create a configuration

Create an access key configuration with an inceptionlabs routing rule and allow InceptionLabs in the access scope.

Assign and send requests

Assign the configuration to your access key and send requests with your access key:

from openai import OpenAI

client = OpenAI(
    base_url="https://gateway.ngrok.ai/v1",
    api_key="ng-xxxxx-g1-xxxxx",
)

response = client.chat.completions.create(
    model="inceptionlabs:mercury-coder-small-beta",
    messages=[{"role": "user", "content": "Hello!"}]
)

Available models

See the model catalog.

Next steps

Hyperbolic Inference.net

Concepts

Getting Started With

SDKs

Guides

Observability

Examples

Reference

API Reference

Setup

Available models

Next steps

​Setup

​Available models

​Next steps

Setup

Available models

Next steps