What you’ll need
- Zed installed.
- An access key from app.ngrok.ai.
Add the gateway as a provider
Add the provider to your Zedsettings.json:
nameis the model name Zed sends to the gateway: a model ID from the model catalog, orprovider:modelto pin a providermax_tokensis the model’s context windowcapabilitiesis optional; set"images": trueinside it for models that accept images
Test the connection
Create a new agent thread, pick one of your models from the selector at the bottom of the agent panel’s message editor, and send a prompt:Explain what a hash map is in two sentences.
Use a model you run yourself
To reach a model on your own machine, register it as a custom provider, then add itsprovider:model name to available_models, such as ollama:llama3.2.
See Use a model you run yourself for the full setup.
Next steps
- Restrict providers and models: Scope what an access key can call
- Configure fallback models: Try another model when the first one fails
- Observability: See which model served each request