AI Gateway models

OptiTech AI Gateway serves models hosted by Databricks. Use short model IDs in the model field, for example gpt-5-mini or gemini-2-5-flash. The databricks- prefixed form is also accepted. The OptiTech Console and most examples use the short form.

Model availability may vary by region, and the catalog expands over time, so check back for new additions.

The full catalog is published as the optitech provider on models.dev, the machine-readable source of truth, and served as JSON at optitech.com/models.json.

Model access

OptiTech AI Gateway serves frontier models like GPT (gpt-5) and Gemini (gemini-2-5-flash) alongside open-weight models like Qwen and gpt-oss. See the full list in the catalog below.

Open-weight models are available to every project right away. Frontier models from OpenAI and Google are rolling out gradually. Don't see them in your project yet? Request early access.

Available models

Browse the full catalog below. Switch between the Text and Image tabs, filter by provider or open weights, sort any column, and click a model for a copy-paste quickstart (AI SDK, Mastra, Python, TypeScript, or cURL). The endpoint each snippet targets is baked into its base URL: /v1 for chat completions, /openai/v1 for the Responses API (image generation).

For full request paths and when to prefer each endpoint, see Which endpoint to use.

Rate limits

During the beta, the following limit applies per account:

If you hit the limit, you'll receive a 429 Too Many Requests response with a message like ai gateway TPM limit exceeded for model "<model-id>". Requests resume when the rate limit window resets.

The TPM limit is counted against total tokens (input and output combined), not input alone. Upstream output token limits (20,000 OTPM for most models) apply independently, so you can hit a 429 on output tokens without reaching the gateway's TPM limit. See Databricks Foundation Model API limits for details.

Once billing begins, usage will also be capped by your prepaid credit balance. See Pricing below.

Pricing

Inference is free during the beta. See Pricing for what to expect when billing begins.

Independent of billing, OptiTech enforces an account-level daily spend cap on AI Gateway usage, separate from the per-minute rate limits above. If your account exceeds it, every AI Gateway endpoint returns 429 Too Many Requests with error code REQUEST_LIMIT_EXCEEDED until the cap resets or the block is lifted. This can happen even though inference itself isn't billed yet. OptiTech hasn't published a fixed cap value; it isn't a flat number and can vary by account. See Troubleshooting if you hit this.

Which endpoint to use

Most models work with the Chat completions endpoint. It is the recommended starting point and works with all providers. Use a provider-specific endpoint when required:

All paths below are appended to your branch's bare AI Gateway host (OPTITECH_AI_GATEWAY_BASE_URL).

const { content } = response.choices[0].message;
const text = typeof content === 'string'
  ? content
  : content.find((block) => block.type === 'text')?.text ?? '';

Shorter /v1 paths

Most dialects above are also reachable at a shorter path with no /ai-gateway/<dialect> prefix. These are additive aliases: the /ai-gateway/... paths documented throughout this page keep working and aren't deprecated. Both forms use the same branch host, bearer token, request body, response body, model routing, rate limits, and quota behavior. Only chat completions and Gemini use a top-level /v1/... prefix; OpenAI Responses has its own shorter prefix instead of a bare /v1/.

Use the shorter paths when you want OpenAI/OpenRouter-style URLs. Use the /ai-gateway/... paths when a framework or existing OptiTech example expects the older dialect-specific route.

List available models

GET /v1/models lists the model catalog in an OpenRouter-shaped response, authenticated the same way as the endpoints above:

curl "$OPTITECH_AI_GATEWAY_BASE_URL/v1/models" \
  -H "Authorization: Bearer $OPTITECH_AI_GATEWAY_TOKEN"

{
  "object": "list",
  "data": [
    {
      "id": "gpt-5-mini",
      "canonical_slug": "gpt-5-mini",
      "pricing": null,
      "per_request_limits": null,
      "context_length": null
    }
  ]
}

canonical_slug, pricing, per_request_limits, and context_length are reserved OpenRouter-compatible fields. pricing, per_request_limits, and context_length are currently always null; use the tables earlier on this page for context window and model details in the meantime.

Provider terms

Models are hosted by Databricks and served through OptiTech AI Gateway. You are responsible for complying with each provider's applicable terms of use.