> ## Documentation Index
> Fetch the complete documentation index at: https://ngrok.com/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Model Catalog

> Built-in providers and models available on ngrok.ai.

ngrok.ai maintains a catalog of known providers and models. This catalog enables automatic model resolution, routing, model validation, and rich metadata for selection strategies.

## How the catalog works

When you send a request with a model name like `gpt-4o`, the gateway automatically:

1. Resolves the model using the catalog
2. Determines the correct provider (for example, OpenAI) and applies the appropriate upstream credentials
3. Routes the request to the provider’s endpoint

If you want to explicitly select a provider, use the `provider:model` format in the model string. For example:

```json theme={null}
{
  "model": "openai:gpt-4o",
  "messages": [{"role": "user", "content": "Hello"}]
}
```

## Built-in providers

The catalog includes built-in providers—public AI APIs with known models and routing metadata. You can manage them on the [Providers page](https://app.ngrok.ai/providers).

### Authentication

Send traffic using an [access key](/docs/ai-gateway/concepts/access-keys). This key authenticates your requests to the gateway, not to the upstream provider.

### Billing and provider credentials

The AI Gateway splits billing into two parts: using the gateway and paying the model provider.

Some built-in providers don’t need a provider key. You can spot them in the tables above—if “Provider key required” says “No,” you can start using them right away as long as you have credits. The gateway takes care of authentication and charges your credits.

Other providers do need a key. For those, add your provider key in app.ngrok.ai. The provider will bill you directly for model usage, and your credits will cover the gateway fee. This is often called BYOK (bring your own key).

### OpenAI

| Field                     | Value                             |
| ------------------------- | --------------------------------- |
| **Provider ID**           | `openai`                          |
| **Aliases**               | `openAI`, `open-ai`, `open-AI`    |
| **Base URL**              | `https://api.openai.com/v1/`      |
| **Website**               | [openai.com](https://openai.com/) |
| **Provider key required** | No                                |

[How to use OpenAI →](/docs/ai-gateway/providers/openai)

#### OpenAI models

| Model ID                 | Display Name           | Context Window | Output Tokens | Modalities  |
| ------------------------ | ---------------------- | -------------- | ------------- | ----------- |
| `gpt-5.6-luna`           | GPT-5.6 Luna           | 1,050,000      | 128,000       | text, image |
| `gpt-5.6-terra`          | GPT-5.6 Terra          | 1,050,000      | 128,000       | text, image |
| `gpt-5.6-sol`            | GPT-5.6 Sol            | 1,050,000      | 128,000       | text, image |
| `gpt-5.5-pro`            | GPT-5.5 Pro            | 1,050,000      | 128,000       | text, image |
| `gpt-5.5`                | GPT-5.5                | 1,050,000      | 128,000       | text, image |
| `gpt-5.4-nano`           | GPT-5.4 Nano           | 400,000        | 128,000       | text, image |
| `gpt-5.4-mini`           | GPT-5.4 Mini           | 400,000        | 128,000       | text, image |
| `gpt-5.4-pro`            | GPT-5.4 Pro            | 1,050,000      | 128,000       | text, image |
| `gpt-5.4`                | GPT-5.4                | 1,050,000      | 128,000       | text, image |
| `gpt-5.3-codex`          | GPT-5.3-Codex          | 400,000        | 128,000       | text, image |
| `gpt-5.2-codex`          | GPT-5.2-Codex          | 400,000        | 128,000       | text, image |
| `gpt-5.2-pro`            | GPT-5.2 Pro            | 400,000        | 128,000       | text, image |
| `gpt-5.2-chat-latest`    | GPT-5.2 Chat Latest    | 128,000        | 16,384        | text, image |
| `gpt-5.2`                | GPT-5.2                | 400,000        | 128,000       | text, image |
| `gpt-5.1-chat-latest`    | GPT-5.1 Chat Latest    | 128,000        | 16,384        | text, image |
| `gpt-5.1`                | GPT-5.1                | 400,000        | 128,000       | text, image |
| `gpt-5-pro`              | GPT-5 Pro              | 400,000        | 272,000       | text, image |
| `gpt-5-chat-latest`      | GPT-5 Chat             | 128,000        | 16,384        | text, image |
| `gpt-5-nano`             | GPT-5 Nano             | 400,000        | 128,000       | text, image |
| `gpt-5-mini`             | GPT-5 Mini             | 400,000        | 128,000       | text, image |
| `gpt-5`                  | GPT-5                  | 400,000        | 128,000       | text, image |
| `o3-deep-research`       | O3-Deep-Research       | 200,000        | 100,000       | text, image |
| `o4-mini-deep-research`  | O4-Mini-Deep-Research  | 200,000        | 100,000       | text, image |
| `o3-pro`                 | O3-Pro                 | 200,000        | 100,000       | text, image |
| `o3`                     | O3                     | 200,000        | 100,000       | text, image |
| `o4-mini`                | O4-Mini                | 200,000        | 100,000       | text, image |
| `gpt-4.1-nano`           | GPT-4.1 nano           | 1,047,576      | 32,768        | text, image |
| `gpt-4.1-mini`           | GPT-4.1 mini           | 1,047,576      | 32,768        | text, image |
| `gpt-4.1`                | GPT-4.1                | 1,047,576      | 32,768        | text, image |
| `o1-pro`                 | O1-Pro                 | 200,000        | 100,000       | text, image |
| `o3-mini`                | O3 Mini                | 200,000        | 100,000       | text        |
| `o1`                     | O1                     | 200,000        | 100,000       | text, image |
| `gpt-4o-mini`            | GPT-4o Mini            | 128,000        | 16,384        | text, image |
| `gpt-4o`                 | GPT-4o                 | 128,000        | 16,384        | text, image |
| `gpt-4-turbo`            | GPT-4 Turbo            | 128,000        | 4,096         | text, image |
| `gpt-3.5-turbo-instruct` | GPT-3.5 Turbo Instruct | 4,096          | 4,096         | text        |
| `gpt-4`                  | GPT-4                  | 8,192          | 8,192         | text        |
| `gpt-3.5-turbo`          | GPT-3.5 Turbo          | 16,385         | 4,096         | text        |

***

### Anthropic

| Field                     | Value                                   |
| ------------------------- | --------------------------------------- |
| **Provider ID**           | `anthropic`                             |
| **Aliases**               | `Anthropic`                             |
| **Base URL**              | `https://api.anthropic.com/v1/`         |
| **Website**               | [anthropic.com](https://anthropic.com/) |
| **Provider key required** | No                                      |

[How to use Anthropic →](/docs/ai-gateway/providers/anthropic)

#### Anthropic models

| Model ID            | Display Name      | Context Window | Output Tokens | Modalities        |
| ------------------- | ----------------- | -------------- | ------------- | ----------------- |
| `claude-opus-5`     | Claude Opus 5     | 1,000,000      | 128,000       | text, image, file |
| `claude-sonnet-5`   | Claude Sonnet 5   | 1,000,000      | 128,000       | text, image, file |
| `claude-fable-5`    | Claude Fable 5    | 1,000,000      | 128,000       | text, image, file |
| `claude-opus-4-8`   | Claude Opus 4.8   | 1,000,000      | 128,000       | text, image, file |
| `claude-opus-4-7`   | Claude Opus 4.7   | 1,000,000      | 128,000       | text, image, file |
| `claude-sonnet-4-6` | Claude Sonnet 4.6 | 1,000,000      | 128,000       | text, image, file |
| `claude-opus-4-6`   | Claude Opus 4.6   | 1,000,000      | 128,000       | text, image, file |
| `claude-opus-4-5`   | Claude Opus 4.5   | 200,000        | 64,000        | text, image, file |
| `claude-haiku-4-5`  | Claude Haiku 4.5  | 200,000        | 64,000        | text, image, file |
| `claude-sonnet-4-5` | Claude Sonnet 4.5 | 200,000        | 64,000        | text, image, file |
| `claude-opus-4-1`   | Claude Opus 4.1   | 200,000        | 32,000        | text, image, file |

***

### Google

| Field                     | Value                                                      |
| ------------------------- | ---------------------------------------------------------- |
| **Provider ID**           | `google`                                                   |
| **Aliases**               | `Google`, `gemini`                                         |
| **Base URL**              | `https://generativelanguage.googleapis.com/v1beta/openai/` |
| **Website**               | [aistudio.google.com](https://aistudio.google.com/)        |
| **Provider key required** | Yes                                                        |

[How to use Google →](/docs/ai-gateway/providers/google)

#### Google models

| Model ID                             | Display Name                        | Context Window | Output Tokens | Modalities                      |
| ------------------------------------ | ----------------------------------- | -------------- | ------------- | ------------------------------- |
| `gemini-3.5-flash-lite`              | Gemini 3.5 Flash-Lite               | 1,048,576      | 65,536        | text, image, audio, video, file |
| `gemini-3.6-flash`                   | Gemini 3.6 Flash                    | 1,048,576      | 65,536        | text, image, audio, video, file |
| `gemini-3.5-flash`                   | Gemini 3.5 Flash                    | 1,048,576      | 65,536        | text, image, audio, video, file |
| `gemini-3.1-flash-lite`              | Gemini 3.1 Flash-Lite               | 1,048,576      | 65,536        | text, image, audio, video, file |
| `gemini-3.1-pro-preview-customtools` | Gemini 3.1 Pro Preview Custom Tools | 1,048,576      | 65,536        | text, image, audio, video, file |
| `gemini-3.1-pro-preview`             | Gemini 3.1 Pro Preview              | 1,048,576      | 65,536        | text, image, audio, video, file |
| `gemini-3-flash-preview`             | Gemini 3 Flash Preview              | 1,048,576      | 65,536        | text, image, audio, video, file |
| `gemini-2.5-flash-lite`              | Gemini 2.5 Flash-Lite               | 1,048,576      | 65,536        | text, image, audio, video, file |
| `gemini-2.5-flash`                   | Gemini 2.5 Flash                    | 1,048,576      | 65,536        | text, image, audio, video, file |
| `gemini-2.5-pro`                     | Gemini 2.5 Pro                      | 1,048,576      | 65,536        | text, image, audio, video, file |

***

### DeepSeek

| Field                     | Value                                     |
| ------------------------- | ----------------------------------------- |
| **Provider ID**           | `deepseek`                                |
| **Aliases**               | `DeepSeek`, `deep-seek`                   |
| **Base URL**              | `https://api.deepseek.com`                |
| **Website**               | [deepseek.com](https://www.deepseek.com/) |
| **Provider key required** | Yes                                       |

[How to use DeepSeek →](/docs/ai-gateway/providers/deepseek)

#### DeepSeek models

| Model ID            | Display Name      | Context Window | Output Tokens | Modalities |
| ------------------- | ----------------- | -------------- | ------------- | ---------- |
| `deepseek-v4-flash` | DeepSeek V4 Flash | 1,000,000      | 384,000       | text       |
| `deepseek-v4-pro`   | DeepSeek V4 Pro   | 1,000,000      | 384,000       | text       |

***

### Groq

| Field                     | Value                            |
| ------------------------- | -------------------------------- |
| **Provider ID**           | `groq`                           |
| **Base URL**              | `https://api.groq.com/openai/v1` |
| **Website**               | [groq.com](https://groq.com/)    |
| **Provider key required** | Yes                              |

[How to use Groq →](/docs/ai-gateway/providers/groq)

Groq provides AI inference powered by their custom LPU (Language Processing Unit) hardware.

#### Groq models

| Model ID                              | Display Name             | Context Window | Output Tokens | Modalities |
| ------------------------------------- | ------------------------ | -------------- | ------------- | ---------- |
| `openai/gpt-oss-safeguard-20b`        | GPT-OSS Safeguard 20B    | 131,072        | 65,536        | text       |
| `openai/gpt-oss-20b`                  | GPT OSS 20B              | 131,072        | 65,536        | text       |
| `openai/gpt-oss-120b`                 | GPT OSS 120B             | 131,072        | 65,536        | text       |
| `meta-llama/llama-prompt-guard-2-86m` | Llama Prompt Guard 2 86M | 512            | 512           | text       |
| `meta-llama/llama-prompt-guard-2-22m` | Llama Prompt Guard 2 22M | 512            | 512           | text       |
| `meta-llama/llama-3.3-70b-versatile`  | Llama 3.3 70B Versatile  | 131,072        | 32,768        | text       |
| `meta-llama/llama-3.1-8b-instant`     | Llama 3.1 8B Instant     | 131,072        | 131,072       | text       |

***

### Moonshot AI

| Field                     | Value                                                   |
| ------------------------- | ------------------------------------------------------- |
| **Provider ID**           | `moonshotai`                                            |
| **Aliases**               | `Moonshot AI`, `Moonshot`, `Kimi`, `kimi.ai`, `kimi-ai` |
| **Base URL**              | `https://api.moonshot.ai/v1`                            |
| **Website**               | [moonshot.ai](https://www.moonshot.ai/)                 |
| **Provider key required** | Yes                                                     |

#### Moonshot AI models

| Model ID                   | Display Name             | Context Window | Output Tokens | Modalities         |
| -------------------------- | ------------------------ | -------------- | ------------- | ------------------ |
| `kimi-k3`                  | Kimi K3                  | 1,048,576      | 1,048,576     | text, image, video |
| `kimi-k2.7-code-highspeed` | Kimi K2.7 Code HighSpeed | 262,144        | 262,144       | text, image, video |
| `kimi-k2.7-code`           | Kimi K2.7 Code           | 262,144        | 262,144       | text, image, video |
| `kimi-k2.6`                | Kimi K2.6                | 262,144        | 262,144       | text, image, video |

***

### Z.ai

| Field                     | Value                                     |
| ------------------------- | ----------------------------------------- |
| **Provider ID**           | `z-ai`                                    |
| **Aliases**               | `Z.ai`, `ZhipuAI`, `Zhipu AI`, `zhipu-ai` |
| **Base URL**              | `https://api.z.ai/api/paas/v4`            |
| **Website**               | [z.ai](https://z.ai/model-api)            |
| **Provider key required** | Yes                                       |

#### Z.ai models

| Model ID              | Display Name        | Context Window | Output Tokens | Modalities |
| --------------------- | ------------------- | -------------- | ------------- | ---------- |
| `glm-5.2`             | GLM-5.2             | 1,000,000      | 131,072       | text       |
| `glm-5.1`             | GLM-5.1             | 200,000        | 131,072       | text       |
| `glm-5-turbo`         | GLM-5-Turbo         | 200,000        | 131,072       | text       |
| `glm-5`               | GLM-5               | 200,000        | 131,072       | text       |
| `glm-4.7-flash`       | GLM-4.7-Flash       | 200,000        | 131,072       | text       |
| `glm-4.7-flashx`      | GLM-4.7-FlashX      | 200,000        | 131,072       | text       |
| `glm-4.7`             | GLM-4.7             | 200,000        | 131,072       | text       |
| `glm-4.6`             | GLM-4.6             | 200,000        | 131,072       | text       |
| `glm-4.5-flash`       | GLM-4.5-Flash       | 128,000        | 98,304        | text       |
| `glm-4.5-airx`        | GLM-4.5-AirX        | 128,000        | 98,304        | text       |
| `glm-4.5-air`         | GLM-4.5-Air         | 128,000        | 98,304        | text       |
| `glm-4.5-x`           | GLM-4.5-X           | 128,000        | 98,304        | text       |
| `glm-4.5`             | GLM-4.5             | 128,000        | 98,304        | text       |
| `glm-4-32b-0414-128k` | GLM-4-32B-0414-128K | 128,000        | 16,000        | text       |

***

### OpenRouter

| Field                     | Value                                   |
| ------------------------- | --------------------------------------- |
| **Provider ID**           | `openrouter`                            |
| **Base URL**              | `https://openrouter.ai/api/v1/`         |
| **Website**               | [openrouter.ai](https://openrouter.ai/) |
| **Provider key required** | Yes                                     |

[How to use OpenRouter →](/docs/ai-gateway/providers/openrouter)

OpenRouter is a unified API that provides access to multiple AI models from various providers through a single endpoint.

***

### Hyperbolic

| Field                     | Value                                     |
| ------------------------- | ----------------------------------------- |
| **Provider ID**           | `hyperbolic`                              |
| **Base URL**              | `https://api.hyperbolic.xyz/v1/`          |
| **Website**               | [hyperbolic.xyz](https://hyperbolic.xyz/) |
| **Provider key required** | Yes                                       |

[How to use Hyperbolic →](/docs/ai-gateway/providers/hyperbolic)

Hyperbolic provides high-performance inference for open-source models.

***

### InceptionLabs

| Field                     | Value                                             |
| ------------------------- | ------------------------------------------------- |
| **Provider ID**           | `inceptionlabs`                                   |
| **Website**               | [inceptionlabs.ai](https://www.inceptionlabs.ai/) |
| **Provider key required** | Yes                                               |

[How to use InceptionLabs →](/docs/ai-gateway/providers/inceptionlabs)

InceptionLabs develops diffusion-based language models for fast, efficient text generation.

***

### Inference.net

| Field                     | Value                                   |
| ------------------------- | --------------------------------------- |
| **Provider ID**           | `inference-net`                         |
| **Base URL**              | `https://api.inference.net/v1/`         |
| **Website**               | [inference.net](https://inference.net/) |
| **Provider key required** | Yes                                     |

[How to use Inference.net →](/docs/ai-gateway/providers/inference-net)

Inference.net provides a distributed inference network for running AI models at scale.

***

## Using models from the catalog

### Simple model reference

Reference models directly by their ID:

```json theme={null}
{
  "model": "gpt-4o",
  "messages": [{"role": "user", "content": "Hello"}]
}
```

### Explicit provider

Use the `provider:model` format for explicit routing:

```json theme={null}
{
  "model": "openai:gpt-4o",
  "messages": [{"role": "user", "content": "Hello"}]
}
```

## Custom providers

Built-in providers cover major public APIs. For self-hosted models (Ollama, vLLM, LM Studio) or other endpoints, create a **custom provider** in the **Custom** tab in app.ngrok.ai. Custom providers always require a provider key when the upstream needs authentication.

See [Custom providers](/docs/ai-gateway/concepts/custom-providers) to add one.

## Catalog updates

The model catalog is updated periodically to include new models and providers. For immediate access to models not yet in the catalog, add them explicitly to your provider configuration.

***

## Aliases reference

Model and provider names are not case-sensitive. For example, `gpt-4o`, `GPT-4o`, and `Gpt-4O` all resolve to the same model.

The following aliases are available in addition to the primary IDs listed above.

### Provider aliases

| Provider ID     | Aliases                                                 |
| --------------- | ------------------------------------------------------- |
| `openai`        | `openAI`, `open-ai`, `open-AI`                          |
| `anthropic`     | `Anthropic`                                             |
| `google`        | `gemini`                                                |
| `deepseek`      | `deep-seek`                                             |
| `openrouter`    | `open-router`                                           |
| `inceptionlabs` | `inception-labs`, `inception`                           |
| `inference.net` | `inference-net`, `inference_net`                        |
| `groq`          | `groqcloud`                                             |
| `moonshotai`    | `Moonshot AI`, `Moonshot`, `Kimi`, `kimi.ai`, `kimi-ai` |
| `z-ai`          | `Z.ai`, `ZhipuAI`, `Zhipu AI`, `zhipu-ai`               |

### OpenAI model aliases

| Alias                              | Resolves to             |
| ---------------------------------- | ----------------------- |
| `gpt-4-omni`                       | `gpt-4o`                |
| `gpt-4o-2024-05-13`                | `gpt-4o`                |
| `gpt-4o-2024-08-06`                | `gpt-4o`                |
| `gpt-4o-2024-11-20`                | `gpt-4o`                |
| `chatgpt-4o-latest`                | `gpt-4o`                |
| `gpt-4o-mini-2024-07-18`           | `gpt-4o-mini`           |
| `gpt-4-turbo-2024-04-09`           | `gpt-4-turbo`           |
| `gpt-4-turbo-preview`              | `gpt-4-turbo`           |
| `gpt-4-1106-preview`               | `gpt-4-turbo`           |
| `gpt-4-0125-preview`               | `gpt-4-turbo`           |
| `gpt-4-0613`                       | `gpt-4`                 |
| `gpt-4-0314`                       | `gpt-4`                 |
| `gpt-4-32k`                        | `gpt-4`                 |
| `gpt-4.1-2025-04-14`               | `gpt-4.1`               |
| `gpt-4.1-mini-2025-04-14`          | `gpt-4.1-mini`          |
| `gpt-4.1-nano-2025-04-14`          | `gpt-4.1-nano`          |
| `gpt-5.1-2025-11-13`               | `gpt-5.1`               |
| `gpt-5.4-2026-03-05`               | `gpt-5.4`               |
| `gpt-5.4-pro-2026-03-05`           | `gpt-5.4-pro`           |
| `gpt-5.2-pro-2025-12-11`           | `gpt-5.2-pro`           |
| `GPT-5.3-Codex`                    | `gpt-5.3-codex`         |
| `gpt-5.3-Codex`                    | `gpt-5.3-codex`         |
| `gpt5.3-codex`                     | `gpt-5.3-codex`         |
| `GPT-5 mini`                       | `gpt-5-mini`            |
| `GPT-5 nano`                       | `gpt-5-nano`            |
| `GPT-5 Chat`                       | `gpt-5-chat-latest`     |
| `gpt-3.5-turbo-0125`               | `gpt-3.5-turbo`         |
| `gpt-3.5-turbo-16k`                | `gpt-3.5-turbo`         |
| `o4-mini-2025-04-16`               | `o4-mini`               |
| `o4-mini-deep-research-2025-06-26` | `o4-mini-deep-research` |
| `o3-pro-2025-06-10`                | `o3-pro`                |
| `o3-2025-04-16`                    | `o3`                    |
| `o3-mini-2025-01-31`               | `o3-mini`               |

### Anthropic model aliases

| Alias                        | Resolves to               |
| ---------------------------- | ------------------------- |
| `claude-opus-4-6-20260205`   | `claude-opus-4-6`         |
| `claude-sonnet-4-6-20260217` | `claude-sonnet-4-6`       |
| `claude-haiku-4-5-20251001`  | `claude-haiku-4-5`        |
| `claude-sonnet-4-5-20250929` | `claude-sonnet-4-5`       |
| `claude-opus-4-5-20251101`   | `claude-opus-4-5`         |
| `claude-opus-4-1-20250805`   | `claude-opus-4-1`         |
| `claude-opus-4.1`            | `claude-opus-4-1`         |
| `claude-sonnet-4-20250514`   | `claude-sonnet-4-0`       |
| `claude-sonnet-4`            | `claude-sonnet-4-0`       |
| `claude-opus-4-20250514`     | `claude-opus-4-0`         |
| `claude-opus-4`              | `claude-opus-4-0`         |
| `claude-haiku-3`             | `claude-3-haiku-20240307` |

### Google model aliases

| Alias          | Resolves to            |
| -------------- | ---------------------- |
| `gemini-3`     | `gemini-3-pro-preview` |
| `gemini-3-pro` | `gemini-3-pro-preview` |

### Meta model aliases

| Alias                       | Resolves to                          |
| --------------------------- | ------------------------------------ |
| `llama-3.1-8b`              | `llama-3.1-8b-instant`               |
| `llama-3.3-70b`             | `llama-3.3-70b-versatile`            |
| `llama-4-maverick-17b-128e` | `llama-4-maverick-17b-128e-instruct` |

### Moonshot AI model aliases

| Alias                              | Resolves to |
| ---------------------------------- | ----------- |
| `kimi-k2-instruct`                 | `kimi-k2`   |
| `kimi-k2-instruct-0905`            | `kimi-k2`   |
| `moonshotai/kimi-k2-instruct-0905` | `kimi-k2`   |