# Vercel AI Gateway MCP

Vendor: Vercel AI Gateway  
Category: other  
Auth: API_KEY  
Composio slug: `vercel_ai_gateway`

Access Vercel AI Gateway's model discovery, inference, generation, and usage APIs through a unified AI model gateway.

## Verdict

Vercel AI Gateway routes LLM requests through a unified API that handles fallbacks, token counting, and multi-provider compatibility. @mention it to send prompts to OpenAI, Anthropic, or other models without switching endpoints, estimate costs before you run a query, or compact long conversation threads into replayable context. Teams managing multiple model providers get the most value — you write one prompt and the gateway picks the best available model. Trade-off: you need a Vercel account and API key; some advanced provider features may not surface through the abstraction layer.

## Tools

- **Compact Response** — Compact a long OpenAI Responses conversation into replayable context through Vercel AI Gateway. This endpoint only supports models routed to OpenAI and does not fail over to other providers; model compatibility is checked by the provider ra
- **Count Message Tokens** — Estimate input tokens for Anthropic-format messages, system content, and tools before sending a model request through Vercel AI Gateway.
- **Create Anthropic Message** — Create one non-streaming Anthropic Messages-compatible result through Vercel AI Gateway, with multimodal content, tools, extended thinking, and routing controls.
- **Create Chat Completion** — Create one non-streaming OpenAI Chat Completions-compatible result through Vercel AI Gateway, with multimodal messages, tools, structured output, fallback models, and routing controls.
- **Create Embeddings** — Generate OpenAI-compatible vector embeddings through Vercel AI Gateway for text or token inputs, with optional dimensions and routing controls.
- **Edit Images** — Create edited images from up to 16 HTTPS or base64 data-URL source images and a text instruction. Uses the non-streaming JSON image-edit route only.
- **Evaluate State** — Evaluate one shared state against one or more typed choice, score, or boolean questions using an AI Gateway evaluation model. Returns structured answers, token usage, and gateway metadata rather than generated prose.
- **Evaluate with TypeSafe API** — Evaluate one shared state through AI Gateway's TypeSafe-compatible System One API. Use this compatibility action for TypeSafe noul, choice, and score request shapes; use Evaluate State for new integrations.
- **Generate Images** — Generate one or more images from a text prompt through an image-only Vercel AI Gateway model. Returns a completed non-streaming JSON response.
- **Generate Response** — Generate one non-streaming OpenAI Responses-compatible result through AI Gateway, with optional instructions, tools, structured output, reasoning, and routing controls. Inspect status because a successful HTTP response may still be incomple
- **Generate Speech** — Generate spoken audio from text through a Vercel AI Gateway speech model. Returns completed base64 audio in JSON; streaming output is not supported.
- **Get Credit Balance** — Return the connected team's remaining AI Gateway credit balance and lifetime credit usage in USD.
- **Get Generation** — Look up cost, token usage, provider routing, latency, and finish details for one completed Vercel AI Gateway generation.
- **Get Model** — Return detailed capabilities, modalities, limits, tags, and pricing for one exact Gateway model ID.
- **Get Model Endpoints** — Compare provider endpoints serving one Vercel AI Gateway model, including limits, pricing, caching, availability, throughput, and latency.
- **Get Spend Report** — Query aggregated Vercel AI Gateway spend and token usage. This endpoint requires a Pro or Enterprise plan, and each query costs $5 per 1,000 queries.
- **List Model Catalog** — List AI Gateway model-to-provider routes and capability tags, with bounded local filtering by model text, provider, or tag.
- **List TypeSafe Models** — List evaluation models available through AI Gateway's TypeSafe-compatible API, including each accepted model name, description, and release date.
- **Rerank Object Documents** — Rank structured object documents by relevance through the Cohere v1 route, using selected rank fields and optionally returning each source document.
- **Rerank Text Documents** — Rerank string documents through the current Cohere v2 compatibility endpoint. Unlike the v1 action, this action accepts text strings only and does not support object documents, rank_fields, or return_documents.
- **Search Models** — Search the AI Gateway model catalog by text, model type, and tags, returning capability and pricing metadata for matching models.
- **Transcribe Audio** — Transcribe base64-encoded recorded audio through a Vercel AI Gateway transcription model. Returns one completed JSON transcript, not a live stream.

## Setup

1. Create or open a Switchy Project.
2. Open Integrations and connect Vercel AI Gateway.
3. Authorise through api_key.
4. Teammates can now @-mention Vercel AI Gateway tools in chat.

---
Last verified: 2026-10-17T02:00:10.360Z  
Canonical URL: https://switchy.build/directory/mcps/vercel-ai-gateway