# LLM API MCP

Vendor: LLM API  
Category: other  
Auth: API_KEY  
Composio slug: `llm_api`

LLM API provides a unified inference API for text, embeddings, images, audio, video, files, and batch workloads across multiple AI providers.

## Tools

- **Cancel Batch** — Request best-effort cancellation of an in-progress batch. Return the provider's actual batch state without implying cancellation took effect; work may still finish and incur charges before the request is applied.
- **Count Anthropic Message Tokens** — Count input tokens for an Anthropic-compatible message request without generating a model response.
- **Create Anthropic Message** — Generate one complete, non-streaming Anthropic-compatible message with flexible content blocks, system prompts, and tool use.
- **Create Chat Completion** — Generate a complete, non-streaming OpenAI-compatible chat response from role-based messages, optionally using tools, multimodal content, structured output, reasoning, or web search supported by the selected model.
- **Create Embeddings** — Create vector embeddings for one text or a batch of texts with a selected embedding model.
- **Create Response** — Generate one complete, non-streaming OpenAI Responses-compatible result from text or structured input, preserving reasoning and tool items.
- **Delete File** — Permanently delete a caller-owned or explicitly authorized project file. This destructive operation cannot be undone; a missing file fails with not found rather than reporting a successful deletion.
- **Discover Models** — Return one model's full live capabilities by ID, or browse a compact, bounded view of the live model catalog using local capability filters.
- **Get Account and Credits** — Return the connected user, project, organization, purchased and bonus credit balances, funding mode, and balance gating in one account-status read.
- **List or Get Batches** — Return one asynchronous batch and its latest lifecycle, token, and cost status by ID, or one provider-default page of project batches when no batch ID is supplied. List mode supports provider cursor pagination.
- **List or Get Files** — Return metadata for one project file by ID, or one provider-default page of project file metadata when no file ID is supplied. List mode supports purpose filtering and provider cursor pagination.
- **Submit Batch** — Create an asynchronous batch from an existing purpose=batch file ID, or upload a JSONL input file with purpose=batch and create the batch in one call.

## Setup

1. Create or open a Switchy Project.
2. Open Integrations and connect LLM API.
3. Authorise through api_key.
4. Teammates can now @-mention LLM API tools in chat.

---
Last verified: 2026-10-17T02:00:10.360Z  
Canonical URL: https://switchy.build/directory/mcps/llm-api