LLM API
LLM API provides a unified inference API for text, embeddings, images, audio, video, files, and batch workloads across multiple AI providers.
Integration
- Vendor
- LLM API
- Category
- other
- Auth
- API_KEY
- Tools
- 12
- Composio slug
llm_api
Tools
- Cancel Batch
Request best-effort cancellation of an in-progress batch. Return the provider's actual batch state without implying cancellation took effect; work may still finish and incur charges before the request is applied.
- Count Anthropic Message Tokens
Count input tokens for an Anthropic-compatible message request without generating a model response.
- Create Anthropic Message
Generate one complete, non-streaming Anthropic-compatible message with flexible content blocks, system prompts, and tool use.
- Create Chat Completion
Generate a complete, non-streaming OpenAI-compatible chat response from role-based messages, optionally using tools, multimodal content, structured output, reasoning, or web search supported by the selected model.
- Create Embeddings
Create vector embeddings for one text or a batch of texts with a selected embedding model.
- Create Response
Generate one complete, non-streaming OpenAI Responses-compatible result from text or structured input, preserving reasoning and tool items.
- Delete Filedestructive
Permanently delete a caller-owned or explicitly authorized project file. This destructive operation cannot be undone; a missing file fails with not found rather than reporting a successful deletion.
- Discover Models
Return one model's full live capabilities by ID, or browse a compact, bounded view of the live model catalog using local capability filters.
- Get Account and Credits
Return the connected user, project, organization, purchased and bonus credit balances, funding mode, and balance gating in one account-status read.
- List or Get Batches
Return one asynchronous batch and its latest lifecycle, token, and cost status by ID, or one provider-default page of project batches when no batch ID is supplied. List mode supports provider cursor pagination.
- List or Get Files
Return metadata for one project file by ID, or one provider-default page of project file metadata when no file ID is supplied. List mode supports purpose filtering and provider cursor pagination.
- Submit Batch
Create an asynchronous batch from an existing purpose=batch file ID, or upload a JSONL input file with purpose=batch and create the batch in one call.
Setup
- Create or open a Switchy Project.
- Open Integrations and connect LLM API.
- Authorise through api_key. Switchy stores the connection against your org.
- Everyone in the Project can now @-mention the LLM API tools in chat.
What teammates see: by default, memories from LLM API are scoped to the Project (PROJECT visibility) - you can mark any memory PRIVATE or share it ORG-wide.
Works well with
Top models
Compatibility data appears once enough Projects have used this MCP together with a given model.