developer-toolsapi_key

Langfuse

Open source LLM engineering platform. Traces, evals, prompt management and metrics to debug and improve your LLM application.

Integration

Vendor
Langfuse
Category
developer-tools
Auth
API_KEY
Tools
13
Composio slug
langfuse

Tools

  • Create Score

    Attach an evaluation score to exactly one Langfuse trace, session, or dataset run, optionally narrowing a trace score to an observation.

  • Get Annotation Queue

    Retrieve one Langfuse annotation queue by its ID.

  • Get Prompt

    Retrieve a Langfuse text or chat prompt by name, deployment label, or exact version, with optional dependency resolution.

  • List Annotation Queues

    List annotation queues configured for human evaluation in the connected Langfuse project.

  • List Dataset Items

    List dataset items, optionally scoped to a dataset, source trace or observation, or historical dataset version.

  • List Dataset Run Items

    List run items for a specific Langfuse dataset and run name.

  • List Datasets

    List datasets available to the connected Langfuse project.

  • List Experiments

    List Langfuse experiments active in a required time range, optionally including metadata and directly attached scores.

  • List Models

    List Langfuse-managed and project-custom model pricing definitions used for usage and cost calculation.

  • List Observations

    Search Langfuse observations such as generations, spans, events, agents, and tool calls, selecting only the field groups needed.

  • List Scores

    Search numeric, boolean, categorical, text, and correction scores with subject and annotation context.

  • Query Metrics

    Run an aggregate Langfuse metrics query over observations or numeric, boolean, or categorical scores.

  • Upsert LLM Connection

    Create or update a Langfuse LLM provider connection by provider name.

Setup

  1. Create or open a Switchy Project.
  2. Open Integrations and connect Langfuse.
  3. Authorise through api_key. Switchy stores the connection against your org.
  4. Everyone in the Project can now @-mention the Langfuse tools in chat.

What teammates see: by default, memories from Langfuse are scoped to the Project (PROJECT visibility) - you can mark any memory PRIVATE or share it ORG-wide.

Works well with

Top models

Compatibility data appears once enough Projects have used this MCP together with a given model.

How Switchy teams use it

Not enough Projects yet to publish anonymised usage stats (we require ≥ 50 Projects per week).

Starter prompts

Starter prompts for this model will land here soon.

More developer tools MCPs

See all developer tools MCPs

Data last verified 31 hours ago.Sources aggregated hourly to weekly. See docs/architecture/model-directory.md.