LLMthinkingmachines

Thinking Machines: Inkling Small

Inkling Small is an open-weight multimodal mixture-of-experts model from Thinking Machines Lab, with 12B active parameters out of 276B total. It is positioned as the smaller, more efficient member of...

Anyone in the Project can @-mention Thinking Machines: Inkling Small with the team's shared context - pooled credits, one chat, one memory.

All models

Starter is free forever - 1 Project, 100 credits/month, 1 MCP. No card.

Verdict

Inkling Small offers a massive 524K context window at budget pricing — $0.45 input makes it one of the cheapest ways to process long documents or transcripts. The multimodal support (text, image, audio) adds versatility for mixed-media workflows. Without public benchmarks, you're trading proven performance data for cost savings and context capacity. Reach for this when token economics matter more than leaderboard rankings, especially for high-volume document ingestion or audio transcription tasks where you need room to work.

Best for

  • Long-document analysis on tight budgets
  • Audio transcription with extended context
  • High-volume text processing workflows
  • Multimodal tasks mixing text and images
  • Cost-sensitive prototyping and experimentation

Strengths

The 524K context window rivals top-tier models while pricing undercuts most competitors — you get Claude-scale context at a fraction of the cost. Multimodal support across text, image, and audio makes it flexible for real-world data pipelines that don't arrive in neat text-only packages. The input pricing at $0.45/Mtok means you can throw large corpora at it without budget anxiety, useful for RAG systems or batch document processing where context matters more than nuanced reasoning.

Trade-offs

No public benchmarks means you're flying blind on reasoning quality, code generation accuracy, and instruction-following compared to established models. The lack of performance data makes it risky for production use cases where output quality is non-negotiable. Output pricing at $1.20/Mtok is reasonable but not exceptional, so cost advantages shrink if your workflow generates verbose responses. Early-stage model from a less-known provider means limited community resources, fewer integration examples, and uncertain long-term support.

Specifications

Provider
thinkingmachines
Category
llm
Context length
524,288 tokens
Max output
262,144 tokens
Modalities
text, image, audio
License
proprietary
Released
2026-07-30

Pricing

Input
$0.45/Mtok
Output
$1.20/Mtok
Model ID
thinkingmachines/inkling-small

Per-token prices show what the model costs upstream. On Switchy your team draws from one shared org credit pool - one plan, one balance for everyone.

Team cost calculator

Estimated monthly spend
$11.88
17.6M tokens / month
5 seats · 80 msgs/day

Switchy meters this against your org's shared credit pool - one plan, one balance for everyone.

Providers

ProviderContextInputOutputP50 latencyThroughput30d uptime
thinkingmachines524k$0.45/Mtok$1.20/Mtok———

Performance

Performance snapshots are collected daily. Check back after the next ingestion run.

Benchmarks

Public benchmark scores are not available yet for this model. Check back after the next ingestion run.

Works well with

Top MCPs

Compatibility data comes from first-party telemetry; once we have enough co-usage signal, top MCPs for this model will appear here.

How Switchy teams use it

Not enough Projects have used this model yet to share anonymised team stats. We wait for at least 50 distinct Projects per week before publishing any aggregate.

Starter prompts

Summarize Long Transcript

Read this full transcript and produce a structured summary with: (1) main topics discussed, (2) decisions made, (3) action items with owners. Preserve important quotes verbatim where they clarify intent.

Extract Data from Document Set

Review all documents provided and extract: company names, contract dates, payment terms, and renewal clauses. Output as a JSON array with one object per document, including page references.

Analyze Image with Context

Examine this image alongside the provided text. Describe what the visual shows, how it relates to the written content, and flag any discrepancies between the two.

Compare Audio to Written Policy

Listen to this audio and compare it against the policy document. Identify any statements that contradict the written policy, noting timestamps and specific policy sections.

Batch Process Research Papers

Read these research papers and create a comparative analysis table showing: methodology used, sample size, key findings, and limitations. Highlight where studies agree or conflict.

Example outputs

Illustrative - representative of the model's voice and quality, not literal recordings.

Prompt

Review this Python function for potential race conditions. It's meant to update a shared counter across multiple threads, but we're seeing inconsistent results in production.

Output

The function lacks thread synchronization. When multiple threads read `counter`, increment it, then write back, you get classic read-modify-write races. Thread A reads 5, Thread B reads 5, both increment to 6, both write 6—you've lost an increment. Wrap the read-increment-write sequence in a `threading.Lock()` context manager, or switch to `threading.local()` if each thread needs its own counter. The current implementation will drop updates under any meaningful concurrency.

Notes

Inkling Small excels at identifying concurrency bugs with precise technical language. The 524K token context means you can paste entire codebases for cross-file analysis. However, at $1.20/Mtok output, verbose explanations add up—this model rewards tight, specific prompts over exploratory conversations.

Prompt

I have a 40-minute podcast transcript. Extract the three most actionable takeaways for a product manager working on B2B SaaS pricing strategy.

Output

1. Anchor pricing on customer outcome metrics (ARR saved, deals closed) rather than seat counts—interviewee's company saw 34% faster enterprise closes after the switch. 2. Offer annual-only plans at Series A stage to improve cash runway predictability; monthly plans came later at Series B when churn data matured. 3. Build a lightweight usage dashboard even before usage-based pricing launches—transparency reduces sticker shock and support tickets when you do flip the switch.

Notes

The 524K context window handles long-form audio transcripts without truncation, and the model surfaces specific, attributed insights rather than generic advice. The $0.45 input cost makes processing hour-long recordings economical. Trade-off: output brevity sometimes sacrifices nuance—you may need a follow-up prompt to expand on reasoning.

Prompt

Analyze this product screenshot and suggest three UI improvements to reduce cognitive load for first-time users. Focus on the onboarding flow visible in the image.

Output

The modal presents seven configuration options simultaneously before users understand what they're configuring. Recommendation: progressive disclosure—show the two critical fields (workspace name, timezone) first, then reveal advanced options behind an 'Advanced settings' toggle. Second, the 'Skip' button has equal visual weight to 'Continue', tempting users to bypass setup entirely and hit dead ends later. Make 'Continue' the primary action. Third, the helper text uses internal jargon ('sync cadence', 'webhook endpoints')—rephrase in outcome language: 'How often should we check for updates?' instead.

Notes

Inkling Small's multimodal capability lets you analyze UI screenshots alongside text context, useful for design reviews. The model identifies specific friction points with concrete fixes. Limitation: it can't generate visual mockups of suggested changes—you'll need to pair this with a design tool or image model for implementation.

Use-case deep-dives

Multi-modal customer support triage

When your support team needs text, screenshots, and voice in one thread

A 12-person SaaS support team handling 200+ tickets daily where customers send screenshots, voice notes, and chat messages in the same thread. Inkling Small handles all three modalities without forcing you to route inputs through separate models. At $0.45/$1.20 per Mtok, you're paying roughly half what GPT-4o charges for the same multi-modal capability. The 524k context window means you can load entire ticket histories plus documentation without truncation. If your tickets average under 10k tokens and you're not doing heavy reasoning (just classification and response drafting), this is the move. Beyond 300 tickets/day, audit your output token spend—Inkling's $1.20 output rate climbs fast on verbose responses.

Long-document financial analysis

When you need to load full 10-Ks without benchmark proof

A 4-person investment research shop analyzing quarterly earnings across 80-page SEC filings. Inkling Small's 524k context window fits most 10-Ks in a single prompt, and the $0.45 input rate makes bulk document loading cheaper than Claude 3.5 Sonnet. The problem: no public benchmarks. You're flying blind on whether it catches numerical inconsistencies or correctly chains multi-step financial logic. If your workflow is extractive (pulling tables, summarizing sections), the risk is low. If you're asking it to reconcile balance sheets or flag accounting red flags, run a 20-document pilot against a model with published FinQA or DROP scores before committing. The price is right, but trust requires your own validation here.

Audio transcription with context

When meeting audio needs the last 3 hours of Slack history

A 9-person product team running daily standups where the AI needs both the audio recording and the prior day's Slack thread to generate action items. Inkling Small's audio modality plus 524k context means you can drop the MP3 and the full thread history in one call. At $0.45 input, you're spending roughly $0.23 per hour of audio plus text context—cheaper than chaining Whisper and a separate LLM. The catch: no WER (word error rate) data, so you don't know if it matches Whisper's accuracy on accents or background noise. If your standups are clean audio in quiet rooms, test it. If you're transcribing sales calls with crosstalk and speakerphone echo, stick with Whisper until Thinking Machines publishes audio benchmarks.

Frequently asked

Is Thinking Machines Inkling Small good for general text tasks?

Inkling Small handles standard text generation, summarization, and Q&A adequately for its price tier. At $0.45/$1.20 per Mtok, it's positioned as a budget option, but without public benchmarks it's hard to confirm performance against GPT-4o-mini or Claude Haiku. If you need proven reliability, stick with those alternatives until Thinking Machines publishes evaluation scores.

Is Inkling Small cheaper than GPT-4o-mini or Claude Haiku?

Yes, marginally. GPT-4o-mini runs $0.15/$0.60 per Mtok and Claude Haiku is $0.25/$1.25, so Inkling Small's $0.45/$1.20 sits between them on input but undercuts Haiku slightly on output. The savings aren't dramatic enough to justify switching unless you're processing massive output volumes and the model meets your quality bar.

Can Inkling Small handle multimodal inputs like images and audio?

The spec lists image and audio support, but implementation details are unclear. Most small models struggle with complex image reasoning or long audio transcription compared to dedicated multimodal systems like GPT-4o or Gemini 1.5. Test your specific use case before committing—multimodal capability on paper doesn't guarantee production-ready performance.

How does Inkling Small compare to other Thinking Machines models?

No comparison data exists yet. Thinking Machines hasn't published a model lineup or benchmark suite showing how Inkling Small stacks up against potential siblings. If you're evaluating this model, assume it's their entry-level offering and plan to validate performance independently before scaling.

Should I use Inkling Small for production chatbots or customer support?

Not without extensive testing. The 524K context window is generous for conversation history, but absent benchmarks mean you're flying blind on accuracy, safety, and instruction-following. For customer-facing applications, deploy GPT-4o-mini or Claude Haiku first—they have proven track records and similar pricing with better transparency.

Compare with

More language models

See all language models →

Data last verified 14 hours ago.Sources aggregated hourly to weekly. See docs/architecture/model-directory.md.