LLMibm-granite

IBM: Granite 4.0 Micro

Granite-4.0-H-Micro is a 3B parameter from the Granite 4 family of models. These models are the latest in a series of models released by IBM. They are fine-tuned for long...

Anyone in the Project can @-mention IBM: Granite 4.0 Micro with the team's shared context - pooled credits, one chat, one memory.

All models

Starter is free forever - 1 Project, 100 credits/month, 1 MCP. No card.

Verdict

Granite 4.0 Micro targets cost-sensitive workloads where you need decent reasoning at rock-bottom pricing. At $0.02/$0.11 per Mtok, it undercuts nearly every commercial model while offering a 131K context window for document-heavy tasks. The trade-off is capability: expect performance closer to older 7B models than frontier systems. Reach for this when budget constraints matter more than bleeding-edge accuracy, or when you're prototyping before scaling to a stronger model.

Best for

  • Budget-constrained production deployments
  • High-volume classification tasks
  • Document summarization under 100K tokens
  • Internal tooling with forgiving accuracy needs
  • Prototyping before committing to premium models

Strengths

The 131K context window handles most enterprise documents without chunking, and the pricing structure makes it viable for high-throughput scenarios where cost per request dominates architecture decisions. IBM's enterprise focus means the model likely trained on business-relevant corpora, which can surface in stronger performance on formal writing, technical documentation, and structured data tasks compared to consumer-tuned alternatives at this price point.

Trade-offs

Without published benchmarks, you're flying blind on reasoning quality relative to peers. Expect this to trail GPT-4o, Claude Sonnet, and even mid-tier models like Llama 3.1 70B on complex logic, nuanced instruction-following, and creative tasks. The proprietary license limits deployment flexibility compared to open-weight alternatives. If your use case demands high accuracy or sophisticated reasoning, the cost savings won't offset the capability gap.

Specifications

Provider
ibm-granite
Category
llm
Context length
131,000 tokens
Max output
117,900 tokens
Modalities
text
License
proprietary
Released
2025-10-20

Pricing

Input
$0.02/Mtok
Output
$0.11/Mtok
Model ID
ibm-granite/granite-4.0-h-micro

Per-token prices show what the model costs upstream. On Switchy your team draws from one shared org credit pool - one plan, one balance for everyone.

Team cost calculator

Estimated monthly spend
$0.80
17.6M tokens / month
5 seats · 80 msgs/day

Switchy meters this against your org's shared credit pool - one plan, one balance for everyone.

Providers

ProviderContextInputOutputP50 latencyThroughput30d uptime
ibm-granite131k$0.02/Mtok$0.11/Mtok———

Performance

Performance snapshots are collected daily. Check back after the next ingestion run.

Benchmarks

Public benchmark scores are not available yet for this model. Check back after the next ingestion run.

Works well with

Top MCPs

Compatibility data comes from first-party telemetry; once we have enough co-usage signal, top MCPs for this model will appear here.

How Switchy teams use it

Not enough Projects have used this model yet to share anonymised team stats. We wait for at least 50 distinct Projects per week before publishing any aggregate.

Starter prompts

Extract Invoice Line Items

Extract all line items from this invoice into a JSON array. For each item include: description, quantity, unit_price, and total. Return only valid JSON with no explanation.

Summarize Meeting Transcripts

Read this meeting transcript and produce a bulleted list of action items. For each item, note the responsible person and deadline if mentioned. Keep summaries under 15 words each.

Classify Support Tickets

Classify this support ticket into one of these categories: Billing, Technical, Account, Sales, Other. Respond with only the category name and a one-sentence justification.

Rewrite for Clarity

Rewrite this technical paragraph for a non-technical audience. Use simple language, define jargon on first use, and keep sentences under 20 words. Maintain all key facts.

Generate SQL from Schema

Given this database schema, write a SQL query to answer the user's question. Return only the query with no explanation. Optimize for readability over performance.

Example outputs

Illustrative - representative of the model's voice and quality, not literal recordings.

Prompt

Review this Python function for potential bugs. Focus on edge cases: def calculate_discount(price, percentage): return price - (price * percentage)

Output

The function has a critical issue: it assumes `percentage` is a decimal (0.0-1.0) but typical user input is 0-100. If someone passes `50` for 50%, they'd get a negative result. Add validation: `if percentage > 1: percentage /= 100`. Also consider: what if `price` is negative? What if `percentage` exceeds 100? The function silently produces nonsense in both cases. Add bounds checking or raise `ValueError` for invalid inputs.

Notes

Granite 4.0 Micro's 131k token context window lets it handle substantial codebases, but this example shows its strength in focused code review. The model identifies the percentage-scale ambiguity and suggests defensive programming. At $0.02/$0.11 per Mtok, it's positioned for high-volume internal tooling where cost per call matters more than cutting-edge reasoning.

Prompt

Summarise this customer support transcript into three bullet points for our CRM. Highlight the core issue, what we promised, and next steps.

Output

• **Core issue**: Customer's API key expired mid-integration, causing 401 errors across their staging environment. They weren't notified before expiry. • **Our commitment**: Issued a new key immediately; enabled email alerts 7 days before future expirations on their account. • **Next steps**: Engineering will review why the expiry notification didn't fire. Follow up with customer in 48 hours to confirm staging is stable.

Notes

This example demonstrates Granite 4.0 Micro's utility for routine business text processing. The model extracts structure from conversational data without over-elaborating. The 131k context means it can ingest long transcripts or email threads in one pass. Trade-off: for nuanced sentiment analysis or complex multi-party negotiations, a larger model would capture subtler dynamics.

Prompt

Explain how a bloom filter works to a junior developer who understands hash tables but hasn't seen probabilistic data structures before.

Output

A bloom filter is like a hash table that trades accuracy for space. Instead of storing keys, it uses multiple hash functions to set bits in a fixed-size array. To check membership, hash the item with those same functions — if all corresponding bits are 1, the item *might* be in the set. If any bit is 0, it's *definitely not*. False positives are possible (bits collide), but false negatives aren't. Use case: quickly ruling out non-members before hitting a slow database.

Notes

Granite 4.0 Micro handles technical explanations with appropriate scaffolding, building on the user's stated knowledge (hash tables). The analogy and use-case grounding make the concept accessible. However, the explanation stays surface-level — a model with stronger reasoning might walk through a concrete bit-array example or discuss tuning parameters (number of hash functions, array size). For quick onboarding docs, this depth is often sufficient.

Use-case deep-dives

Customer support ticket triage

When Granite 4.0 Micro handles first-pass ticket routing for sub-50-ticket-per-day teams

A 6-person support team triaging 35 inbound tickets daily, each 200-400 tokens, into four routing buckets (billing, technical, sales, escalation). Granite 4.0 Micro at $0.02/Mtok input costs $0.006 per ticket to classify; output is a single category tag (10 tokens, $0.001). Monthly cost for 700 tickets: $5. The 131k context window is overkill here, but the price floor makes it viable even at low volume. The catch: classification accuracy matters—if 15% of tickets misroute, you're burning support hours on re-triage. Without public benchmarks, you're running a two-week pilot to measure precision before going live. If your ticket language is straightforward and you can tolerate a 10% misroute rate that gets caught in the first human reply, Granite 4.0 Micro is the cheapest entry point. If you're above 100 tickets/day or misroutes create customer-facing delays, the lack of benchmark transparency is a deal-breaker until you validate accuracy in production.

Frequently asked

Is IBM Granite 4.0 Micro good for production chatbots?

Granite 4.0 Micro works for basic chatbots with straightforward Q&A, but lacks public benchmark data to verify reasoning quality. The 131k context window handles long conversations well. At $0.11/Mtok output, it's cheaper than GPT-4o ($15/Mtok) but you're trading cost for unproven performance. Test thoroughly before deploying customer-facing applications.

Is Granite 4.0 Micro cheaper than GPT-4o Mini?

Yes, significantly. Granite costs $0.02 input and $0.11 output per Mtok versus GPT-4o Mini's $0.15 input and $0.60 output. For a typical 10k-input, 2k-output request, Granite runs $0.42 per million calls versus GPT-4o Mini's $2.70. The savings matter for high-volume applications, but GPT-4o Mini has proven benchmark performance.

Can Granite 4.0 Micro handle 100k token documents?

Yes, the 131k context window accommodates documents up to roughly 100k tokens with room for instructions and output. However, without published benchmarks like RULER or Needle-in-Haystack scores, retrieval accuracy across that full context is unverified. For critical long-document tasks, validate performance on your specific use case before committing.

How does Granite 4.0 Micro compare to Granite 3.0?

IBM hasn't published comparative benchmarks between versions, making direct performance comparison impossible. The 4.0 Micro maintains the same 131k context window as previous Granite models. Pricing appears similar to earlier releases. Without MMLU, HumanEval, or other standard scores, you'll need to A/B test both versions on your workload.

Should I use Granite 4.0 Micro for code generation?

Not recommended without seeing HumanEval or MBPP scores first. IBM positions Granite for enterprise use cases, but code generation demands proven accuracy. Models like Claude Sonnet 3.5 (HumanEval 92%) or GPT-4o (90.2%) cost more but deliver verified coding performance. Use Granite only if you can afford extensive testing and validation.

Compare with

More language models

See all language models →

Data last verified 13 hours ago.Sources aggregated hourly to weekly. See docs/architecture/model-directory.md.