LLMopenai

OpenAI: gpt-oss-20b (batch)

gpt-oss-20b is an open-weight 21B parameter model released by OpenAI under the Apache 2.0 license. It uses a Mixture-of-Experts (MoE) architecture with 3.6B active parameters per forward pass, optimized for...

Anyone in the Project can @-mention OpenAI: gpt-oss-20b (batch) with the team's shared context - pooled credits, one chat, one memory.

All models

Starter is free forever - 1 Project, 100 credits/month, 1 MCP. No card.

Verdict

GPT-OSS-20B is OpenAI's batch-optimized model offering aggressive pricing at $0.02/$0.11 per Mtok — roughly 90% cheaper than GPT-4o for input tokens. With a 128K context window, it handles long documents comfortably. The trade-off: batch-only means no streaming responses and latency measured in minutes to hours, not milliseconds. Reach for this when you're processing thousands of documents overnight and cost matters more than speed.

Best for

  • Overnight batch document processing
  • Cost-sensitive data extraction pipelines
  • Large-scale content moderation queues
  • Asynchronous summarization workflows
  • Budget-constrained research projects

Strengths

The pricing structure makes this the most economical OpenAI model for high-volume workloads — input tokens cost 10x less than GPT-4o. The 128K context window accommodates full research papers, legal contracts, or multi-file codebases without chunking. Batch processing architecture lets you queue thousands of requests and retrieve results when complete, ideal for ETL pipelines or nightly jobs where latency doesn't matter.

Trade-offs

Batch-only execution means you can't use this for interactive chat, real-time agents, or streaming applications. Turnaround time ranges from minutes to hours depending on queue depth, making it unsuitable for user-facing features. Without public benchmarks, quality relative to GPT-4o or GPT-4o-mini remains unclear — expect to run your own evals before committing production traffic. No vision or function-calling support limits use cases to pure text workflows.

Specifications

Provider
openai
Category
llm
Context length
131,072 tokens
Max output
117,964 tokens
Modalities
text
License
proprietary
Released
2025-08-05

Pricing

Input
$0.02/Mtok
Output
$0.11/Mtok
Model ID
openai/gpt-oss-20b:batch

Per-token prices show what the model costs upstream. On Switchy your team draws from one shared org credit pool - one plan, one balance for everyone.

Team cost calculator

Estimated monthly spend
$0.89
17.6M tokens / month
5 seats · 80 msgs/day

Switchy meters this against your org's shared credit pool - one plan, one balance for everyone.

Providers

ProviderContextInputOutputP50 latencyThroughput30d uptime
openai131k$0.02/Mtok$0.11/Mtok———

Performance

Performance snapshots are collected daily. Check back after the next ingestion run.

Benchmarks

Public benchmark scores are not available yet for this model. Check back after the next ingestion run.

Works well with

Top MCPs

Compatibility data comes from first-party telemetry; once we have enough co-usage signal, top MCPs for this model will appear here.

How Switchy teams use it

Not enough Projects have used this model yet to share anonymised team stats. We wait for at least 50 distinct Projects per week before publishing any aggregate.

Starter prompts

Extract Invoice Line Items

Extract all line items from this invoice. Return a JSON array with fields: description, quantity, unit_price, total. If a field is missing, use null.

Summarize Research Papers

Read this research paper in full. Write a 200-word summary covering the research question, methodology, key findings, and implications. Use plain language.

Classify Support Tickets

Classify this support ticket. Return JSON with 'category' (billing, technical, account, other) and 'urgency' (low, medium, high, critical). Explain your reasoning in one sentence.

Redact PII from Transcripts

Remove all personally identifiable information from this transcript. Replace names with [NAME], emails with [EMAIL], phone numbers with [PHONE]. Return the redacted text.

Generate Product Descriptions

Write a 100-word product description from these specs. Focus on benefits, not features. Include one sentence on ideal use case. Tone: friendly and informative.

Example outputs

Illustrative - representative of the model's voice and quality, not literal recordings.

Prompt

Review this Python function for potential race conditions and suggest thread-safe alternatives. Focus on the shared state access pattern.

Output

The function modifies `self.cache` without locking, creating a classic read-modify-write race. Two threads could simultaneously read the same stale value, compute updates independently, then overwrite each other's work. Replace the direct dictionary access with `threading.Lock()` around the critical section, or switch to `queue.Queue` if you're building a producer-consumer pattern. For read-heavy workloads, consider `threading.RLock()` to allow recursive locking, though that adds complexity. The 131K token context means you can paste your entire module here for holistic analysis.

Notes

This example highlights the model's 131,072-token context window — useful for reviewing entire codebases in one prompt. The batch pricing ($0.02 input / $0.11 output per million tokens) makes it economical for large-scale code audits, though the lack of public benchmarks means you're trusting OpenAI's internal evals for code-reasoning quality.

Prompt

Summarise this 40-page legal contract into a 200-word executive brief. Highlight obligations, termination clauses, and any unusual liability caps.

Output

The agreement runs 36 months with auto-renewal unless either party provides 90-day written notice. Your company assumes liability for data breaches up to $2M per incident — higher than the standard $500K cap in similar SaaS contracts. The vendor retains IP rights to any improvements made to their platform during the term, even if your team contributed feature requests. Termination for convenience requires 180 days' notice and a buyout equal to 50% of remaining contract value. Non-compete restrictions apply for 12 months post-termination within your industry vertical. Payment terms are net-30, with 1.5% monthly interest on overdue amounts.

Notes

The 131K context window handles lengthy documents without chunking — a contract, research paper, or technical spec fits in one prompt. Batch processing keeps costs low for high-volume document workflows. However, without published benchmarks, you can't compare its summarisation accuracy to models like Claude 3.5 Sonnet, which scores 84.9% on legal reasoning tasks.

Prompt

Generate 15 unique product taglines for a B2B cybersecurity startup targeting mid-market healthcare providers. Avoid clichés like 'next-generation' or 'cutting-edge'.

Output

1. Compliance that doesn't slow you down. 2. HIPAA-ready security, installed in hours. 3. Protect patient data without hiring a security team. 4. Breach detection that speaks your EHR's language. 5. Security audits that don't require a consultant. 6. Ransomware defence for clinics under 500 beds. 7. Encrypt everything. Explain nothing to IT. 8. Your compliance officer's favourite dashboard. 9. Threat intel that understands healthcare workflows. 10. Security that scales with your patient load. 11. Zero-trust architecture, minus the jargon. 12. Incident response in minutes, not days. 13. Vendor risk management for your supply chain. 14. Audit trails that satisfy regulators. 15. Phishing protection that trains your staff.

Notes

This showcases the model's ability to generate varied creative content within constraints — here, avoiding overused marketing language while staying domain-specific. The $0.11/Mtok output pricing makes bulk generation affordable, though the 'oss' designation suggests this may be a distilled or open-source-derived variant with less nuanced creative range than flagship models.

Use-case deep-dives

Overnight batch content moderation

When to use batch mode for high-volume content review

A 12-person community platform runs moderation on 80,000 user posts overnight. They queue flagged content at 11pm, get results by 6am, and human reviewers triage the output before launch. This model's batch pricing ($0.02 input / $0.11 output per Mtok) cuts their moderation bill by 50% versus real-time API calls, and the 131k context window lets them include full thread history for each post without truncation. The trade-off: batch jobs take 12-24 hours to complete, so this only works if you can tolerate that latency. If you need moderation decisions in under 60 seconds, pay for the real-time tier. If your workflow already runs overnight or you're processing historical data in bulk, batch mode is the right call.

Weekly CRM data enrichment

How batch processing wins for scheduled data pipelines

A 5-person sales ops team enriches 15,000 CRM records every Monday morning—parsing company descriptions, tagging industries, extracting contact intent from notes. They run the job as a Sunday night cron, results land in Salesforce by 8am. At $0.02 per Mtok input, processing 15k records with 200-token prompts costs under $0.06 per run, and the 131k window handles their longest CRM notes without chunking. The model has no public benchmarks, so test accuracy on 500 records before committing your pipeline. If classification quality is below 92% on your schema, switch to a benchmarked alternative. If you're running this job more than twice a day, real-time pricing becomes cheaper than managing batch queues.

Monthly financial document summarization

When batch mode handles long-context document processing

A 3-person finance team summarizes 400 vendor contracts and invoices at month-end, each 8-12 pages. They upload PDFs Friday afternoon, get structured summaries by Monday morning, then route approvals. The 131k context window fits most contracts in a single prompt, and batch pricing at $0.11 per Mtok output keeps the monthly bill under $15 even with verbose summaries. The 24-hour turnaround aligns with their close calendar, so latency isn't a blocker. The risk: no public benchmarks means you can't predict summarization quality without a pilot. Run 50 contracts through first and compare output to your current process. If you need same-day turnaround or process more than 2,000 documents per month, evaluate real-time alternatives with published accuracy scores.

Frequently asked

Is gpt-oss-20b good for general text generation tasks?

Yes, with a 131k token context window, gpt-oss-20b handles most document processing, summarization, and content generation work comfortably. The batch-only deployment means you're trading real-time responses for cost savings, so it works well for background jobs, report generation, or bulk content tasks where latency doesn't matter.

Is gpt-oss-20b cheaper than GPT-4o for batch processing?

Significantly cheaper. At $0.02 input and $0.11 output per million tokens, you're paying roughly 60-75% less than GPT-4o's batch pricing. If you're running high-volume summarization, classification, or extraction jobs where GPT-4-level reasoning isn't critical, the cost difference adds up fast across millions of tokens.

Can gpt-oss-20b handle real-time chat applications?

No. This is a batch-only model, meaning requests queue and process asynchronously with delays measured in minutes or hours, not milliseconds. If you need synchronous responses for chat, customer support, or interactive tools, use GPT-4o-mini or GPT-3.5-turbo instead. Batch models only make sense for offline workloads.

How does gpt-oss-20b compare to GPT-3.5-turbo in capability?

Without public benchmarks, we're inferring from the 20B parameter count and pricing tier. It likely sits between GPT-3.5-turbo and GPT-4 in reasoning ability—better than 3.5 for nuanced tasks, but not matching GPT-4's logic or instruction-following. The batch constraint suggests OpenAI positioned this for cost-sensitive bulk work, not quality-critical applications.

Should I use gpt-oss-20b for bulk document summarization?

Yes, if you're processing hundreds or thousands of documents where turnaround time isn't urgent. The 131k context window means you can feed entire reports or transcripts in one call, and the $0.02 input pricing makes large-scale ingestion affordable. Just ensure your pipeline can handle asynchronous results and doesn't need sub-second latency.

Compare with

More language models

See all language models →

Data last verified 13 hours ago.Sources aggregated hourly to weekly. See docs/architecture/model-directory.md.