Nous: Hermes 3 70B Instruct
Hermes 3 is a generalist language model with many improvements over [Hermes 2](/models/nousresearch/nous-hermes-2-mistral-7b-dpo), including advanced agentic capabilities, much better roleplaying, reasoning, multi-turn conversation, long context coherence, and improvements across the...
Anyone in the Project can @-mention Nous: Hermes 3 70B Instruct with the team's shared context - pooled credits, one chat, one memory.
Starter is free forever - 1 Project, 100 credits/month, 1 MCP. No card.
Verdict
Best for
- Function calling with structured JSON output
- Long-context document analysis under budget
- Instruction-following for internal tooling
- Cost-sensitive agentic workflows
- Reasoning tasks where GPT-4 feels overpriced
Strengths
The $0.70/Mtok symmetric pricing makes this one of the most affordable 70B models available. The 131K context window exceeds most competitors in this price tier, letting you process full codebases or long reports in a single call. Nous Research's Hermes fine-tuning historically emphasizes function calling and structured output, making this a solid choice for tool use and API integrations where you need reliable JSON responses without paying Claude or GPT-4 rates.
Trade-offs
No public benchmarks means you're flying blind on comparative performance — we don't have MMLU, HumanEval, or MT-Bench scores to anchor expectations. Early adopters report solid performance on reasoning tasks, but you'll need to validate quality in your specific domain before committing. The symmetric input/output pricing is unusual; most models charge more for output, so if your use case generates long responses, you're paying more than the headline rate suggests.
Specifications
- Provider
- nousresearch
- Category
- llm
- Context length
- 131,072 tokens
- Max output
- 16,384 tokens
- Modalities
- text
- License
- proprietary
- Released
- 2024-08-18
Pricing
- Input
- $0.70/Mtok
- Output
- $0.70/Mtok
- Model ID
nousresearch/hermes-3-llama-3.1-70b
Per-token prices show what the model costs upstream. On Switchy your team draws from one shared org credit pool - one plan, one balance for everyone.
Team cost calculator
5 seats · 80 msgs/day
Switchy meters this against your org's shared credit pool - one plan, one balance for everyone.
Providers
| Provider | Context | Input | Output | P50 latency | Throughput | 30d uptime |
|---|---|---|---|---|---|---|
| nousresearch | 131k | $0.70/Mtok | $0.70/Mtok | — | — | — |
Performance
Benchmarks
Works well with
Top MCPs
Compatibility data comes from first-party telemetry; once we have enough co-usage signal, top MCPs for this model will appear here.
How Switchy teams use it
Starter prompts
Extract Structured Meeting Notes
Read this meeting transcript and extract: (1) decisions made, (2) action items with assigned owners, (3) open questions. Return as JSON with arrays for each category. Be precise about who owns each action item.
Analyze Long-Form Contract
Review this contract and identify: (1) key obligations for each party, (2) termination clauses, (3) liability caps or indemnification terms, (4) any unusual or high-risk provisions. Summarize each in plain language.
Generate API Integration Code
Write a Python function that calls the Stripe API to create a subscription, handles rate limiting with exponential backoff, and returns a structured result object. Include error handling for common failure modes.
Compare Product Feature Sets
I'm comparing three project management tools. For each, list: (1) core features, (2) pricing tiers, (3) integration ecosystem, (4) best use case. Present as a comparison table with clear trade-offs.
Debug Complex Logic Error
This function is supposed to calculate weighted averages but returns incorrect results. Walk through the logic step-by-step, identify where the calculation breaks, and explain the fix in plain language before showing corrected code.
Example outputs
Illustrative - representative of the model's voice and quality, not literal recordings.
Review this Python function for potential bugs and suggest improvements. Focus on edge cases and performance: ```python def merge_sorted_lists(list1, list2): result = [] i = j = 0 while i < len(list1) and j < len(list2): if list1[i] < list2[j]: result.append(list1[i]) i += 1 else: result.append(list2[j]) j += 1 return result ```
The function has a critical bug: it doesn't handle remaining elements after one list is exhausted. When the while loop exits, elements from the longer list are lost. Add these lines after the loop: ```python result.extend(list1[i:]) result.extend(list2[j:]) ``` Performance-wise, repeated `len()` calls are inefficient. Cache the lengths or use iterators. For very large lists, consider using `heapq.merge()` from the standard library, which is optimized for this exact use case and handles the edge cases automatically.
This example shows Hermes 3's code review capability — it catches the logic error, explains the consequence, and provides both a fix and a performance optimization. The 131K token context window means it can review entire codebases in one pass, though without benchmark data we can't verify its accuracy against models like Claude or GPT-4.
I'm writing a technical blog post about database indexing. Explain B-tree indexes in a way that's accurate for engineers but accessible to junior developers. Include when to use them versus hash indexes.
B-tree indexes organize data in a sorted tree structure where each node contains multiple keys and pointers to child nodes. Think of it like a phone book: you can quickly jump to the 'M' section, then narrow down to 'Ma', then 'Martin'. This hierarchical search takes O(log n) time. Use B-trees when you need range queries (`WHERE age BETWEEN 25 AND 35`) or sorted results (`ORDER BY created_at`). The sorted structure makes these operations efficient. Hash indexes, by contrast, compute a hash of the key and jump directly to the data — O(1) for exact matches. But they can't handle ranges or sorting. Use hash indexes only for equality lookups (`WHERE user_id = 12345`) on high-cardinality columns where you never need ordering.
Demonstrates Hermes 3's ability to calibrate technical depth for a specific audience. The explanation balances precision with accessibility, using an effective analogy. At $0.70 per million tokens for both input and output, it's competitively priced for long-form content generation, though the lack of public benchmarks makes quality comparison difficult.
Extract structured data from this customer support email and return it as JSON: "Hi, my order #A-2847 arrived yesterday but the blue wireless headphones (SKU: WH-200B) are defective — the left ear cuts out intermittently. I'd like a replacement shipped to my office at 450 Market St, San Francisco CA 94105. My account email is sarah.chen@techcorp.io. Thanks!"
```json { "order_id": "A-2847", "issue_type": "defective_product", "product": { "name": "wireless headphones", "color": "blue", "sku": "WH-200B" }, "defect_description": "left ear cuts out intermittently", "requested_action": "replacement", "shipping_address": { "street": "450 Market St", "city": "San Francisco", "state": "CA", "zip": "94105", "type": "office" }, "customer_email": "sarah.chen@techcorp.io" } ```
Shows Hermes 3's structured extraction capability — it correctly identifies entities, infers the issue type, and organizes nested data logically. The model handles the 'office' context clue appropriately. However, without function-calling benchmarks, we can't assess how reliably it maintains schema consistency across varied inputs compared to specialized extraction models.
Use-case deep-dives
When 131K context beats chaining calls for contract review
A 4-person legal ops team needs to cross-reference clauses across 20+ vendor agreements during M&A due diligence. Hermes 3 70B's 131,072-token window fits roughly 400 pages in a single prompt, letting you load entire contract sets without chunking or retrieval overhead. At $0.70/Mtok symmetrical pricing, a 100K-token analysis (75K in, 25K out) costs $0.07—cheaper than running 6 separate calls through a model with a 32K limit. The trade-off: you're paying for capacity whether you use it or not, so if your typical doc is under 20 pages, a smaller-context model at $0.30/Mtok saves money. Use this when your workflow already involves stitching together multi-document context and you'd rather pay once than orchestrate retrieval.
Why flat pricing works for high-volume async moderation queues
A 12-person community platform runs nightly moderation on 8,000 user posts, flagging policy violations before morning review. Hermes 3 70B's symmetrical $0.70/Mtok means output tokens don't spike your bill—critical when each moderation call returns a 200-token structured report (violation type, severity, quoted text). Processing 8K posts at 150 tokens in and 200 out costs $1.96/night, versus $2.80 on a model charging $0.40 in / $1.20 out. The 70B parameter count handles nuanced policy edge cases better than smaller models, reducing false positives that waste human review time. If you're under 2,000 posts/day, a 7B model at $0.10/Mtok is cheaper and fast enough. Choose this when output volume is predictable and you need reasoning depth at scale.
When 70B latency costs you more than the per-token rate
A 9-person SaaS support team uses AI to classify inbound tickets and route them to specialists within 3 seconds of submission. Hermes 3 70B delivers strong intent classification, but 70B models typically add 800ms–2s of latency versus 7B alternatives, pushing you past the 3-second SLA on 15–20% of tickets during peak hours. At 600 tickets/day and 80 tokens per classification, you're spending $0.03/day—cost isn't the issue. The issue is that users refresh the page or send duplicate tickets when routing feels slow, creating more work than a slightly less accurate 7B model would. Use this for routing only if you're batching tickets every 30 seconds instead of processing them live, or if your SLA is 10+ seconds and you need the reasoning edge on ambiguous requests.
Frequently asked
Is Hermes 3 70B good for general instruction following?
Yes. Hermes 3 70B is purpose-built for instruction following and conversational tasks. The 70B parameter count gives it strong reasoning without the cost overhead of 400B+ models. It handles multi-turn dialogue, creative writing, and structured output generation reliably. Expect solid performance on coding assistance, summarization, and Q&A workflows where you need consistent instruction adherence.
Is Hermes 3 70B cheaper than GPT-4o or Claude Sonnet?
Yes, significantly. At $0.70 per million tokens for both input and output, Hermes 3 costs roughly 70-85% less than GPT-4o ($2.50/$10.00) and Claude Sonnet 3.5 ($3.00/$15.00). The symmetric pricing also means you don't pay a premium for longer outputs. If you're running high-volume inference where GPT-4-class intelligence isn't required, the cost savings add up fast.
Can Hermes 3 70B handle the full 131k context window reliably?
The 131k context window is advertised, but real-world performance at maximum context depends on your use case. For retrieval tasks or long document analysis, expect some degradation in accuracy past 100k tokens—this is common across all models. For most production workflows, staying under 80k tokens gives you headroom without hitting quality cliffs. Test your specific prompts at scale before committing.
How does Hermes 3 70B compare to Llama 3.1 70B?
Both are 70B open-weight models with 128k+ context windows, but Hermes 3 is fine-tuned specifically for instruction following and agentic behavior. If you need a model that follows complex multi-step prompts or maintains character in roleplay scenarios, Hermes 3 typically edges out base Llama 3.1. For raw reasoning or math, they're comparable. Pricing is similar across most providers.
Should I use Hermes 3 70B for production chatbots?
Yes, if your budget can't justify GPT-4 and you need better instruction adherence than smaller models. Hermes 3 70B handles multi-turn context well and produces coherent, on-brand responses. Latency is reasonable for chat (2-4 seconds for typical responses depending on your provider). Just ensure you have fallback logic for edge cases—no 70B model is bulletproof.
Compare with
More language models
- Nous: Hermes 4 405Bnousresearch
- NVIDIA: Nemotron 3.5 Content Safetynvidia
- NVIDIA: Nemotron 3.5 Content Safety (free)nvidia
- NVIDIA: Nemotron 3.5 Lightningnvidia
- NVIDIA: Nemotron 3.5 Lightning (free)nvidia
- NVIDIA: Nemotron 3.5 Super VLnvidia
- NVIDIA: Nemotron 3.5 Super VL (free)nvidia
- NVIDIA: Nemotron 3 Nano 30B A3Bnvidia
- NVIDIA: Nemotron 3 Nano Omni (free)nvidia
- NVIDIA: Nemotron 3 Supernvidia
- NVIDIA: Nemotron 3 Super (free)nvidia
- NVIDIA: Nemotron 3 Ultranvidia