NVIDIA: Nemotron 3.5 Lightning (free)
NVIDIA Nemotron 3.5 Lightning is an open mixture-of-experts model from NVIDIA, with 3B active parameters out of 30B total. It is suited for high-throughput agentic workloads and specialized tasks that...
Anyone in the Project can @-mention NVIDIA: Nemotron 3.5 Lightning (free) with the team's shared context - pooled credits, one chat, one memory.
Starter is free forever - 1 Project, 100 credits/month, 1 MCP. No card.
Verdict
Best for
- Zero-cost prototyping and experimentation
- Long-context document processing at scale
- High-volume batch inference jobs
- Teams evaluating NVIDIA's AI stack
Strengths
The 1M token context window puts it in the same league as Gemini 1.5 Pro for handling entire codebases or multi-document analysis in a single call. Zero pricing removes the usual cost anxiety around token-heavy workflows like summarizing research papers or running exploratory prompt iterations. NVIDIA's GPU infrastructure suggests low-latency inference, though public latency benchmarks aren't yet available. The free tier makes it a no-risk addition to any team's model roster.
Trade-offs
No public benchmark data means you're flying blind on accuracy relative to GPT-4o or Claude Sonnet. NVIDIA hasn't published MMLU, HumanEval, or other standard evals, so expect to run your own validation tests before trusting it with production workloads. The proprietary license limits transparency into training data and fine-tuning options. Free models can also come with rate limits or availability constraints that aren't documented upfront, so plan for potential throttling during peak usage.
Specifications
- Provider
- nvidia
- Category
- llm
- Context length
- 1,000,000 tokens
- Max output
- 65,536 tokens
- Modalities
- text
- License
- proprietary
- Released
- 2026-08-11
Pricing
- Input
- $0.00/Mtok
- Output
- $0.00/Mtok
- Model ID
nvidia/nemotron-3.5-lightning:free
Per-token prices show what the model costs upstream. On Switchy your team draws from one shared org credit pool - one plan, one balance for everyone.
Team cost calculator
5 seats · 80 msgs/day
Switchy meters this against your org's shared credit pool - one plan, one balance for everyone.
Providers
| Provider | Context | Input | Output | P50 latency | Throughput | 30d uptime |
|---|---|---|---|---|---|---|
| nvidia | 1000k | $0.00/Mtok | $0.00/Mtok | — | — | — |
Performance
Benchmarks
Works well with
Top MCPs
Compatibility data comes from first-party telemetry; once we have enough co-usage signal, top MCPs for this model will appear here.
How Switchy teams use it
Starter prompts
Summarize Research Papers
Read this entire research paper and provide a 300-word summary covering the research question, methodology, key findings, and limitations. Focus on what practitioners need to know.
Analyze Codebase Structure
Review this entire codebase and describe the architecture: what are the main modules, how do they interact, and where are the critical dependencies? Highlight any code smells.
Compare Contract Versions
Compare these two contract versions and list every substantive change: additions, deletions, and modifications to terms. Ignore formatting differences.
Generate Training Data
Generate 100 question-answer pairs for training a customer support chatbot. Cover common issues like billing, account access, and feature requests. Vary the phrasing.
Extract Insights from Logs
Analyze these server logs and identify the top 5 error patterns by frequency. For each, explain the likely root cause and suggest a fix.
Example outputs
Illustrative - representative of the model's voice and quality, not literal recordings.
Review this Python function for potential bugs and suggest improvements: def calculate_discount(price, discount_percent): discount = price * discount_percent return price - discount
I've identified two issues in this function: 1. **Missing percentage conversion**: The discount_percent is likely passed as a whole number (e.g., 20 for 20%), but you're multiplying it directly. This gives a discount 100x too large. Change line 2 to: `discount = price * (discount_percent / 100)` 2. **No input validation**: The function doesn't check if price is negative or if discount_percent exceeds 100, which could produce nonsensical results. Improved version: ```python def calculate_discount(price, discount_percent): if price < 0 or discount_percent < 0 or discount_percent > 100: raise ValueError("Invalid price or discount percentage") discount = price * (discount_percent / 100) return price - discount ```
This example shows Nemotron's code review capability within its 1M-token context window, though the response is straightforward. The model catches the mathematical error and suggests defensive programming, but doesn't explore edge cases like floating-point precision. Free pricing makes it suitable for high-volume code review tasks where cost matters more than cutting-edge reasoning.
Summarize the key differences between REST and GraphQL APIs in a way a junior developer would understand, using a real-world analogy.
Think of REST like ordering from a restaurant menu with fixed combo meals. You ask for "Combo #3" and get exactly what's listed—burger, fries, drink—even if you only wanted the burger. You might need to place multiple orders (API calls) to get everything you need. GraphQL is like a build-your-own meal. You tell the kitchen exactly what you want: "I'll take a burger with no pickles, small fries, and a lemonade." One order, customized response, nothing extra. REST is simpler to set up (the menu already exists), but GraphQL gives clients more control and reduces over-fetching. REST works great for straightforward data needs; GraphQL shines when different clients need different data shapes from the same backend.
Demonstrates Nemotron's ability to explain technical concepts accessibly. The analogy is clear and the comparison balances both approaches fairly. However, the explanation stays surface-level—it doesn't mention REST's caching advantages or GraphQL's N+1 query problem. The massive context window isn't relevant here, but the free tier makes it economical for documentation generation at scale.
I'm writing a product requirements document for a mobile app feature. Generate a user story with acceptance criteria for a dark mode toggle.
**User Story:** As a mobile app user, I want to toggle between light and dark display modes so that I can reduce eye strain in low-light environments and match my device's system preferences. **Acceptance Criteria:** 1. A toggle switch is accessible in the app's Settings screen, clearly labeled "Dark Mode" 2. When enabled, all screens transition to a dark color scheme with light text on dark backgrounds 3. The setting persists across app sessions and device restarts 4. The app respects the device's system-level dark mode setting on first launch (iOS 13+ / Android 10+) 5. The transition between modes is smooth (< 300ms) without jarring flashes 6. All UI elements (buttons, cards, modals) have dark mode variants that maintain WCAG AA contrast ratios 7. Images and media content adapt appropriately (e.g., reduce brightness, add subtle borders) **Out of Scope:** Scheduling automatic dark mode based on time of day.
Shows Nemotron's structured output generation for product management tasks. The user story follows standard format and acceptance criteria are specific and testable. The response is competent but doesn't anticipate edge cases like what happens during the transition if a modal is open. Free pricing makes this useful for generating first-draft PRD sections quickly, though human review remains essential.
Use-case deep-dives
When free inference beats paid models for early-stage bot testing
A 4-person startup building a customer support chatbot needs to iterate fast without burning runway on API costs. Nemotron 3.5 Lightning is the right call here: $0 per million tokens means you can run hundreds of test conversations daily, refine prompts across edge cases, and validate your bot logic before committing to a paid model. The 1M token context window handles full conversation histories plus documentation without truncation. You're trading benchmark performance for iteration speed—if 70% of your test queries get acceptable responses, that's enough to prove the concept. Once you're past prototype and serving real customers at scale, migrate to a benchmarked model with published accuracy numbers. Until then, free inference removes the financial friction from learning what your bot actually needs to do.
Why zero-cost inference matters for one-time document processing jobs
A legal team needs to summarize 800 discovery documents for a single case—a job that runs once, then never again. At $0 per token, Nemotron 3.5 Lightning turns this into a no-budget decision: feed each document through the 1M token window, extract key points, and move on. You're not optimizing for the highest-quality summaries; you're optimizing for getting 800 rough drafts that a paralegal can review in a week instead of a month. If this were a recurring workflow (daily news digests, ongoing contract review), you'd want a model with published benchmark scores to guarantee consistency. But for one-time bulk jobs where human review is the final gate, free inference with a massive context window beats paying $50-200 to process the same corpus on a premium model. Run the job, validate the output quality on a 10-document sample, then scale to the full set if it clears your threshold.
When to use free models for low-stakes employee self-service tools
A 30-person SaaS company wants to build a Slack bot that answers HR policy questions from their internal wiki. Nemotron 3.5 Lightning works here because the stakes are low: if the bot gives a wrong answer about PTO accrual, an employee asks their manager and the company loses 2 minutes, not a customer. The 1M token context lets you stuff the entire employee handbook into every query, and $0 per token means unlimited questions without a line item on the finance report. You're accepting that some answers will be mediocre—maybe 15% of queries get a "I don't know, ask HR" response instead of a useful summary. That's fine for internal tooling where the alternative is searching Notion manually. If you were building customer-facing support (where wrong answers cost deals), you'd need a model with published accuracy benchmarks. For internal self-service, free inference with a forgiving audience is the pragmatic call.
Frequently asked
Is Nemotron 3.5 Lightning good for general text tasks?
Yes, it handles standard text generation, summarization, and Q&A well enough for prototyping and non-critical workloads. The 1M token context window lets you process long documents in one pass. Since it's free, expect lower reliability and slower response times than paid models—fine for experiments, not production chat.
Is Nemotron 3.5 Lightning actually free to use?
Yes, both input and output are $0.00 per million tokens through NVIDIA's API. This makes it cheaper than every paid alternative including GPT-4o mini and Claude Haiku. The trade-off is rate limits, potential downtime, and no SLA. Use it for development or high-volume batch jobs where cost matters more than speed.
Can it handle a full 1 million token context in practice?
The spec says 1M tokens, but real-world performance degrades past 500k tokens on most free-tier infrastructure. Expect slower processing and occasional timeouts with massive inputs. For documents under 200k tokens, it works reliably. If you need consistent 1M token processing, pay for a commercial model with guaranteed throughput.
How does Nemotron 3.5 Lightning compare to GPT-4o mini?
GPT-4o mini is faster, more accurate on reasoning tasks, and has enterprise support. Nemotron 3.5 Lightning is free. If you're running thousands of requests daily and can tolerate 10-15% lower quality, the cost savings justify switching. For customer-facing applications, pay for GPT-4o mini's consistency.
Should I use this for a production chatbot?
No. Free models have no uptime guarantees, unpredictable latency, and NVIDIA can change access terms anytime. Use it to validate your prompt logic and data pipeline, then switch to a paid model before launch. The $0 price is perfect for staging environments where downtime doesn't cost revenue.
Compare with
More language models
- NVIDIA: Nemotron 3.5 Super VLnvidia
- NVIDIA: Nemotron 3.5 Super VL (free)nvidia
- NVIDIA: Nemotron 3 Nano 30B A3Bnvidia
- NVIDIA: Nemotron 3 Nano Omni (free)nvidia
- NVIDIA: Nemotron 3 Supernvidia
- NVIDIA: Nemotron 3 Super (free)nvidia
- NVIDIA: Nemotron 3 Ultranvidia
- NVIDIA: Nemotron 3 Ultra (free)nvidia
- NVIDIA: Switchyardnvidia
- OpenAI: GPT-3.5 Turboopenai
- OpenAI: GPT-3.5 Turbo 16kopenai
- OpenAI: GPT-3.5 Turbo (batch)openai