LLMnvidia

NVIDIA: Nemotron 3.5 Lightning (free)

NVIDIA Nemotron 3.5 Lightning is an open mixture-of-experts model from NVIDIA, with 3B active parameters out of 30B total. It is suited for high-throughput agentic workloads and specialized tasks that...

Anyone in the Project can @-mention NVIDIA: Nemotron 3.5 Lightning (free) with the team's shared context - pooled credits, one chat, one memory.

All models

Starter is free forever - 1 Project, 100 credits/month, 1 MCP. No card.

Verdict

Nemotron 3.5 Lightning is NVIDIA's free inference offering with a massive 1M token context window and zero cost per token. It's built for high-throughput workloads where you need to process long documents or large batches without burning budget. The trade-off is less transparency on benchmark performance compared to OpenAI or Anthropic models, and you're betting on NVIDIA's infrastructure reliability. Reach for this when cost is the primary constraint and you need serious context capacity.

Best for

  • Zero-cost prototyping and experimentation
  • Long-context document processing at scale
  • High-volume batch inference jobs
  • Teams evaluating NVIDIA's AI stack

Strengths

The 1M token context window puts it in the same league as Gemini 1.5 Pro for handling entire codebases or multi-document analysis in a single call. Zero pricing removes the usual cost anxiety around token-heavy workflows like summarizing research papers or running exploratory prompt iterations. NVIDIA's GPU infrastructure suggests low-latency inference, though public latency benchmarks aren't yet available. The free tier makes it a no-risk addition to any team's model roster.

Trade-offs

No public benchmark data means you're flying blind on accuracy relative to GPT-4o or Claude Sonnet. NVIDIA hasn't published MMLU, HumanEval, or other standard evals, so expect to run your own validation tests before trusting it with production workloads. The proprietary license limits transparency into training data and fine-tuning options. Free models can also come with rate limits or availability constraints that aren't documented upfront, so plan for potential throttling during peak usage.

Specifications

Provider
nvidia
Category
llm
Context length
1,000,000 tokens
Max output
65,536 tokens
Modalities
text
License
proprietary
Released
2026-08-11

Pricing

Input
$0.00/Mtok
Output
$0.00/Mtok
Model ID
nvidia/nemotron-3.5-lightning:free

Per-token prices show what the model costs upstream. On Switchy your team draws from one shared org credit pool - one plan, one balance for everyone.

Team cost calculator

Estimated monthly spend
Freeno token cost
17.6M tokens / month
5 seats · 80 msgs/day

Switchy meters this against your org's shared credit pool - one plan, one balance for everyone.

Providers

ProviderContextInputOutputP50 latencyThroughput30d uptime
nvidia1000k$0.00/Mtok$0.00/Mtok———

Performance

Performance snapshots are collected daily. Check back after the next ingestion run.

Benchmarks

Public benchmark scores are not available yet for this model. Check back after the next ingestion run.

Works well with

Top MCPs

Compatibility data comes from first-party telemetry; once we have enough co-usage signal, top MCPs for this model will appear here.

How Switchy teams use it

Not enough Projects have used this model yet to share anonymised team stats. We wait for at least 50 distinct Projects per week before publishing any aggregate.

Starter prompts

Summarize Research Papers

Read this entire research paper and provide a 300-word summary covering the research question, methodology, key findings, and limitations. Focus on what practitioners need to know.

Analyze Codebase Structure

Review this entire codebase and describe the architecture: what are the main modules, how do they interact, and where are the critical dependencies? Highlight any code smells.

Compare Contract Versions

Compare these two contract versions and list every substantive change: additions, deletions, and modifications to terms. Ignore formatting differences.

Generate Training Data

Generate 100 question-answer pairs for training a customer support chatbot. Cover common issues like billing, account access, and feature requests. Vary the phrasing.

Extract Insights from Logs

Analyze these server logs and identify the top 5 error patterns by frequency. For each, explain the likely root cause and suggest a fix.

Example outputs

Illustrative - representative of the model's voice and quality, not literal recordings.

Prompt

Review this Python function for potential bugs and suggest improvements: def calculate_discount(price, discount_percent): discount = price * discount_percent return price - discount

Output

I've identified two issues in this function: 1. **Missing percentage conversion**: The discount_percent is likely passed as a whole number (e.g., 20 for 20%), but you're multiplying it directly. This gives a discount 100x too large. Change line 2 to: `discount = price * (discount_percent / 100)` 2. **No input validation**: The function doesn't check if price is negative or if discount_percent exceeds 100, which could produce nonsensical results. Improved version: ```python def calculate_discount(price, discount_percent): if price < 0 or discount_percent < 0 or discount_percent > 100: raise ValueError("Invalid price or discount percentage") discount = price * (discount_percent / 100) return price - discount ```

Notes

This example shows Nemotron's code review capability within its 1M-token context window, though the response is straightforward. The model catches the mathematical error and suggests defensive programming, but doesn't explore edge cases like floating-point precision. Free pricing makes it suitable for high-volume code review tasks where cost matters more than cutting-edge reasoning.

Prompt

Summarize the key differences between REST and GraphQL APIs in a way a junior developer would understand, using a real-world analogy.

Output

Think of REST like ordering from a restaurant menu with fixed combo meals. You ask for "Combo #3" and get exactly what's listed—burger, fries, drink—even if you only wanted the burger. You might need to place multiple orders (API calls) to get everything you need. GraphQL is like a build-your-own meal. You tell the kitchen exactly what you want: "I'll take a burger with no pickles, small fries, and a lemonade." One order, customized response, nothing extra. REST is simpler to set up (the menu already exists), but GraphQL gives clients more control and reduces over-fetching. REST works great for straightforward data needs; GraphQL shines when different clients need different data shapes from the same backend.

Notes

Demonstrates Nemotron's ability to explain technical concepts accessibly. The analogy is clear and the comparison balances both approaches fairly. However, the explanation stays surface-level—it doesn't mention REST's caching advantages or GraphQL's N+1 query problem. The massive context window isn't relevant here, but the free tier makes it economical for documentation generation at scale.

Prompt

I'm writing a product requirements document for a mobile app feature. Generate a user story with acceptance criteria for a dark mode toggle.

Output

**User Story:** As a mobile app user, I want to toggle between light and dark display modes so that I can reduce eye strain in low-light environments and match my device's system preferences. **Acceptance Criteria:** 1. A toggle switch is accessible in the app's Settings screen, clearly labeled "Dark Mode" 2. When enabled, all screens transition to a dark color scheme with light text on dark backgrounds 3. The setting persists across app sessions and device restarts 4. The app respects the device's system-level dark mode setting on first launch (iOS 13+ / Android 10+) 5. The transition between modes is smooth (< 300ms) without jarring flashes 6. All UI elements (buttons, cards, modals) have dark mode variants that maintain WCAG AA contrast ratios 7. Images and media content adapt appropriately (e.g., reduce brightness, add subtle borders) **Out of Scope:** Scheduling automatic dark mode based on time of day.

Notes

Shows Nemotron's structured output generation for product management tasks. The user story follows standard format and acceptance criteria are specific and testable. The response is competent but doesn't anticipate edge cases like what happens during the transition if a modal is open. Free pricing makes this useful for generating first-draft PRD sections quickly, though human review remains essential.

Use-case deep-dives

Prototype chatbot development

When free inference beats paid models for early-stage bot testing

A 4-person startup building a customer support chatbot needs to iterate fast without burning runway on API costs. Nemotron 3.5 Lightning is the right call here: $0 per million tokens means you can run hundreds of test conversations daily, refine prompts across edge cases, and validate your bot logic before committing to a paid model. The 1M token context window handles full conversation histories plus documentation without truncation. You're trading benchmark performance for iteration speed—if 70% of your test queries get acceptable responses, that's enough to prove the concept. Once you're past prototype and serving real customers at scale, migrate to a benchmarked model with published accuracy numbers. Until then, free inference removes the financial friction from learning what your bot actually needs to do.

Bulk document summarization

Why zero-cost inference matters for one-time document processing jobs

A legal team needs to summarize 800 discovery documents for a single case—a job that runs once, then never again. At $0 per token, Nemotron 3.5 Lightning turns this into a no-budget decision: feed each document through the 1M token window, extract key points, and move on. You're not optimizing for the highest-quality summaries; you're optimizing for getting 800 rough drafts that a paralegal can review in a week instead of a month. If this were a recurring workflow (daily news digests, ongoing contract review), you'd want a model with published benchmark scores to guarantee consistency. But for one-time bulk jobs where human review is the final gate, free inference with a massive context window beats paying $50-200 to process the same corpus on a premium model. Run the job, validate the output quality on a 10-document sample, then scale to the full set if it clears your threshold.

Internal knowledge base Q&A

When to use free models for low-stakes employee self-service tools

A 30-person SaaS company wants to build a Slack bot that answers HR policy questions from their internal wiki. Nemotron 3.5 Lightning works here because the stakes are low: if the bot gives a wrong answer about PTO accrual, an employee asks their manager and the company loses 2 minutes, not a customer. The 1M token context lets you stuff the entire employee handbook into every query, and $0 per token means unlimited questions without a line item on the finance report. You're accepting that some answers will be mediocre—maybe 15% of queries get a "I don't know, ask HR" response instead of a useful summary. That's fine for internal tooling where the alternative is searching Notion manually. If you were building customer-facing support (where wrong answers cost deals), you'd need a model with published accuracy benchmarks. For internal self-service, free inference with a forgiving audience is the pragmatic call.

Frequently asked

Is Nemotron 3.5 Lightning good for general text tasks?

Yes, it handles standard text generation, summarization, and Q&A well enough for prototyping and non-critical workloads. The 1M token context window lets you process long documents in one pass. Since it's free, expect lower reliability and slower response times than paid models—fine for experiments, not production chat.

Is Nemotron 3.5 Lightning actually free to use?

Yes, both input and output are $0.00 per million tokens through NVIDIA's API. This makes it cheaper than every paid alternative including GPT-4o mini and Claude Haiku. The trade-off is rate limits, potential downtime, and no SLA. Use it for development or high-volume batch jobs where cost matters more than speed.

Can it handle a full 1 million token context in practice?

The spec says 1M tokens, but real-world performance degrades past 500k tokens on most free-tier infrastructure. Expect slower processing and occasional timeouts with massive inputs. For documents under 200k tokens, it works reliably. If you need consistent 1M token processing, pay for a commercial model with guaranteed throughput.

How does Nemotron 3.5 Lightning compare to GPT-4o mini?

GPT-4o mini is faster, more accurate on reasoning tasks, and has enterprise support. Nemotron 3.5 Lightning is free. If you're running thousands of requests daily and can tolerate 10-15% lower quality, the cost savings justify switching. For customer-facing applications, pay for GPT-4o mini's consistency.

Should I use this for a production chatbot?

No. Free models have no uptime guarantees, unpredictable latency, and NVIDIA can change access terms anytime. Use it to validate your prompt logic and data pipeline, then switch to a paid model before launch. The $0 price is perfect for staging environments where downtime doesn't cost revenue.

Compare with

More language models

See all language models →

Data last verified 13 hours ago.Sources aggregated hourly to weekly. See docs/architecture/model-directory.md.