What does Nemotron 3.5 Lightning 30B cost on RunInfra?

Input costs $0.05 per 1M input tokens. Cached input costs $0.01 per 1M cached input tokens. Output costs $0.15 per 1M output tokens.

What are the limits for Nemotron 3.5 Lightning 30B?

Context window: 262,144 tokens. Maximum request size: 3.5 MB per request. Maximum generated output: 262,144 tokens.

RunInfraby RightNow

Model APIsNew
Optimization
Pricing
Research
Contact

Dashboard Sign in Get started

Model Library

Built for agents that replay context. Agent traffic resends the whole conversation on every tool call. Here the repeated part hits cache and bills at the cached input rate.

RunInfraby RightNow

Join the community System status

Optimization agent Model APIs Pricing Startups Benchmarks Docs Research News Brand assets Contact

Backed by

Combinator

AICPA Type II

SOC 2

Ask AI about RunInfra

Part of RightNow

Security DPA AUP Cookies Terms Privacy

RunInfraby RightNow

Join the community System status

Optimization agent Model APIs Pricing Startups Benchmarks Docs Research News Brand assets Contact

Backed by

Combinator

AICPA Type II

SOC 2

Ask AI about RunInfra

Part of RightNow

Security DPA AUP Cookies Terms Privacy

Model Library

Built for agents that replay context. Agent traffic resends the whole conversation on every tool call. Here the repeated part hits cache and bills at the cached input rate.

RunInfraby RightNow

Join the community System status

Optimization agent Model APIs Pricing Startups Benchmarks Docs Research News Brand assets Contact

Backed by

Combinator

AICPA Type II

SOC 2

Ask AI about RunInfra

Part of RightNow

Security DPA AUP Cookies Terms Privacy

RunInfraby RightNow

Join the community System status

Optimization agent Model APIs Pricing Startups Benchmarks Docs Research News Brand assets Contact

Backed by

Combinator

AICPA Type II

SOC 2

Ask AI about RunInfra

Part of RightNow

Security DPA AUP Cookies Terms Privacy

Nemotron 3.5 Lightning 30B | Model APIs | RunInfra

Model Library
/
NVIDIA
/
Nemotron 3.5 Lightning 30B

Nemotron 3.5 Lightning 30B

nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16

Get API key Chat Completions API reference

Nemotron 3.5 Lightning 30B is an LLM listed in RunInfra Model APIs. RunInfra serves it as nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 at $0.05 per 1M input tokens and $0.15 per 1M output tokens. Its context window is 262,144 tokens. The API provides OpenAI-compatible chat completions and Anthropic-compatible Messages, POST /v1/messages.

Pricing

USD, pay per token

per 1M input tokens: $0.05
per 1M cached input tokens: $0.01
per 1M output tokens: $0.15

Measured performance

Output speed

540.9output tokens per second, model only

Time to first token

67milliseconds to first reasoning token

Cache hit rate

95.3%last 24 hours

Access

Confirm how your client reaches this model.

Provider: NVIDIA
API compatibility: OpenAI-compatible chat completions
Anthropic compatibility: Anthropic-compatible Messages, POST /v1/messages
Accepted input: Text only
Availability: Available
Data retention: Your prompts are never stored and never used for training.

Capacity

Check the limits your workload must fit.

Context window: 262,144 tokens
Maximum request size: 3.5 MB per request
Maximum generated output: 262,144 tokens

Capabilities

See which request modes the API supports.

Tool calling: Supported
JSON mode: Supported
Streaming: Supported
Precision: BF16, unquantized

View Full Spec

Gateway compatibility: OpenAI- and Anthropic-compatible APIs for compatible clients, tools, and gateways
Prefix caching: Automatic prefix caching runs on every replica, and requests from the same session or conversation are routed back to the replica that holds their cached prefix. A stable session hint or prompt_cache_key provides explicit grouping; otherwise RunInfra derives it from the start of the conversation. Hits remain best effort until eviction or a serve restart, never guaranteed. Cached input is billed at the cached input rate. Responses report cached token counts.
Cache retention: Prefix cache is held on the serving GPU and evicted under memory pressure. Retention is best effort.
Upstream model