Nemotron 3.5 Lightning 30B A3B
Open weights
API id
nemotron-3.5-lightning-30b-a3bInput / 1M
-
not listed
Output / 1M
-
not listed
Context window
-
tokens
Max output
33K
tokens per reply
Hosts
2
2 listings
Released
-
date not published
Where to run it
2 hosts serve Nemotron 3.5 Lightning 30B A3B. The comparison is on blended price, 3 parts input to 1 part output.
| Host | In / out per 1M | Model id | |
|---|---|---|---|
NVIDIA NIMInference nemotron-3.5-lightning-30b-a3b | - | nemotron-3.5-lightning-30b-a3b | |
PerplexityGateway nemotron-3.5-lightning-30b-a3b | $0.0115 / $0.17 | nemotron-3.5-lightning-30b-a3b |
Capabilities
Core
- Streaming
- Function calling
- JSON mode
- Structured outputs
Multimodal
- Vision
- Image input
- Audio
- Image generation
- Video
Advanced
- Reasoning
- Tool calling
- MCP
- Prompt caching
- Batch API
- Embeddings
- Takes in
- Text
- Produces
- Text
- Open weights
- License: NVIDIA Open Model LicenseRuntimes: TGI, vLLM
Similar models
This model has no listed price, so these are current models with similar capabilities.
Smaller NVIDIA models
No similar NVIDIA model keeps its key capabilities.
Other frontier labs
Open-weight picks
Model line
Newer and older versions, at each lab's own price.
- UndatedNemotron 3.5 Lightning 30B A3BLatestNot listed
- UndatedNemotron Lightning 3.5 30B A3B$0.05 / $0.20
Call it
Using NVIDIA NIM's API.
Python
from litellm import completion
response = completion(
model="nvidia_nim/nemotron-3.5-lightning-30b-a3b",
messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)Quick answers
How much does Nemotron 3.5 Lightning 30B A3B cost?
Its lowest listed price is at Perplexity: $0.0115 per million input tokens and $0.17 per million output tokens.
Which APIs offer Nemotron 3.5 Lightning 30B A3B?
Nemotron 3.5 Lightning 30B A3B runs on 2 APIs: NVIDIA NIM and Perplexity.
Is Nemotron 3.5 Lightning 30B A3B being retired?
No retirement date is scheduled for it on any API we track.
Is there a newer version of Nemotron 3.5 Lightning 30B A3B?
No. Nemotron 3.5 Lightning 30B A3B is the newest model in its line.
What is Nemotron 3.5 Lightning 30B A3B's API model id?
Use nemotron-3.5-lightning-30b-a3b with NVIDIA NIM.
Sources
Raw catalog entry for nemotron-3.5-lightning-30b-a3b on NVIDIA NIM
{
"litellm_provider": "nvidia_nim",
"max_output_tokens": 32768,
"mode": "chat",
"source": "https://build.nvidia.com/nvidia/nemotron-3.5-lightning-30b-a3b.md",
"supported_endpoints": [
"/v1/chat/completions"
]
}