Llama 3.1 Nemotron Ultra 253B
Open weights
API id
llama-3.1-nemotron-ultra-253b-v1Input / 1M
-
not listed
Output / 1M
-
not listed
Context window
131K
tokens
Max output
131K
tokens per reply
Hosts
2
3 listings
Released
-
date not published
Where to run it
2 hosts serve Llama 3.1 Nemotron Ultra 253B. The comparison is on blended price, 3 parts input to 1 part output.
| Host | In / out per 1M | Model id | |
|---|---|---|---|
NVIDIA NIMInference llama-3.1-nemotron-ultra-253b-v1 | - | llama-3.1-nemotron-ultra-253b-v1 | |
Nebius AI StudioInference Llama-3.1-Nemotron-Ultra-253B-v1 | $0.60 / $1.80 | Llama-3.1-Nemotron-Ultra-253B-v1 |
Show 1 more listings: regions, snapshots and variantsHide regional listings
| Nebius AI Studio | |||||||
| Alias Llama-3_1-Nemotron-Ultra-253B-v1 | $0.60 / $1.80 | Llama-3_1-Nemotron-Ultra-253B-v1 | |||||
Capabilities
Core
- Streaming
- Function calling
- JSON mode
- Structured outputs
Multimodal
- Vision
- Image input
- Audio
- Image generation
- Video
Advanced
- Reasoning
- Tool calling
- MCP
- Prompt caching
- Batch API
- Embeddings
- Takes in
- Text
- Produces
- Text
- Open weights
- License: Llama Community LicenseRuntimes: Ollama, TGI, llama.cpp, vLLM
Similar models
This model has no listed price, so these are current models with similar capabilities.
Smaller NVIDIA models
No similar NVIDIA model keeps its key capabilities.
Other frontier labs
Open-weight picks
Call it
Using NVIDIA NIM's API.
Python
from litellm import completion
response = completion(
model="nvidia_nim/llama-3.1-nemotron-ultra-253b-v1",
messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)Quick answers
How much does Llama 3.1 Nemotron Ultra 253B cost?
Its lowest listed price is at Nebius AI Studio: $0.60 per million input tokens and $1.80 per million output tokens.
Which APIs offer Llama 3.1 Nemotron Ultra 253B?
Llama 3.1 Nemotron Ultra 253B runs on 2 APIs: NVIDIA NIM and Nebius AI Studio.
What is Llama 3.1 Nemotron Ultra 253B's context window?
131K tokens, with up to 131K tokens in one reply.
Is Llama 3.1 Nemotron Ultra 253B being retired?
No retirement date is scheduled for it on any API we track.
What is Llama 3.1 Nemotron Ultra 253B's API model id?
Use llama-3.1-nemotron-ultra-253b-v1 with NVIDIA NIM. Other hosts use their own ids: Llama-3.1-Nemotron-Ultra-253B-v1 on Nebius AI Studio.
Sources
Raw catalog entry for llama-3.1-nemotron-ultra-253b-v1 on NVIDIA NIM
{
"litellm_provider": "nvidia_nim",
"source": "https://integrate.api.nvidia.com/v1/models"
}