impulse

Llama 3.2 Nv Rerankqa 1B

Open weightsRerank
API id llama-3.2-nv-rerankqa-1b-v2
Input / 1M
-
not listed
Output / 1M
-
not listed
Context window
-
tokens
Max output
-
tokens per reply
Hosts
1
2 listings
Released
-
date not published

Where to run it

1 host serve Llama 3.2 Nv Rerankqa 1B. The comparison is on blended price, 3 parts input to 1 part output.

HostIn / out per 1M
NVIDIA NIMInference
llama-3.2-nv-rerankqa-1b-v2
-
Show 1 more listings: regions, snapshots and variants
NVIDIA NIM
Alias
llama-3_2-nv-rerankqa-1b-v2
-

Capabilities

Core

  • Streaming
  • Function calling
  • JSON mode
  • Structured outputs

Multimodal

  • Vision
  • Image input
  • Audio
  • Image generation
  • Video

Advanced

  • Reasoning
  • Tool calling
  • MCP
  • Prompt caching
  • Batch API
  • Embeddings
Takes in
Text
Produces
Text
Open weights
License: Llama Community License
Runtimes: Ollama, TGI, llama.cpp, vLLM

Similar models

This model has no listed price, so these are current models with similar capabilities.

Smaller Meta models

No similar Meta model keeps its key capabilities.

Other frontier labs

No similar match from another frontier lab.

Open-weight picks

Call it

Using NVIDIA NIM's API.

Python
from litellm import completion

response = completion(
    model="nvidia_nim/llama-3.2-nv-rerankqa-1b-v2",
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)

Quick answers

Which APIs offer Llama 3.2 Nv Rerankqa 1B?

Llama 3.2 Nv Rerankqa 1B runs on 1 API: NVIDIA NIM.

Is Llama 3.2 Nv Rerankqa 1B being retired?

No retirement date is scheduled for it on any API we track.

What is Llama 3.2 Nv Rerankqa 1B's API model id?

Use llama-3.2-nv-rerankqa-1b-v2 with NVIDIA NIM.

Sources

Raw catalog entry for llama-3.2-nv-rerankqa-1b-v2 on NVIDIA NIM
{
  "input_cost_per_query": 0,
  "input_cost_per_token": 0,
  "litellm_provider": "nvidia_nim",
  "mode": "rerank",
  "output_cost_per_token": 0
}