Granite 34B Code Instruct
Open weights
API id
granite-34b-code-instructInput / 1M
-
not listed
Output / 1M
-
not listed
Context window
-
tokens
Max output
-
tokens per reply
Hosts
1
1 listings
Released
-
date not published
Where to run it
1 host serve Granite 34B Code Instruct. The comparison is on blended price, 3 parts input to 1 part output.
| Host | In / out per 1M | Model id | |
|---|---|---|---|
NVIDIA NIMInference granite-34b-code-instruct | - | granite-34b-code-instruct |
Capabilities
Core
- Streaming
- Function calling
- JSON mode
- Structured outputs
Multimodal
- Vision
- Image input
- Audio
- Image generation
- Video
Advanced
- Reasoning
- Tool calling
- MCP
- Prompt caching
- Batch API
- Embeddings
- Takes in
- Text
- Produces
- Text
- Open weights
- License: Apache-2.0Runtimes: Ollama, llama.cpp, vLLM
Similar models
This model has no listed price, so these are current models with similar capabilities.
Smaller IBM models
No similar IBM model keeps its key capabilities.
Other frontier labs
Open-weight picks
Call it
Using NVIDIA NIM's API.
Python
from litellm import completion
response = completion(
model="nvidia_nim/granite-34b-code-instruct",
messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)Quick answers
Which APIs offer Granite 34B Code Instruct?
Granite 34B Code Instruct runs on 1 API: NVIDIA NIM.
Is Granite 34B Code Instruct being retired?
No retirement date is scheduled for it on any API we track.
What is Granite 34B Code Instruct's API model id?
Use granite-34b-code-instruct with NVIDIA NIM.
Sources
Raw catalog entry for granite-34b-code-instruct on NVIDIA NIM
{
"litellm_provider": "nvidia_nim",
"mode": "chat",
"source": "https://build.nvidia.com/ibm/granite-34b-code-instruct.md",
"supported_endpoints": [
"/v1/chat/completions"
]
}