impulse

Granite 8B Code Instruct

Open weights
API id granite-8b-code-instruct
Input / 1M
-
not listed
Output / 1M
-
not listed
Context window
-
tokens
Max output
-
tokens per reply
Hosts
1
1 listings
Released
-
date not published

Where to run it

1 host serve Granite 8B Code Instruct. The comparison is on blended price, 3 parts input to 1 part output.

HostIn / out per 1M
NVIDIA NIMInference
granite-8b-code-instruct
-

Capabilities

Core

  • Streaming
  • Function calling
  • JSON mode
  • Structured outputs

Multimodal

  • Vision
  • Image input
  • Audio
  • Image generation
  • Video

Advanced

  • Reasoning
  • Tool calling
  • MCP
  • Prompt caching
  • Batch API
  • Embeddings
Takes in
Text
Produces
Text
Open weights
License: Apache-2.0
Runtimes: Ollama, llama.cpp, vLLM

Similar models

This model has no listed price, so these are current models with similar capabilities.

Smaller IBM models

No similar IBM model keeps its key capabilities.

Other frontier labs

  • GPT-5.5 Pro
    OpenAI · on OpenAI
    $30.00 / $180.00
    Has every key capability
  • Claude Fable 5.2
    Anthropic · on Anthropic
    $8.00 / $40.00
    Has every key capability
  • Gemini 4 Carbon
    Google · on Google AI Studio
    $2.00 / $10.00
    Has every key capability
  • Grok 4.7
    xAI · on xAI
    $2.00 / $6.00
    Has every key capability

Open-weight picks

  • Command A Plus
    Cohere · on AIHubMix
    $2.50 / $10.00
    Has every key capability
  • Kimi K3.1 Pro
    Moonshot AI · on Databricks
    $2.00 / $10.00
    Has every key capability
  • Qwen3.8.2 4T A95B
    Alibaba Qwen · on DeepInfra
    $2.00 / $6.00
    Has every key capability
  • Muse Spark Open
    Meta · on Baseten
    $1.25 / $4.25
    Has every key capability

Call it

Using NVIDIA NIM's API.

Python
from litellm import completion

response = completion(
    model="nvidia_nim/granite-8b-code-instruct",
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)

Quick answers

Which APIs offer Granite 8B Code Instruct?

Granite 8B Code Instruct runs on 1 API: NVIDIA NIM.

Is Granite 8B Code Instruct being retired?

No retirement date is scheduled for it on any API we track.

What is Granite 8B Code Instruct's API model id?

Use granite-8b-code-instruct with NVIDIA NIM.

Sources

Raw catalog entry for granite-8b-code-instruct on NVIDIA NIM
{
  "litellm_provider": "nvidia_nim",
  "mode": "chat",
  "source": "https://build.nvidia.com/ibm/granite-8b-code-instruct.md",
  "supported_endpoints": [
    "/v1/chat/completions"
  ]
}