impulse

Code Llama 70B

Open weights
API id codellama-70b
Input / 1M
-
not listed
Output / 1M
-
not listed
Context window
-
tokens
Max output
-
tokens per reply
Hosts
1
1 listings
Released
-
date not published

Where to run it

1 host serve Code Llama 70B. The comparison is on blended price, 3 parts input to 1 part output.

HostIn / out per 1M
NVIDIA NIMInference
codellama-70b
-

Capabilities

Core

  • Streaming
  • Function calling
  • JSON mode
  • Structured outputs

Multimodal

  • Vision
  • Image input
  • Audio
  • Image generation
  • Video

Advanced

  • Reasoning
  • Tool calling
  • MCP
  • Prompt caching
  • Batch API
  • Embeddings
Takes in
Text
Produces
Text
Open weights
License: Llama Community License
Runtimes: Ollama, TGI, llama.cpp, vLLM

Similar models

This model has no listed price, so these are current models with similar capabilities.

Smaller Meta models

Other frontier labs

  • GPT-5.5 Pro
    OpenAI · on OpenAI
    $30.00 / $180.00
    Has every key capability
  • Claude Fable 5.2
    Anthropic · on Anthropic
    $8.00 / $40.00
    Has every key capability
  • Gemini 4 Carbon
    Google · on Google AI Studio
    $2.00 / $10.00
    Has every key capability
  • Grok 4.7
    xAI · on xAI
    $2.00 / $6.00
    Has every key capability

Open-weight picks

  • Command A Plus
    Cohere · on AIHubMix
    $2.50 / $10.00
    Has every key capability
  • Kimi K3.1 Pro
    Moonshot AI · on Databricks
    $2.00 / $10.00
    Has every key capability
  • Qwen3.8.2 4T A95B
    Alibaba Qwen · on DeepInfra
    $2.00 / $6.00
    Has every key capability
  • Muse Spark Open
    Meta · on Baseten
    $1.25 / $4.25
    Has every key capability

Call it

Using NVIDIA NIM's API.

Python
from litellm import completion

response = completion(
    model="nvidia_nim/codellama-70b",
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)

Quick answers

Which APIs offer Code Llama 70B?

Code Llama 70B runs on 1 API: NVIDIA NIM.

Is Code Llama 70B being retired?

No retirement date is scheduled for it on any API we track.

What is Code Llama 70B's API model id?

Use codellama-70b with NVIDIA NIM.

Sources

Raw catalog entry for codellama-70b on NVIDIA NIM
{
  "litellm_provider": "nvidia_nim",
  "mode": "chat",
  "source": "https://build.nvidia.com/meta/codellama-70b.md",
  "supported_endpoints": [
    "/v1/chat/completions"
  ]
}