Code Llama 70B
Open weights
API id
codellama-70bInput / 1M
-
not listed
Output / 1M
-
not listed
Context window
-
tokens
Max output
-
tokens per reply
Hosts
1
1 listings
Released
-
date not published
Where to run it
1 host serve Code Llama 70B. The comparison is on blended price, 3 parts input to 1 part output.
| Host | In / out per 1M | Model id | |
|---|---|---|---|
NVIDIA NIMInference codellama-70b | - | codellama-70b |
Capabilities
Core
- Streaming
- Function calling
- JSON mode
- Structured outputs
Multimodal
- Vision
- Image input
- Audio
- Image generation
- Video
Advanced
- Reasoning
- Tool calling
- MCP
- Prompt caching
- Batch API
- Embeddings
- Takes in
- Text
- Produces
- Text
- Open weights
- License: Llama Community LicenseRuntimes: Ollama, TGI, llama.cpp, vLLM
Similar models
This model has no listed price, so these are current models with similar capabilities.
Smaller Meta models
Other frontier labs
Open-weight picks
Call it
Using NVIDIA NIM's API.
Python
from litellm import completion
response = completion(
model="nvidia_nim/codellama-70b",
messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)Quick answers
Which APIs offer Code Llama 70B?
Code Llama 70B runs on 1 API: NVIDIA NIM.
Is Code Llama 70B being retired?
No retirement date is scheduled for it on any API we track.
What is Code Llama 70B's API model id?
Use codellama-70b with NVIDIA NIM.
Sources
Raw catalog entry for codellama-70b on NVIDIA NIM
{
"litellm_provider": "nvidia_nim",
"mode": "chat",
"source": "https://build.nvidia.com/meta/codellama-70b.md",
"supported_endpoints": [
"/v1/chat/completions"
]
}