Llama3 70B
Open weights
API id
llama3-70bInput / 1M
-
not listed
Output / 1M
-
not listed
Context window
8K
tokens
Max output
8K
tokens per reply
Hosts
1
2 listings
Released
-
date not published
Where to run it
1 host serve Llama3 70B. The comparison is on blended price, 3 parts input to 1 part output.
Capabilities
Core
- Streaming
- Function calling
- JSON mode
- Structured outputs
Multimodal
- Vision
- Image input
- Audio
- Image generation
- Video
Advanced
- Reasoning
- Tool calling
- MCP
- Prompt caching
- Batch API
- Embeddings
- Takes in
- Text
- Produces
- Text
- Open weights
- License: Llama Community LicenseRuntimes: Ollama, TGI, llama.cpp, vLLM
Similar models
This model has no listed price, so these are current models with similar capabilities.
Smaller Meta models
Other frontier labs
Open-weight picks
Model line
Newer and older versions, at each lab's own price.
- UndatedLlama 3.3 70BLatest$0.20 / $0.50
- UndatedLlama3.3 70B$0.72 / $0.72
- UndatedLlama 3.1 70B$0.60 / $0.60
- UndatedLlama3.1 70B$0.72 / $0.72
- UndatedLlama 3 70B$0.59 / $0.79
- UndatedLlama3 70BThis pageNot listed
- UndatedLlama 2 70B$0.10 / $0.10
- UndatedLlama2 70BNot listed
Call it
Using Snowflake's API.
Python
from litellm import completion
response = completion(
model="snowflake/llama3-70b",
messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)Quick answers
Which APIs offer Llama3 70B?
Llama3 70B runs on 1 API: Snowflake.
What is Llama3 70B's context window?
8K tokens, with up to 8K tokens in one reply.
Is Llama3 70B being retired?
No retirement date is scheduled for it on any API we track.
Is there a newer version of Llama3 70B?
Yes. Llama 3.3 70B is the newest model in this line.
What is Llama3 70B's API model id?
Use llama3-70b with Snowflake.
Sources
Raw catalog entry for llama3-70b on Snowflake
{
"litellm_provider": "snowflake",
"max_input_tokens": 8000,
"max_output_tokens": 8192,
"mode": "chat"
}