Llama 3 70B
llama-3-70bPricing
List prices at Vercel AI Gateway, in US dollars per million tokens.
| Tier | Input / 1M | Output / 1M | |
|---|---|---|---|
| Standard | $0.59 | $0.79 |
What it costs a month
At Vercel AI Gateway list prices, 30 days.
- Chat assistant5,000 requests a day, 2K in / 0.5K out$236
- RAG over documents2,000 requests a day, 8K in / 0.6K out$312
- Coding agent1,000 requests a day, 40K in / 2K out$755
- Overnight batch20,000 requests a day, 4K in / 0.4K out$1,606
Where to run it
2 hosts serve Llama 3 70B. The comparison is on blended price, 3 parts input to 1 part output.
| Host | In / out per 1M | Model id | |
|---|---|---|---|
Vercel AI GatewayGateway llama-3-70b | $0.59 / $0.79 | llama-3-70b | |
ReplicateInference llama-3-70b | $0.65 / $2.75 +84% vs headline | llama-3-70b |
Capabilities
Core
- Streaming
- Function calling
- JSON mode
- Structured outputs
Multimodal
- Vision
- Image input
- Audio
- Image generation
- Video
Advanced
- Reasoning
- Tool calling
- MCP
- Prompt caching
- Batch API
- Embeddings
- Takes in
- Text
- Produces
- Text
- Open weights
- License: Llama Community LicenseRuntimes: Ollama, TGI, llama.cpp, vLLM
Cheaper alternatives
Current models that cost less and keep most of what this one can do: tools, vision, reasoning, structured output, caching and enough context.
Same model, cheaper host
No host sells it for less than Vercel AI Gateway.
Smaller Meta models
- 80% less
- 69% less
Other frontier labs
- 28% less
- 69% less
- 69% less
- 59% less
Open-weight picks
- 0% less
- 18% less
- 25% less
- 30% less
Model line
Newer and older versions, at each lab's own price.
- UndatedLlama 3.3 70BLatest$0.20 / $0.50
- UndatedLlama3.3 70B$0.72 / $0.72
- UndatedLlama 3.1 70B$0.60 / $0.60
- UndatedLlama3.1 70B$0.72 / $0.72
- UndatedLlama 3 70BThis page$0.59 / $0.79
- UndatedLlama3 70BNot listed
- UndatedLlama 2 70B$0.10 / $0.10
- UndatedLlama2 70BNot listed
Call it
Using Vercel AI Gateway's API.
from litellm import completion
response = completion(
model="vercel_ai_gateway/llama-3-70b",
messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)Quick answers
How much does Llama 3 70B cost?
On Vercel AI Gateway, Llama 3 70B costs $0.59 per million input tokens and $0.79 per million output tokens.
Which APIs offer Llama 3 70B?
Llama 3 70B runs on 2 APIs: Vercel AI Gateway and Replicate.
What is Llama 3 70B's context window?
8K tokens, with up to 8K tokens in one reply.
Is Llama 3 70B being retired?
No retirement date is scheduled for it on any API we track.
Is there a newer version of Llama 3 70B?
Yes. Llama 3.3 70B is the newest model in this line.
What are cheaper alternatives to Llama 3 70B?
Models that cost less and keep most of what it can do: Muse Spark 1.3 Contributor on Meta Model API (80% less), GPT-5.4 Nano on OpenAI (28% less), Claude Haiku 5.5 on Anthropic (69% less) and Inkling Small on DeepInfra (0% less). Savings are on a mix of 3 input tokens to 1 output token.
What is Llama 3 70B's API model id?
Use llama-3-70b with Vercel AI Gateway.
Sources
Raw catalog entry for llama-3-70b on Vercel AI Gateway
{
"input_cost_per_token": 5.9e-7,
"litellm_provider": "vercel_ai_gateway",
"max_input_tokens": 8192,
"max_output_tokens": 8192,
"mode": "chat",
"output_cost_per_token": 7.9e-7,
"supports_tool_choice": true
}