impulse

Llama 3 70B

Open weights
API id llama-3-70b
Input / 1M
$0.59
at Vercel AI Gateway
Output / 1M
$0.79
at Vercel AI Gateway
Context window
8K
tokens
Max output
8K
tokens per reply
Hosts
2
2 listings
Released
-
date not published

Pricing

List prices at Vercel AI Gateway, in US dollars per million tokens.

TierInput / 1MOutput / 1M
Standard$0.59$0.79

What it costs a month

At Vercel AI Gateway list prices, 30 days.

  • Chat assistant5,000 requests a day, 2K in / 0.5K out$236
  • RAG over documents2,000 requests a day, 8K in / 0.6K out$312
  • Coding agent1,000 requests a day, 40K in / 2K out$755
  • Overnight batch20,000 requests a day, 4K in / 0.4K out$1,606
Use your own numbers

Where to run it

2 hosts serve Llama 3 70B. The comparison is on blended price, 3 parts input to 1 part output.

HostIn / out per 1M
llama-3-70b
$0.59 / $0.79
ReplicateInference
llama-3-70b
$0.65 / $2.75
+84% vs headline

Capabilities

Core

  • Streaming
  • Function calling
  • JSON mode
  • Structured outputs

Multimodal

  • Vision
  • Image input
  • Audio
  • Image generation
  • Video

Advanced

  • Reasoning
  • Tool calling
  • MCP
  • Prompt caching
  • Batch API
  • Embeddings
Takes in
Text
Produces
Text
Open weights
License: Llama Community License
Runtimes: Ollama, TGI, llama.cpp, vLLM

Cheaper alternatives

Current models that cost less and keep most of what this one can do: tools, vision, reasoning, structured output, caching and enough context.

Same model, cheaper host

No host sells it for less than Vercel AI Gateway.

Smaller Meta models

Other frontier labs

  • GPT-5.4 Nano
    OpenAI · on OpenAI
    $0.20 / $1.25
    Has every key capability
    28% less
  • Claude Haiku 5.5
    Anthropic · on Anthropic
    $0.10 / $0.50
    Has every key capability
    69% less
  • GPT-6 Luna
    OpenAI · on OpenAI
    $0.10 / $0.50
    Has every key capability
    69% less
  • GPT-4o Mini
    OpenAI · on OpenAI
    $0.15 / $0.60
    Has every key capability
    59% less

Open-weight picks

  • Inkling Small
    Independent · on DeepInfra
    $0.45 / $1.20
    Has every key capability
    0% less
  • DeepSeek Flash
    DeepSeek · on DeepSeek
    $0.30 / $1.20
    Has every key capability
    18% less
  • Qwen3.7 Plus
    Alibaba Qwen · on Replicate
    $0.276 / $1.10
    Has every key capability
    25% less
  • GLM 4 6v
    Zhipu AI · on Novita AI
    $0.30 / $0.90
    Has every key capability
    30% less

Model line

Newer and older versions, at each lab's own price.

  1. UndatedLlama 3.3 70BLatest$0.20 / $0.50
  2. UndatedLlama3.3 70B$0.72 / $0.72
  3. UndatedLlama 3.1 70B$0.60 / $0.60
  4. UndatedLlama3.1 70B$0.72 / $0.72
  5. UndatedLlama 3 70BThis page$0.59 / $0.79
  6. UndatedLlama3 70BNot listed
  7. UndatedLlama 2 70B$0.10 / $0.10
  8. UndatedLlama2 70BNot listed

Call it

Using Vercel AI Gateway's API.

Python
from litellm import completion

response = completion(
    model="vercel_ai_gateway/llama-3-70b",
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)

Quick answers

How much does Llama 3 70B cost?

On Vercel AI Gateway, Llama 3 70B costs $0.59 per million input tokens and $0.79 per million output tokens.

Which APIs offer Llama 3 70B?

Llama 3 70B runs on 2 APIs: Vercel AI Gateway and Replicate.

What is Llama 3 70B's context window?

8K tokens, with up to 8K tokens in one reply.

Is Llama 3 70B being retired?

No retirement date is scheduled for it on any API we track.

Is there a newer version of Llama 3 70B?

Yes. Llama 3.3 70B is the newest model in this line.

What are cheaper alternatives to Llama 3 70B?

Models that cost less and keep most of what it can do: Muse Spark 1.3 Contributor on Meta Model API (80% less), GPT-5.4 Nano on OpenAI (28% less), Claude Haiku 5.5 on Anthropic (69% less) and Inkling Small on DeepInfra (0% less). Savings are on a mix of 3 input tokens to 1 output token.

What is Llama 3 70B's API model id?

Use llama-3-70b with Vercel AI Gateway.

Sources

Raw catalog entry for llama-3-70b on Vercel AI Gateway
{
  "input_cost_per_token": 5.9e-7,
  "litellm_provider": "vercel_ai_gateway",
  "max_input_tokens": 8192,
  "max_output_tokens": 8192,
  "mode": "chat",
  "output_cost_per_token": 7.9e-7,
  "supports_tool_choice": true
}