impulse

Llama3 70B Instruct

Open weights
API id meta.llama3-70b-instruct-v1:0
A newer model in this line is out: Llama 3.3 70B Instruct, released 6 Dec 2024.
Amazon Bedrock (except US government regions) retires it on 30 Mar 2027 (in 131 days); Amazon Bedrock (US government regions only) on 9 May 2027. 2 hosts keep serving it.
Input / 1M
$2.65
at Amazon Bedrock
Output / 1M
$3.50
at Amazon Bedrock
Context window
8K
tokens
Max output
8K
tokens per reply
Hosts
2
11 listings
Released
-
date not published

Pricing

List prices at Amazon Bedrock, in US dollars per million tokens.

TierInput / 1MOutput / 1M
Standard$2.65$3.50

What it costs a month

At Amazon Bedrock list prices, 30 days.

  • Chat assistant5,000 requests a day, 2K in / 0.5K out$1,058
  • RAG over documents2,000 requests a day, 8K in / 0.6K out$1,398
  • Coding agent1,000 requests a day, 40K in / 2K out$3,390
  • Overnight batch20,000 requests a day, 4K in / 0.4K out$7,200
Use your own numbers

Where to run it

2 hosts serve Llama3 70B Instruct. The comparison is on blended price, 3 parts input to 1 part output.

HostIn / out per 1M
meta.llama3-70b-instruct-v1:0
$2.65 / $3.50
Retires 30 Mar 2027
llama3-70b-instruct-maas
-
Show 9 more listings: regions, snapshots and variants
Amazon Bedrock
us-east-1
meta.llama3-70b-instruct-v1:0
$2.65 / $3.50
Retires 30 Mar 2027
us-gov-east-1
meta.llama3-70b-instruct-v1:0
$2.65 / $3.50
us-gov-west-1
meta.llama3-70b-instruct-v1:0
$2.65 / $3.50
Retires 9 May 2027
us-west-1
meta.llama3-70b-instruct-v1:0
$2.65 / $3.50
Retires 30 Mar 2027
eu-west-1
meta.llama3-70b-instruct-v1:0
$2.86 / $3.78
+8% vs headline
Retires 30 Mar 2027
ca-central-1
meta.llama3-70b-instruct-v1:0
$3.05 / $4.03
+15% vs headline
Retires 30 Mar 2027
ap-south-1
meta.llama3-70b-instruct-v1:0
$3.18 / $4.20
+20% vs headline
Retires 30 Mar 2027
eu-west-2
meta.llama3-70b-instruct-v1:0
$3.45 / $4.55
+30% vs headline
Retires 30 Mar 2027
sa-east-1
meta.llama3-70b-instruct-v1:0
$4.45 / $5.88
+68% vs headline
Retires 30 Mar 2027

Capabilities

Core

  • Streaming
  • Function calling
  • JSON mode
  • Structured outputs

Multimodal

  • Vision
  • Image input
  • Audio
  • Image generation
  • Video

Advanced

  • Reasoning
  • Tool calling
  • MCP
  • Prompt caching
  • Batch API
  • Embeddings
Takes in
Text
Produces
Text
Open weights
License: Llama Community License
Runtimes: Ollama, TGI, llama.cpp, vLLM

Cheaper alternatives

Current models that cost less and keep most of what this one can do: tools, vision, reasoning, structured output, caching and enough context.

Same model, cheaper host

No host sells it for less than Amazon Bedrock.

Smaller Meta models

Other frontier labs

  • GPT-6.1 Terra
    OpenAI · on OpenAI
    $1.00 / $5.00
    Has every key capability
    30% less
  • Grok 4.20 Multi Agent
    xAI · on xAI
    $1.25 / $2.50
    Has every key capability
    45% less
  • Gemini 3.8 Flash
    Google · on Google AI Studio
    $0.75 / $3.75
    Has every key capability
    48% less
  • Claude Haiku 5.5
    Anthropic · on Anthropic
    $0.10 / $0.50
    Has every key capability
    93% less

Open-weight picks

  • Qwen4 Max
    Alibaba Qwen · on Together AI
    $1.43 / $4.28
    Has every key capability
    25% less
  • Muse Spark Open
    Meta · on Baseten
    $1.25 / $4.25
    Has every key capability
    30% less
  • Inkling
    Independent · on DeepInfra
    $0.95 / $4.05
    Has every key capability
    40% less
  • GLM 5.3
    Zhipu AI · on CLF AI Gateway
    $0.56 / $1.76
    Has every key capability
    70% less

Model line

Newer and older versions, at each lab's own price.

  1. Dec 2024Llama 3.3 70B InstructLatestNot listed
  2. Dec 2024Llama3.3 70B Instruct$0.12 / $0.30
  3. Jul 2024Llama 3.1 70B Instruct$0.72 / $0.72
  4. Jul 2024Llama3.1 70B Instruct$0.12 / $0.30
  5. UndatedLlama 3 70B Instruct$0.51 / $0.74
  6. UndatedLlama3 70B InstructThis page$2.65 / $3.50

Call it

Using Amazon Bedrock's API.

Python
from litellm import completion

response = completion(
    model="bedrock/meta.llama3-70b-instruct-v1:0",
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)

Quick answers

How much does Llama3 70B Instruct cost?

On Amazon Bedrock, Llama3 70B Instruct costs $2.65 per million input tokens and $3.50 per million output tokens.

Which APIs offer Llama3 70B Instruct?

Llama3 70B Instruct runs on 2 APIs: Amazon Bedrock and Vertex AI.

What is Llama3 70B Instruct's context window?

8K tokens, with up to 8K tokens in one reply.

Is Llama3 70B Instruct being retired?

Amazon Bedrock (except US government regions) retires it on 30 Mar 2027; Amazon Bedrock (US government regions only) on 9 May 2027. 2 hosts keep serving it.

Is there a newer version of Llama3 70B Instruct?

Yes. Llama 3.3 70B Instruct is the newest model in this line, released on 6 Dec 2024.

What are cheaper alternatives to Llama3 70B Instruct?

Models that cost less and keep most of what it can do: Muse Spark 1.3 on Meta Model API (30% less), GPT-6.1 Terra on OpenAI (30% less), Grok 4.20 Multi Agent on xAI (45% less) and Qwen4 Max on Together AI (25% less). Savings are on a mix of 3 input tokens to 1 output token.

What is Llama3 70B Instruct's API model id?

Use meta.llama3-70b-instruct-v1:0 with Amazon Bedrock. Other hosts use their own ids: llama3-70b-instruct-maas on Vertex AI.

Sources

Raw catalog entry for meta.llama3-70b-instruct-v1:0 on Amazon Bedrock
{
  "deprecation_date": "2027-03-30",
  "deprecation_source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-meta-llama-3-70b-instruct.md",
  "input_cost_per_token": 0.00000265,
  "litellm_provider": "bedrock",
  "max_input_tokens": 8192,
  "max_output_tokens": 8192,
  "mode": "chat",
  "output_cost_per_token": 0.0000035,
  "source": "https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-meta-llama-3-70b-instruct.md"
}