impulse

Llama 2 70B Chat Hf

Open weights
API id Llama-2-70b-chat-hf
Input / 1M
$1.00
at Anyscale
Output / 1M
$1.00
at Anyscale
Context window
4K
tokens
Max output
4K
tokens per reply
Hosts
1
1 listings
Released
-
date not published

Pricing

List prices at Anyscale, in US dollars per million tokens.

TierInput / 1MOutput / 1M
Standard$1.00$1.00

What it costs a month

At Anyscale list prices, 30 days.

  • Chat assistant5,000 requests a day, 2K in / 0.5K out$375
  • RAG over documents2,000 requests a day, 8K in / 0.6K out$516
  • Coding agent1,000 requests a day, 40K in / 2K out$1,260
  • Overnight batch20,000 requests a day, 4K in / 0.4K out$2,640
Use your own numbers

Where to run it

1 host serve Llama 2 70B Chat Hf. The comparison is on blended price, 3 parts input to 1 part output.

HostIn / out per 1M
Llama-2-70b-chat-hf
$1.00 / $1.00

Capabilities

Core

  • Streaming
  • Function calling
  • JSON mode
  • Structured outputs

Multimodal

  • Vision
  • Image input
  • Audio
  • Image generation
  • Video

Advanced

  • Reasoning
  • Tool calling
  • MCP
  • Prompt caching
  • Batch API
  • Embeddings
Takes in
Text
Produces
Text
Open weights
License: Llama Community License
Runtimes: Ollama, TGI, llama.cpp, vLLM

Cheaper alternatives

Current models that cost less and keep most of what this one can do: tools, vision, reasoning, structured output, caching and enough context.

Same model, cheaper host

No host sells it for less than Anyscale.

Smaller Meta models

Other frontier labs

  • Gemini 3.5 Flash Lite
    Google · on Google AI Studio
    $0.30 / $2.50
    Has every key capability
    15% less
  • GPT-5.4 Nano
    OpenAI · on OpenAI
    $0.20 / $1.25
    Has every key capability
    54% less
  • Claude Haiku 5.5
    Anthropic · on Anthropic
    $0.10 / $0.50
    Has every key capability
    80% less
  • GPT-6 Luna
    OpenAI · on OpenAI
    $0.10 / $0.50
    Has every key capability
    80% less

Open-weight picks

  • Motif 3
    Independent · on ai&
    $0.50 / $2.00
    Has every key capability
    13% less
  • GLM 5.3
    Zhipu AI · on CLF AI Gateway
    $0.56 / $1.76
    Has every key capability
    14% less
  • Nemotron 3 Ultra 550B A55B
    NVIDIA · on Perplexity
    $0.25 / $2.50
    Has every key capability
    19% less
  • DeepSeek V4 Pro
    DeepSeek · on CLF AI Gateway
    $0.528 / $1.58
    Has every key capability
    21% less

Call it

Using Anyscale's API.

Python
from litellm import completion

response = completion(
    model="anyscale/Llama-2-70b-chat-hf",
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)

Quick answers

How much does Llama 2 70B Chat Hf cost?

On Anyscale, Llama 2 70B Chat Hf costs $1.00 per million input tokens and $1.00 per million output tokens.

Which APIs offer Llama 2 70B Chat Hf?

Llama 2 70B Chat Hf runs on 1 API: Anyscale.

What is Llama 2 70B Chat Hf's context window?

4K tokens, with up to 4K tokens in one reply.

Is Llama 2 70B Chat Hf being retired?

No retirement date is scheduled for it on any API we track.

What are cheaper alternatives to Llama 2 70B Chat Hf?

Models that cost less and keep most of what it can do: Muse Spark 1.3 Contributor on Meta Model API (88% less), Gemini 3.5 Flash Lite on Google AI Studio (15% less), GPT-5.4 Nano on OpenAI (54% less) and Motif 3 on ai& (13% less). Savings are on a mix of 3 input tokens to 1 output token.

What is Llama 2 70B Chat Hf's API model id?

Use Llama-2-70b-chat-hf with Anyscale.

Sources

Raw catalog entry for Llama-2-70b-chat-hf on Anyscale
{
  "input_cost_per_token": 0.000001,
  "litellm_provider": "anyscale",
  "max_input_tokens": 4096,
  "max_output_tokens": 4096,
  "mode": "chat",
  "output_cost_per_token": 0.000001
}