impulse

Llama 2 13B Chat Hf

Open weights
API id Llama-2-13b-chat-hf
Input / 1M
$0.25
at Anyscale
Output / 1M
$0.25
at Anyscale
Context window
4K
tokens
Max output
4K
tokens per reply
Hosts
1
1 listings
Released
-
date not published

Pricing

List prices at Anyscale, in US dollars per million tokens.

TierInput / 1MOutput / 1M
Standard$0.25$0.25

What it costs a month

At Anyscale list prices, 30 days.

  • Chat assistant5,000 requests a day, 2K in / 0.5K out$93.75
  • RAG over documents2,000 requests a day, 8K in / 0.6K out$129
  • Coding agent1,000 requests a day, 40K in / 2K out$315
  • Overnight batch20,000 requests a day, 4K in / 0.4K out$660
Use your own numbers

Where to run it

1 host serve Llama 2 13B Chat Hf. The comparison is on blended price, 3 parts input to 1 part output.

HostIn / out per 1M
Llama-2-13b-chat-hf
$0.25 / $0.25

Capabilities

Core

  • Streaming
  • Function calling
  • JSON mode
  • Structured outputs

Multimodal

  • Vision
  • Image input
  • Audio
  • Image generation
  • Video

Advanced

  • Reasoning
  • Tool calling
  • MCP
  • Prompt caching
  • Batch API
  • Embeddings
Takes in
Text
Produces
Text
Open weights
License: Llama Community License
Runtimes: Ollama, TGI, llama.cpp, vLLM

Cheaper alternatives

Current models that cost less and keep most of what this one can do: tools, vision, reasoning, structured output, caching and enough context.

Same model, cheaper host

No host sells it for less than Anyscale.

Smaller Meta models

Other frontier labs

  • Claude Haiku 5.5
    Anthropic · on Anthropic
    $0.10 / $0.50
    Has every key capability
    20% less
  • GPT-6 Luna
    OpenAI · on OpenAI
    $0.10 / $0.50
    Has every key capability
    20% less

Open-weight picks

  • Qwen3 Coder Next
    Alibaba Qwen · on AIHubMix
    $0.137 / $0.548
    Has every key capability
    4% less
  • Ministral 14B 2512
    Mistral AI · on Mistral AI
    $0.20 / $0.20
    Has every key capability
    20% less
  • Nemotron 3.5 Super VL
    NVIDIA · on Kyma API
    $0.081 / $0.472
    Has every key capability
    28% less
  • Gemma 4 31B IT
    Google · on W&B Inference
    $0.10 / $0.34
    Has every key capability
    36% less

Call it

Using Anyscale's API.

Python
from litellm import completion

response = completion(
    model="anyscale/Llama-2-13b-chat-hf",
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)

Quick answers

How much does Llama 2 13B Chat Hf cost?

On Anyscale, Llama 2 13B Chat Hf costs $0.25 per million input tokens and $0.25 per million output tokens.

Which APIs offer Llama 2 13B Chat Hf?

Llama 2 13B Chat Hf runs on 1 API: Anyscale.

What is Llama 2 13B Chat Hf's context window?

4K tokens, with up to 4K tokens in one reply.

Is Llama 2 13B Chat Hf being retired?

No retirement date is scheduled for it on any API we track.

What are cheaper alternatives to Llama 2 13B Chat Hf?

Models that cost less and keep most of what it can do: Muse Spark 1.3 Contributor on Meta Model API (50% less), Claude Haiku 5.5 on Anthropic (20% less), GPT-6 Luna on OpenAI (20% less) and Qwen3 Coder Next on AIHubMix (4% less). Savings are on a mix of 3 input tokens to 1 output token.

What is Llama 2 13B Chat Hf's API model id?

Use Llama-2-13b-chat-hf with Anyscale.

Sources

Raw catalog entry for Llama-2-13b-chat-hf on Anyscale
{
  "input_cost_per_token": 2.5e-7,
  "litellm_provider": "anyscale",
  "max_input_tokens": 4096,
  "max_output_tokens": 4096,
  "mode": "chat",
  "output_cost_per_token": 2.5e-7
}