Llama 2 13B Chat Hf
Llama-2-13b-chat-hfPricing
List prices at Anyscale, in US dollars per million tokens.
| Tier | Input / 1M | Output / 1M | |
|---|---|---|---|
| Standard | $0.25 | $0.25 |
What it costs a month
At Anyscale list prices, 30 days.
- Chat assistant5,000 requests a day, 2K in / 0.5K out$93.75
- RAG over documents2,000 requests a day, 8K in / 0.6K out$129
- Coding agent1,000 requests a day, 40K in / 2K out$315
- Overnight batch20,000 requests a day, 4K in / 0.4K out$660
Where to run it
1 host serve Llama 2 13B Chat Hf. The comparison is on blended price, 3 parts input to 1 part output.
| Host | In / out per 1M | Model id | |
|---|---|---|---|
AnyscaleCloud Llama-2-13b-chat-hf | $0.25 / $0.25 | Llama-2-13b-chat-hf |
Capabilities
Core
- Streaming
- Function calling
- JSON mode
- Structured outputs
Multimodal
- Vision
- Image input
- Audio
- Image generation
- Video
Advanced
- Reasoning
- Tool calling
- MCP
- Prompt caching
- Batch API
- Embeddings
- Takes in
- Text
- Produces
- Text
- Open weights
- License: Llama Community LicenseRuntimes: Ollama, TGI, llama.cpp, vLLM
Cheaper alternatives
Current models that cost less and keep most of what this one can do: tools, vision, reasoning, structured output, caching and enough context.
Same model, cheaper host
No host sells it for less than Anyscale.
Smaller Meta models
- 50% less
- 20% less
Other frontier labs
- 20% less
- 20% less
Open-weight picks
- 4% less
- 20% less
- 28% less
- 36% less
Call it
Using Anyscale's API.
from litellm import completion
response = completion(
model="anyscale/Llama-2-13b-chat-hf",
messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)Quick answers
How much does Llama 2 13B Chat Hf cost?
On Anyscale, Llama 2 13B Chat Hf costs $0.25 per million input tokens and $0.25 per million output tokens.
Which APIs offer Llama 2 13B Chat Hf?
Llama 2 13B Chat Hf runs on 1 API: Anyscale.
What is Llama 2 13B Chat Hf's context window?
4K tokens, with up to 4K tokens in one reply.
Is Llama 2 13B Chat Hf being retired?
No retirement date is scheduled for it on any API we track.
What are cheaper alternatives to Llama 2 13B Chat Hf?
Models that cost less and keep most of what it can do: Muse Spark 1.3 Contributor on Meta Model API (50% less), Claude Haiku 5.5 on Anthropic (20% less), GPT-6 Luna on OpenAI (20% less) and Qwen3 Coder Next on AIHubMix (4% less). Savings are on a mix of 3 input tokens to 1 output token.
What is Llama 2 13B Chat Hf's API model id?
Use Llama-2-13b-chat-hf with Anyscale.
Sources
Raw catalog entry for Llama-2-13b-chat-hf on Anyscale
{
"input_cost_per_token": 2.5e-7,
"litellm_provider": "anyscale",
"max_input_tokens": 4096,
"max_output_tokens": 4096,
"mode": "chat",
"output_cost_per_token": 2.5e-7
}