Llama 2 7B Chat Hf
Llama-2-7b-chat-hfPricing
List prices at Anyscale, in US dollars per million tokens.
| Tier | Input / 1M | Output / 1M | |
|---|---|---|---|
| Standard | $0.15 | $0.15 |
What it costs a month
At Anyscale list prices, 30 days.
- Chat assistant5,000 requests a day, 2K in / 0.5K out$56.25
- RAG over documents2,000 requests a day, 8K in / 0.6K out$77.40
- Coding agent1,000 requests a day, 40K in / 2K out$189
- Overnight batch20,000 requests a day, 4K in / 0.4K out$396
Where to run it
1 host serve Llama 2 7B Chat Hf. The comparison is on blended price, 3 parts input to 1 part output.
| Host | In / out per 1M | Model id | |
|---|---|---|---|
AnyscaleCloud Llama-2-7b-chat-hf | $0.15 / $0.15 | Llama-2-7b-chat-hf |
Capabilities
Core
- Streaming
- Function calling
- JSON mode
- Structured outputs
Multimodal
- Vision
- Image input
- Audio
- Image generation
- Video
Advanced
- Reasoning
- Tool calling
- MCP
- Prompt caching
- Batch API
- Embeddings
- Takes in
- Text
- Produces
- Text
- Open weights
- License: Llama Community LicenseRuntimes: Ollama, TGI, llama.cpp, vLLM
Cheaper alternatives
Current models that cost less and keep most of what this one can do: tools, vision, reasoning, structured output, caching and enough context.
Same model, cheaper host
No host sells it for less than Anyscale.
Smaller Meta models
- 17% less
Other frontier labs
No cheaper match from another frontier lab.
Open-weight picks
- 1% less
- 5% less
- 8% less
- 8% less
Call it
Using Anyscale's API.
from litellm import completion
response = completion(
model="anyscale/Llama-2-7b-chat-hf",
messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)Quick answers
How much does Llama 2 7B Chat Hf cost?
On Anyscale, Llama 2 7B Chat Hf costs $0.15 per million input tokens and $0.15 per million output tokens.
Which APIs offer Llama 2 7B Chat Hf?
Llama 2 7B Chat Hf runs on 1 API: Anyscale.
What is Llama 2 7B Chat Hf's context window?
4K tokens, with up to 4K tokens in one reply.
Is Llama 2 7B Chat Hf being retired?
No retirement date is scheduled for it on any API we track.
What are cheaper alternatives to Llama 2 7B Chat Hf?
Models that cost less and keep most of what it can do: Muse Spark 1.3 Contributor on Meta Model API (17% less) and MiMo V2.5 on GMI Cloud (1% less). Savings are on a mix of 3 input tokens to 1 output token.
What is Llama 2 7B Chat Hf's API model id?
Use Llama-2-7b-chat-hf with Anyscale.
Sources
Raw catalog entry for Llama-2-7b-chat-hf on Anyscale
{
"input_cost_per_token": 1.5e-7,
"litellm_provider": "anyscale",
"max_input_tokens": 4096,
"max_output_tokens": 4096,
"mode": "chat",
"output_cost_per_token": 1.5e-7
}