Llama 2 70B Chat
llama-v2-70b-chatPricing
List prices at Fireworks AI, in US dollars per million tokens.
| Tier | Input / 1M | Output / 1M | |
|---|---|---|---|
| Standard | $0.90 | $0.90 |
What it costs a month
At Fireworks AI list prices, 30 days.
- Chat assistant5,000 requests a day, 2K in / 0.5K out$338
- RAG over documents2,000 requests a day, 8K in / 0.6K out$464
- Coding agent1,000 requests a day, 40K in / 2K out$1,134
- Overnight batch20,000 requests a day, 4K in / 0.4K out$2,376
Where to run it
3 hosts serve Llama 2 70B Chat. The comparison is on blended price, 3 parts input to 1 part output.
| Host | In / out per 1M | Model id | |
|---|---|---|---|
Fireworks AIInference llama-v2-70b-chat | $0.90 / $0.90 | llama-v2-70b-chat | |
ReplicateInference llama-2-70b-chat | $0.65 / $2.75 +31% vs headline | llama-2-70b-chat | |
PerplexityGateway llama-2-70b-chat | $0.70 / $2.80 +36% vs headline | llama-2-70b-chat |
Capabilities
Core
- Streaming
- Function calling
- JSON mode
- Structured outputs
Multimodal
- Vision
- Image input
- Audio
- Image generation
- Video
Advanced
- Reasoning
- Tool calling
- MCP
- Prompt caching
- Batch API
- Embeddings
- Takes in
- Text
- Produces
- Text
- Open weights
- License: Llama Community LicenseRuntimes: Ollama, TGI, llama.cpp, vLLM
Cheaper alternatives
Current models that cost less and keep most of what this one can do: tools, vision, reasoning, structured output, caching and enough context.
Same model, cheaper host
No host sells it for less than Fireworks AI.
Smaller Meta models
- 86% less
- 78% less
Other frontier labs
- 6% less
- 49% less
- 78% less
- 78% less
Open-weight picks
- 3% less
- 4% less
- 10% less
- 12% less
Model line
Newer and older versions, at each lab's own price.
- UndatedLlama 2 70B ChatLatest$0.90 / $0.90
- UndatedLlama2 70B Chat$1.95 / $2.56
Call it
Using Fireworks AI's API.
from litellm import completion
response = completion(
model="fireworks_ai/llama-v2-70b-chat",
messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)Quick answers
How much does Llama 2 70B Chat cost?
On Fireworks AI, Llama 2 70B Chat costs $0.90 per million input tokens and $0.90 per million output tokens.
Which APIs offer Llama 2 70B Chat?
Llama 2 70B Chat runs on 3 APIs: Fireworks AI, Replicate and Perplexity.
What is Llama 2 70B Chat's context window?
2K tokens, with up to 2K tokens in one reply.
Is Llama 2 70B Chat being retired?
No retirement date is scheduled for it on any API we track.
Is there a newer version of Llama 2 70B Chat?
No. Llama 2 70B Chat is the newest model in its line.
What are cheaper alternatives to Llama 2 70B Chat?
Models that cost less and keep most of what it can do: Muse Spark 1.3 Contributor on Meta Model API (86% less), Gemini 3.5 Flash Lite on Google AI Studio (6% less), GPT-5.4 Nano on OpenAI (49% less) and Motif 3 on ai& (3% less). Savings are on a mix of 3 input tokens to 1 output token.
What is Llama 2 70B Chat's API model id?
Use llama-v2-70b-chat with Fireworks AI. Other hosts use their own ids: llama-2-70b-chat on Replicate, llama-2-70b-chat on Perplexity.
Sources
Raw catalog entry for llama-v2-70b-chat on Fireworks AI
{
"max_input_tokens": 2048,
"max_output_tokens": 2048,
"input_cost_per_token": 9e-7,
"output_cost_per_token": 9e-7,
"litellm_provider": "fireworks_ai",
"mode": "chat"
}