Compare models
Up to 4 models side by side: list prices, what a month of real traffic costs, limits and capabilities. The best value in each row is marked with a check.
| Model | |
|---|---|
| Overview | |
| Released | 19 Sep 2024 |
| Status | Older Newer: Qwen2.5 72B Instruct |
| Open weights | Yes, Apache-2.0 |
| Hosts APIs you can call it on | 1 |
| Price · USD per million tokens, at the lab's own API where it sells the model | |
| Priced at | Novita AI |
| Input | $0.38 |
| Output | $0.40 |
| Cached input | - |
| Batch input / output | - |
| Cheapest anywhere input / output | $0.38 / $0.40 Novita AI |
| Monthly bill · at the price above, 30 days, with each workload's cache and batch use | |
| Chat assistant 5,000 a day, 2K in, 500 out | $144 |
| RAG over documents 2,000 a day, 8K in, 600 out | $197 |
| Coding agent 1,000 a day, 40K in, 2K out | $480 |
| Overnight batch 20,000 a day, 4K in, 400 out | $1,008 |
| Limits | |
| Context window | 32K tokens |
| Max output | 8K tokens |
| Capabilities | |
| Takes in | Text |
| Produces | Text |
| Effort settings as listed by the source | - |
| Streaming | |
| Function calling | |
| JSON mode | |
| Structured outputs | |
| Tool calling | |
| Parallel tool calls | |