Llama3.1
Open weights
API id
llama3.1Input / 1M
-
not listed
Output / 1M
-
not listed
Context window
8K
tokens
Max output
8K
tokens per reply
Hosts
0
1 listings
Released
-
date not published
Where to run it
0 hosts serve Llama3.1. The comparison is on blended price, 3 parts input to 1 part output.
| Host | In / out per 1M | Model id | |
|---|---|---|---|
OllamaLocal llama3.1 | - | llama3.1 |
Capabilities
Core
- Streaming
- Function calling
- JSON mode
- Structured outputs
Multimodal
- Vision
- Image input
- Audio
- Image generation
- Video
Advanced
- Reasoning
- Tool calling
- MCP
- Prompt caching
- Batch API
- Embeddings
- Takes in
- Text
- Produces
- Text
- Open weights
- License: Llama Community LicenseRuntimes: Ollama, TGI, llama.cpp, vLLM
Similar models
This model has no listed price, so these are current models with similar capabilities.
Smaller Meta models
Other frontier labs
Open-weight picks
Model line
Newer and older versions, at each lab's own price.
Call it
Using Ollama's API.
Python
from litellm import completion
response = completion(
model="ollama/llama3.1",
messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)Quick answers
What is Llama3.1's context window?
8K tokens, with up to 8K tokens in one reply.
Is there a newer version of Llama3.1?
No. Llama3.1 is the newest model in its line.
What is Llama3.1's API model id?
Use llama3.1 with Ollama.
Sources
Raw catalog entry for llama3.1 on Ollama
{
"input_cost_per_token": 0,
"litellm_provider": "ollama",
"max_input_tokens": 8192,
"max_output_tokens": 8192,
"mode": "chat",
"output_cost_per_token": 0,
"supports_function_calling": true
}