Llama 3.3 8B Instruct
Open weights
API id
Llama-3.3-8B-InstructInput / 1M
-
not listed
Output / 1M
-
not listed
Context window
128K
tokens
Max output
4K
tokens per reply
Hosts
1
1 listings
Released
-
date not published
Where to run it
1 host serve Llama 3.3 8B Instruct. The comparison is on blended price, 3 parts input to 1 part output.
| Host | In / out per 1M | Model id | |
|---|---|---|---|
Llama APILab API Llama-3.3-8B-Instruct | - | Llama-3.3-8B-Instruct |
Capabilities
Core
- Streaming
- Function calling
- JSON mode
- Structured outputs
Multimodal
- Vision
- Image input
- Audio
- Image generation
- Video
Advanced
- Reasoning
- Tool calling
- MCP
- Prompt caching
- Batch API
- Embeddings
- Takes in
- Text
- Produces
- Text
- Open weights
- License: Llama Community LicenseRuntimes: Ollama, TGI, llama.cpp, vLLM
Similar models
This model has no listed price, so these are current models with similar capabilities.
Smaller Meta models
Other frontier labs
Open-weight picks
Model line
Newer and older versions, at each lab's own price.
- UndatedLlama 3.3 8B InstructLatestNot listed
- Jul 2024Llama 3.1 8B Instruct$0.02 / $0.05
- Jul 2024Llama3.1 8B Instruct$0.025 / $0.04
- UndatedLlama 3 8B Instruct$0.04 / $0.04
- UndatedLlama3 8B Instruct$0.30 / $0.60
Call it
Using Llama API's API.
Python
from litellm import completion
response = completion(
model="meta_llama/Llama-3.3-8B-Instruct",
messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)Quick answers
Which APIs offer Llama 3.3 8B Instruct?
Llama 3.3 8B Instruct runs on 1 API: Llama API.
What is Llama 3.3 8B Instruct's context window?
128K tokens, with up to 4K tokens in one reply.
Is Llama 3.3 8B Instruct being retired?
No retirement date is scheduled for it on any API we track.
Is there a newer version of Llama 3.3 8B Instruct?
No. Llama 3.3 8B Instruct is the newest model in its line.
What is Llama 3.3 8B Instruct's API model id?
Use Llama-3.3-8B-Instruct with Llama API.
Sources
Raw catalog entry for Llama-3.3-8B-Instruct on Llama API
{
"litellm_provider": "meta_llama",
"max_input_tokens": 128000,
"max_output_tokens": 4028,
"mode": "chat",
"source": "https://ai.developer.meta.com/docs/models",
"supported_modalities": [
"text"
],
"supported_output_modalities": [
"text"
],
"supports_function_calling": true,
"supports_tool_choice": true
}