Llama3 405B Instruct
Open weights
API id
llama3-405b-instruct-maasInput / 1M
-
not listed
Output / 1M
-
not listed
Context window
32K
tokens
Max output
32K
tokens per reply
Hosts
1
1 listings
Released
-
date not published
Where to run it
1 host serve Llama3 405B Instruct. The comparison is on blended price, 3 parts input to 1 part output.
| Host | In / out per 1M | Model id | |
|---|---|---|---|
Vertex AICloud llama3-405b-instruct-maas | - | llama3-405b-instruct-maas |
Capabilities
Core
- Streaming
- Function calling
- JSON mode
- Structured outputs
Multimodal
- Vision
- Image input
- Audio
- Image generation
- Video
Advanced
- Reasoning
- Tool calling
- MCP
- Prompt caching
- Batch API
- Embeddings
- Takes in
- Text
- Produces
- Text
- Open weights
- License: Llama Community LicenseRuntimes: Ollama, TGI, llama.cpp, vLLM
Similar models
This model has no listed price, so these are current models with similar capabilities.
Smaller Meta models
Other frontier labs
Open-weight picks
Model line
Newer and older versions, at each lab's own price.
- UndatedLlama 3.1 405B InstructLatest$3.00 / $3.00
- UndatedLlama3.1 405B Instruct$0.80 / $0.80
- UndatedLlama3 405B InstructThis pageNot listed
Call it
Using Vertex AI's API.
Python
from litellm import completion
response = completion(
model="vertex_ai/llama3-405b-instruct-maas",
messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)Quick answers
Which APIs offer Llama3 405B Instruct?
Llama3 405B Instruct runs on 1 API: Vertex AI.
What is Llama3 405B Instruct's context window?
32K tokens, with up to 32K tokens in one reply.
Is Llama3 405B Instruct being retired?
No retirement date is scheduled for it on any API we track.
Is there a newer version of Llama3 405B Instruct?
Yes. Llama 3.1 405B Instruct is the newest model in this line.
What is Llama3 405B Instruct's API model id?
Use llama3-405b-instruct-maas with Vertex AI.
Sources
Raw catalog entry for llama3-405b-instruct-maas on Vertex AI
{
"input_cost_per_token": 0,
"litellm_provider": "vertex_ai-llama_models",
"max_input_tokens": 32000,
"max_output_tokens": 32000,
"mode": "chat",
"output_cost_per_token": 0,
"source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#partner-models",
"supports_tool_choice": true
}