impulse

Llama3 405B Instruct

Open weights
API id llama3-405b-instruct-maas
Input / 1M
-
not listed
Output / 1M
-
not listed
Context window
32K
tokens
Max output
32K
tokens per reply
Hosts
1
1 listings
Released
-
date not published

Where to run it

1 host serve Llama3 405B Instruct. The comparison is on blended price, 3 parts input to 1 part output.

HostIn / out per 1M
llama3-405b-instruct-maas
-

Capabilities

Core

  • Streaming
  • Function calling
  • JSON mode
  • Structured outputs

Multimodal

  • Vision
  • Image input
  • Audio
  • Image generation
  • Video

Advanced

  • Reasoning
  • Tool calling
  • MCP
  • Prompt caching
  • Batch API
  • Embeddings
Takes in
Text
Produces
Text
Open weights
License: Llama Community License
Runtimes: Ollama, TGI, llama.cpp, vLLM

Similar models

This model has no listed price, so these are current models with similar capabilities.

Smaller Meta models

Other frontier labs

  • GPT-5.5 Pro
    OpenAI · on OpenAI
    $30.00 / $180.00
    Has every key capability
  • Claude Fable 5.2
    Anthropic · on Anthropic
    $8.00 / $40.00
    Has every key capability
  • Gemini 4 Carbon
    Google · on Google AI Studio
    $2.00 / $10.00
    Has every key capability
  • Grok 4.7
    xAI · on xAI
    $2.00 / $6.00
    Has every key capability

Open-weight picks

  • Command A Plus
    Cohere · on AIHubMix
    $2.50 / $10.00
    Has every key capability
  • Kimi K3.1 Pro
    Moonshot AI · on Databricks
    $2.00 / $10.00
    Has every key capability
  • Qwen3.8.2 4T A95B
    Alibaba Qwen · on DeepInfra
    $2.00 / $6.00
    Has every key capability
  • Muse Spark Open
    Meta · on Baseten
    $1.25 / $4.25
    Has every key capability

Model line

Newer and older versions, at each lab's own price.

  1. UndatedLlama 3.1 405B InstructLatest$3.00 / $3.00
  2. UndatedLlama3.1 405B Instruct$0.80 / $0.80
  3. UndatedLlama3 405B InstructThis pageNot listed

Call it

Using Vertex AI's API.

Python
from litellm import completion

response = completion(
    model="vertex_ai/llama3-405b-instruct-maas",
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)

Quick answers

Which APIs offer Llama3 405B Instruct?

Llama3 405B Instruct runs on 1 API: Vertex AI.

What is Llama3 405B Instruct's context window?

32K tokens, with up to 32K tokens in one reply.

Is Llama3 405B Instruct being retired?

No retirement date is scheduled for it on any API we track.

Is there a newer version of Llama3 405B Instruct?

Yes. Llama 3.1 405B Instruct is the newest model in this line.

What is Llama3 405B Instruct's API model id?

Use llama3-405b-instruct-maas with Vertex AI.

Sources

Raw catalog entry for llama3-405b-instruct-maas on Vertex AI
{
  "input_cost_per_token": 0,
  "litellm_provider": "vertex_ai-llama_models",
  "max_input_tokens": 32000,
  "max_output_tokens": 32000,
  "mode": "chat",
  "output_cost_per_token": 0,
  "source": "https://cloud.google.com/vertex-ai/generative-ai/pricing#partner-models",
  "supports_tool_choice": true
}