Snowflake Llama 3.1 405B
Open weights
API id
snowflake-llama-3.1-405bInput / 1M
-
not listed
Output / 1M
-
not listed
Context window
8K
tokens
Max output
8K
tokens per reply
Hosts
1
1 listings
Released
-
date not published
Where to run it
1 host serve Snowflake Llama 3.1 405B. The comparison is on blended price, 3 parts input to 1 part output.
| Host | In / out per 1M | Model id | |
|---|---|---|---|
SnowflakeCloud snowflake-llama-3.1-405b | - | snowflake-llama-3.1-405b |
Capabilities
Core
- Streaming
- Function calling
- JSON mode
- Structured outputs
Multimodal
- Vision
- Image input
- Audio
- Image generation
- Video
Advanced
- Reasoning
- Tool calling
- MCP
- Prompt caching
- Batch API
- Embeddings
- Takes in
- Text
- Produces
- Text
- Open weights
- License: Llama Community LicenseRuntimes: Ollama, TGI, llama.cpp, vLLM
Similar models
This model has no listed price, so these are current models with similar capabilities.
Smaller Independent models
No similar Independent model keeps its key capabilities.
Other frontier labs
Open-weight picks
Call it
Using Snowflake's API.
Python
from litellm import completion
response = completion(
model="snowflake/snowflake-llama-3.1-405b",
messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)Quick answers
Which APIs offer Snowflake Llama 3.1 405B?
Snowflake Llama 3.1 405B runs on 1 API: Snowflake.
What is Snowflake Llama 3.1 405B's context window?
8K tokens, with up to 8K tokens in one reply.
Is Snowflake Llama 3.1 405B being retired?
No retirement date is scheduled for it on any API we track.
What is Snowflake Llama 3.1 405B's API model id?
Use snowflake-llama-3.1-405b with Snowflake.
Sources
Raw catalog entry for snowflake-llama-3.1-405b on Snowflake
{
"litellm_provider": "snowflake",
"max_input_tokens": 8000,
"max_output_tokens": 8192,
"mode": "chat"
}