Phi 3.5 MOE Instruct
Open weights
API id
phi-3.5-moe-instructInput / 1M
-
not listed
Output / 1M
-
not listed
Context window
-
tokens
Max output
-
tokens per reply
Hosts
1
1 listings
Released
-
date not published
Where to run it
1 host serve Phi 3.5 MOE Instruct. The comparison is on blended price, 3 parts input to 1 part output.
| Host | In / out per 1M | Model id | |
|---|---|---|---|
NVIDIA NIMInference phi-3.5-moe-instruct | - | phi-3.5-moe-instruct |
Capabilities
Core
- Streaming
- Function calling
- JSON mode
- Structured outputs
Multimodal
- Vision
- Image input
- Audio
- Image generation
- Video
Advanced
- Reasoning
- Tool calling
- MCP
- Prompt caching
- Batch API
- Embeddings
- Takes in
- Text
- Produces
- Text
- Open weights
- License: MITRuntimes: Ollama, llama.cpp, vLLM
Similar models
This model has no listed price, so these are current models with similar capabilities.
Smaller Microsoft models
Other frontier labs
Open-weight picks
Call it
Using NVIDIA NIM's API.
Python
from litellm import completion
response = completion(
model="nvidia_nim/phi-3.5-moe-instruct",
messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)Quick answers
Which APIs offer Phi 3.5 MOE Instruct?
Phi 3.5 MOE Instruct runs on 1 API: NVIDIA NIM.
Is Phi 3.5 MOE Instruct being retired?
No retirement date is scheduled for it on any API we track.
What is Phi 3.5 MOE Instruct's API model id?
Use phi-3.5-moe-instruct with NVIDIA NIM.
Sources
Raw catalog entry for phi-3.5-moe-instruct on NVIDIA NIM
{
"litellm_provider": "nvidia_nim",
"source": "https://integrate.api.nvidia.com/v1/models"
}