Providers/Nvidia NIM

Nvidia NIM

Inference provider · docs.litellm.ai

Nvidia NIM models via API.

Models
3
Endpoints
4
Regions
0
Avg input
$0.00
Auth
API key
SDKs
0

Endpoints

POST/v1/chat/completionsCompletionsStream
POST/v1/messagesMessagesStream
POST/v1/rerankRerank-
POST/v1/responsesResponsesStream

Models · 3

Release timeline

llama-3.2-nv-rerankqa-1b-v2
llama-3_2-nv-rerankqa-1b-v2
nv-rerankqa-mistral-4b-v3

Details

CategoryInference provider
AuthAPI key
Regions-