Models/Meta-Llama-3-70B-Instruct

Meta-Llama-3-70B-InstructActive · Cloud

Anyscale · Released · Llama Community License

Anyscale chat model.

Context

8K

Max output

8K

Input

$1.00

Output

$1.00

Cached in

-

Latency

-

Capabilities

Core

Streaming

Function calling

JSON mode

Structured outputs

Multimodal

Vision

Image input

Audio

Image generation

Video

Advanced

Reasoning

Tool calling

MCP

Prompt caching

Batch API

Embeddings

Details

ProviderAnyscale

Released

LicenseLlama Community License

InputText

OutputText

Throughput-

Availability-

Related models

CodeLlama-34b-Instruct-hfAnyscale4K$1.00 CodeLlama-70b-Instruct-hfAnyscale4K$1.00 Llama-2-13b-chat-hfAnyscale4K$0.25