Mid-size Llama 3.1 with balanced performance.
DigitSpace routes requests to the best providers that are able to handle your prompt size and parameters.
Mid-size Llama 3.1 with balanced performance. You can access it through DigitSpace's OpenAI-compatible API with automatic provider routing, fallback, and cost analytics.
Pricing for Llama 3.1 70B Instruct on DigitSpace starts at $0.72 per million input tokens and $0.72 per million output tokens, depending on the provider. The pricing table above always reflects the current per-provider rates.
Llama 3.1 70B Instruct supports a context window of up to 128,000 tokens on its largest provider deployment.
Llama 3.1 70B Instruct is served by AWS Bedrock through DigitSpace. Requests are automatically routed to the best available provider, with fallback when a provider has issues.
No. Llama 3.1 70B Instruct does not currently support tool calling or structured JSON outputs through DigitSpace.
Llama 3.1 70B Instruct was released on July 23, 2024.