Meta: Llama 3.1 70B Instruct provider comparison

meta-llama/llama-3.1-70b-instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...

Endpoints:: 3
Context:: 131.1K
Input:: text
Output:: text

Compare this model in a set →

At a glance

Comparison winners

Based on 1,000 input and 500 output tokens using the latest published median speed data.

Best cost/speed trade-off

DeepInfradeepinfra/turbo

$0.4 / 1M tokens

18.85 s estimated response

Cheapest

DeepInfradeepinfra/turbo

$0.4 / 1M tokens

$0.0006 for the sample request

Fastest

Weights & Biaseswandb/bf16

9.05 s estimated response

$0.8 / 1M tokens

Visual comparison

Price and performance charts

Compare published endpoint pricing and estimated response time visually.

Effective price by endpoint

USD per 1 million tokens for input and output. Lower is better.

DeepInfra has the lowest estimated cost for 1,000 input and 500 output tokens at $0.0006.

Estimated cost vs. response time

Based on 1,000 input and 500 output tokens. Cost is shown in USD per 1 million tokens. Lower and further left is better; the single best cost/speed trade-off appears at full opacity.

3 providers have complete pricing and speed data. DeepInfra is closest to the ideal combination of lowest cost and fastest response.

Server-rendered comparison

Provider endpoints

Prompt and completion prices are effective USD per token as published by OpenRouter. Missing speed data never removes an endpoint.

Rank providers by

Endpoint comparison for Meta: Llama 3.1 70B Instruct
Provider / route	Current pricing ↗	Speed measurements	Endpoint details
Provider / route DeepInfra`deepinfra/turbo` CheapestBest cost/speed trade-off	Current pricing Input price $0.4 / 1M tokens Output price $0.4 / 1M tokens Sample cost $0.0006	Speed measurements 500-token response 18.85 s Response starts 0.33 s Output speed 27.0 tok/s	Endpoint details Uptime (30 min) 92.69% Context 131.1K Model format fp8 Max output 16.4K 15 parameters frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_k, top_p
Provider / route Amazon Bedrock`amazon-bedrock`	Current pricing Input price $0.72 / 1M tokens Output price $0.72 / 1M tokens Sample cost $0.00108	Speed measurements 500-token response 21.37 s Response starts 0.53 s Output speed 24.0 tok/s	Endpoint details Uptime (30 min) 99.89% Context 131.1K Model format unknown Max output 8.2K 5 parameters max_tokens, stop, temperature, top_k, top_p
Provider / route Weights & Biases`wandb/bf16` Fastest	Current pricing Input price $0.8 / 1M tokens Output price $0.8 / 1M tokens Sample cost $0.0012	Speed measurements 500-token response 9.05 s Response starts 0.28 s Output speed 57.0 tok/s	Endpoint details Uptime (30 min) 100.00% Context 128K Model format bf16 Max output 128K 12 parameters frequency_penalty, logprobs, max_tokens, presence_penalty, repetition_penalty, seed, stop, structured_outputs, temperature, top_k, top_logprobs, top_p

Endpoint data fetched Jul 15, 2026, 11:17 PM UTC.

Llama 3.1 70B Instruct deployment guide

How to choose a Llama 3.1 70B Instruct inference provider

Llama 3.1 70B Instruct is indexed here as a text model by Meta, with 3 provider endpoints from DeepInfra, Amazon Bedrock, Weights & Biases. The comparison preserves each exact OpenRouter routing tag so pricing and performance observations can be connected to the route an application would actually request.

Match the endpoint to the workload

The model publishes a 131.1K-token context window. It accepts text input and returns text output. 17 distinct supported parameters appear across the listed routes. Confirm limits on the specific endpoint rather than assuming every host exposes the same configuration.

Compare the real request economics

DeepInfra currently has the lowest estimated cost for the standard 1,000-input/500-output-token sample at $0.0006. Input-heavy and output-heavy applications can produce a different result, so review both per-million-token prices in the endpoint table.

Balance response start and generation speed

Weights & Biases currently has the shortest estimated 500-token response at 9.05 seconds. DeepInfra is the single endpoint closest to the current ideal cost/speed combination. Recent observations can change, so validate finalists with your own prompts.