Skip to content

Highest Output-Speed DeepSeek V3.1 Inference Providers

Ranks providers by their recent typical output speed in tokens per second. Providers without enough recent data remain visible after ranked rows.

Google Vertex currently ranks first at 151.0 tok/s via google-vertex/us-west2.

Provider options:
8
Ranked:
8
Metric:
Output speed

Highest output speed endpoint ranking

Highest Output-Speed DeepSeek V3.1 Inference Providers
RankProvider / routeOutput speedSpeed measurementsEndpoint details
#1Provider / route
Google Vertexgoogle-vertex/us-west2
Output speed151.0 tok/sSpeed measurements
500-token response
3.96 s
Response starts
0.65 s
Output speed
151.0 tok/s
Endpoint details
Input price
$0.6 / 1M tokens
Output price
$1.7 / 1M tokens
Uptime (30 min)
99.40%
Context
163.8K
#2Provider / route
SambaNovasambanova/fp8
Output speed53.0 tok/sSpeed measurements
500-token response
10.21 s
Response starts
0.77 s
Output speed
53.0 tok/s
Endpoint details
Input price
$0.65 / 1M tokens
Output price
$1.5 / 1M tokens
Uptime (30 min)
99.22%
Context
131.1K
#3Provider / route
Output speed47.0 tok/sSpeed measurements
500-token response
11.00 s
Response starts
0.37 s
Output speed
47.0 tok/s
Endpoint details
Input price
$0.55 / 1M tokens
Output price
$1.65 / 1M tokens
Uptime (30 min)
100.00%
Context
161K
#4Provider / route
MARAmara
Output speed46.5 tok/sSpeed measurements
500-token response
13.17 s
Response starts
2.41 s
Output speed
46.5 tok/s
Endpoint details
Input price
$0.6 / 1M tokens
Output price
$1.7 / 1M tokens
Uptime (30 min)
91.50%
Context
131.1K
#5Provider / route
NovitaAInovita/fp8
Output speed18.0 tok/sSpeed measurements
500-token response
29.51 s
Response starts
1.73 s
Output speed
18.0 tok/s
Endpoint details
Input price
$0.27 / 1M tokens
Output price
$1 / 1M tokens
Uptime (30 min)
100.00%
Context
131.1K
#6Provider / route
SiliconFlowsiliconflow/fp8
Output speed18.0 tok/sSpeed measurements
500-token response
29.40 s
Response starts
1.62 s
Output speed
18.0 tok/s
Endpoint details
Input price
$0.27 / 1M tokens
Output price
$1 / 1M tokens
Uptime (30 min)
97.45%
Context
163.8K
#7Provider / route
DeepInfradeepinfra/fp4
Output speed9.0 tok/sSpeed measurements
500-token response
56.59 s
Response starts
1.04 s
Output speed
9.0 tok/s
Endpoint details
Input price
$0.25 / 1M tokens
Output price
$0.95 / 1M tokens
Uptime (30 min)
99.12%
Context
163.8K
#8Provider / route
AtlasCloudatlas-cloud/fp8
Output speed4.0 tok/sSpeed measurements
500-token response
126.46 s
Response starts
1.46 s
Output speed
4.0 tok/s
Endpoint details
Input price
$0.3 / 1M tokens
Output price
$0.95 / 1M tokens
Uptime (30 min)
99.87%
Context
131.1K

Endpoint data fetched .

DeepSeek V3.1 endpoint guide

How to interpret the Highest Output-Speed DeepSeek V3.1 Inference Providers

8 of 8 DeepSeek V3.1 endpoints currently have the published data required for this ranking. Google Vertex leads at 151.0 tok/s via google-vertex/us-west2. The table keeps unranked routes visible so missing measurements do not look like missing provider availability.

How generation throughput is ranked

The output-speed ranking compares recent median generated tokens per second. It favors routes that complete long generations quickly, while first-token latency remains a separate measure of how responsive the endpoint feels at the beginning.

Compare Google Vertex with the next option

SambaNova currently ranks second at 53.0 tok/s. Compare that gap with input and output price, response-start time, output speed, 30-minute uptime, context length, and the exact route before deciding whether first place is meaningful for your workload.

Use the route, not only the provider name

DeepSeek V3.1 has 8 published provider options, and performance data is matched to each exact OpenRouter routing tag. Different quantization, context, regional deployment, or provider configuration can change price and behavior even when the underlying model name is identical.