Skip to content

Highest Output-Speed gpt-oss-20b Inference Providers

Ranks providers by their recent typical output speed in tokens per second. Providers without enough recent data remain visible after ranked rows.

Groq currently ranks first at 547.0 tok/s via groq.

Provider options:
13
Ranked:
12
Metric:
Output speed

Highest output speed endpoint ranking

Highest Output-Speed gpt-oss-20b Inference Providers
RankProvider / routeOutput speedSpeed measurementsEndpoint details
#1Provider / route
Groqgroq
Output speed547.0 tok/sSpeed measurements
500-token response
1.21 s
Response starts
0.30 s
Output speed
547.0 tok/s
Endpoint details
Input price
$0.075 / 1M tokens
Output price
$0.3 / 1M tokens
Uptime (30 min)
99.91%
Context
131.1K
#2Provider / route
Output speed156.0 tok/sSpeed measurements
500-token response
3.48 s
Response starts
0.28 s
Output speed
156.0 tok/s
Endpoint details
Input price
$0.03 / 1M tokens
Output price
$0.13 / 1M tokens
Uptime (30 min)
99.63%
Context
131.1K
#3Provider / route
Google Vertexgoogle-vertex/us-central1
Output speed144.0 tok/sSpeed measurements
500-token response
6.78 s
Response starts
3.31 s
Output speed
144.0 tok/s
Endpoint details
Input price
$0.07 / 1M tokens
Output price
$0.25 / 1M tokens
Uptime (30 min)
61.56%
Context
131.1K
#4Provider / route
Fireworksfireworks
Output speed126.0 tok/sSpeed measurements
500-token response
4.30 s
Response starts
0.33 s
Output speed
126.0 tok/s
Endpoint details
Input price
$0.07 / 1M tokens
Output price
$0.3 / 1M tokens
Uptime (30 min)
99.06%
Context
131.1K
#5Provider / route
DeepInfradeepinfra/bf16
Output speed107.0 tok/sSpeed measurements
500-token response
5.43 s
Response starts
0.76 s
Output speed
107.0 tok/s
Endpoint details
Input price
$0.03 / 1M tokens
Output price
$0.14 / 1M tokens
Uptime (30 min)
100.00%
Context
131.1K
#6Provider / route
Togethertogether
Output speed104.5 tok/sSpeed measurements
500-token response
5.05 s
Response starts
0.27 s
Output speed
104.5 tok/s
Endpoint details
Input price
$0.05 / 1M tokens
Output price
$0.2 / 1M tokens
Uptime (30 min)
Insufficient recent data
Context
131.1K
#7Provider / route
Parasailparasail/fp4
Output speed98.0 tok/sSpeed measurements
500-token response
5.58 s
Response starts
0.47 s
Output speed
98.0 tok/s
Endpoint details
Input price
$0.04 / 1M tokens
Output price
$0.2 / 1M tokens
Uptime (30 min)
96.17%
Context
131.1K
#8Provider / route
Amazon Bedrockamazon-bedrock
Output speed60.0 tok/sSpeed measurements
500-token response
16.02 s
Response starts
7.69 s
Output speed
60.0 tok/s
Endpoint details
Input price
$0.07 / 1M tokens
Output price
$0.15 / 1M tokens
Uptime (30 min)
97.07%
Context
131.1K
#9Provider / route
Phalaphala
Output speed56.0 tok/sSpeed measurements
500-token response
9.55 s
Response starts
0.62 s
Output speed
56.0 tok/s
Endpoint details
Input price
$0.04 / 1M tokens
Output price
$0.15 / 1M tokens
Uptime (30 min)
100.00%
Context
131.1K
#10Provider / route
NovitaAInovita/fp4
Output speed27.0 tok/sSpeed measurements
500-token response
19.09 s
Response starts
0.57 s
Output speed
27.0 tok/s
Endpoint details
Input price
$0.04 / 1M tokens
Output price
$0.15 / 1M tokens
Uptime (30 min)
100.00%
Context
131.1K
#11Provider / route
DekaLLMdekallm/bf16
Output speed17.0 tok/sSpeed measurements
500-token response
30.32 s
Response starts
0.91 s
Output speed
17.0 tok/s
Endpoint details
Input price
$0.029 / 1M tokens
Output price
$0.14 / 1M tokens
Uptime (30 min)
96.95%
Context
131.1K
#12Provider / route
SiliconFlowsiliconflow/fp8
Output speed11.0 tok/sSpeed measurements
500-token response
46.81 s
Response starts
1.35 s
Output speed
11.0 tok/s
Endpoint details
Input price
$0.04 / 1M tokens
Output price
$0.18 / 1M tokens
Uptime (30 min)
100.00%
Context
131.1K
Provider / route
Amazon Bedrockamazon-bedrock/eu-west-1
Output speedInsufficient recent dataSpeed measurements
500-token response
Insufficient recent data
Response starts
Insufficient recent data
Output speed
Insufficient recent data
Endpoint details
Input price
$0.07 / 1M tokens
Output price
$0.15 / 1M tokens
Uptime (30 min)
Insufficient recent data
Context
131.1K

Endpoint data fetched .

gpt-oss-20b endpoint guide

How to interpret the Highest Output-Speed gpt-oss-20b Inference Providers

12 of 13 gpt-oss-20b endpoints currently have the published data required for this ranking. Groq leads at 547.0 tok/s via groq. The table keeps unranked routes visible so missing measurements do not look like missing provider availability.

How generation throughput is ranked

The output-speed ranking compares recent median generated tokens per second. It favors routes that complete long generations quickly, while first-token latency remains a separate measure of how responsive the endpoint feels at the beginning.

Compare Groq with the next option

Weights & Biases currently ranks second at 156.0 tok/s. Compare that gap with input and output price, response-start time, output speed, 30-minute uptime, context length, and the exact route before deciding whether first place is meaningful for your workload.

Use the route, not only the provider name

gpt-oss-20b has 13 published provider options, and performance data is matched to each exact OpenRouter routing tag. Different quantization, context, regional deployment, or provider configuration can change price and behavior even when the underlying model name is identical.