Skip to content

Fastest First-Token gpt-oss-120b Inference Providers

Ranks providers by how quickly the first generated token appears. Providers without enough recent data remain visible after ranked rows.

Groq currently ranks first at 0.14 s via groq.

Provider options:
21
Ranked:
20
Metric:
Time to first token

Fastest first token endpoint ranking

Fastest First-Token gpt-oss-120b Inference Providers
RankProvider / routeTime to first tokenSpeed measurementsEndpoint details
#1Provider / route
Groqgroq
Time to first token0.14 sSpeed measurements
500-token response
1.41 s
Response starts
0.14 s
Output speed
392.5 tok/s
Endpoint details
Input price
$0.15 / 1M tokens
Output price
$0.6 / 1M tokens
Uptime (30 min)
99.64%
Context
131.1K
#2Provider / route
Cerebrascerebras/fp16
Time to first token0.23 sSpeed measurements
500-token response
0.82 s
Response starts
0.23 s
Output speed
857.0 tok/s
Endpoint details
Input price
$0.35 / 1M tokens
Output price
$0.75 / 1M tokens
Uptime (30 min)
99.93%
Context
131.1K
#3Provider / route
Togethertogether
Time to first token0.23 sSpeed measurements
500-token response
5.04 s
Response starts
0.23 s
Output speed
104.0 tok/s
Endpoint details
Input price
$0.15 / 1M tokens
Output price
$0.6 / 1M tokens
Uptime (30 min)
88.78%
Context
131.1K
#4Provider / route
Basetenbaseten/fp4
Time to first token0.24 sSpeed measurements
500-token response
2.42 s
Response starts
0.24 s
Output speed
230.0 tok/s
Endpoint details
Input price
$0.1 / 1M tokens
Output price
$0.5 / 1M tokens
Uptime (30 min)
100.00%
Context
128.1K
#5Provider / route
SambaNovasambanova
Time to first token0.32 sSpeed measurements
500-token response
4.17 s
Response starts
0.32 s
Output speed
130.0 tok/s
Endpoint details
Input price
$0.14 / 1M tokens
Output price
$0.95 / 1M tokens
Uptime (30 min)
99.03%
Context
131.1K
#6Provider / route
Google Vertexgoogle-vertex/global
Time to first token0.38 sSpeed measurements
500-token response
3.81 s
Response starts
0.38 s
Output speed
146.0 tok/s
Endpoint details
Input price
$0.09 / 1M tokens
Output price
$0.36 / 1M tokens
Uptime (30 min)
97.58%
Context
131.1K
#7Provider / route
Parasailparasail/fp4
Time to first token0.39 sSpeed measurements
500-token response
6.27 s
Response starts
0.39 s
Output speed
85.0 tok/s
Endpoint details
Input price
$0.1 / 1M tokens
Output price
$0.75 / 1M tokens
Uptime (30 min)
95.94%
Context
131.1K
#8Provider / route
OpenInferenceopen-inference/int8
Time to first token0.44 sSpeed measurements
500-token response
13.60 s
Response starts
0.44 s
Output speed
38.0 tok/s
Endpoint details
Input price
$0.03 / 1M tokens
Output price
$0.15 / 1M tokens
Uptime (30 min)
99.81%
Context
131.1K
#9Provider / route
Time to first token0.46 sSpeed measurements
500-token response
13.62 s
Response starts
0.46 s
Output speed
38.0 tok/s
Endpoint details
Input price
$0.04 / 1M tokens
Output price
$0.14 / 1M tokens
Uptime (30 min)
97.23%
Context
131.1K
#10Provider / route
Nebiusnebius/fp4
Time to first token0.54 sSpeed measurements
500-token response
5.92 s
Response starts
0.54 s
Output speed
93.0 tok/s
Endpoint details
Input price
$0.15 / 1M tokens
Output price
$0.6 / 1M tokens
Uptime (30 min)
85.41%
Context
131.1K
#11Provider / route
DeepInfradeepinfra/turbo
Time to first token0.62 sSpeed measurements
500-token response
5.47 s
Response starts
0.62 s
Output speed
103.0 tok/s
Endpoint details
Input price
$0.15 / 1M tokens
Output price
$0.6 / 1M tokens
Uptime (30 min)
99.91%
Context
131.1K
#12Provider / route
NovitaAInovita/fp4
Time to first token0.67 sSpeed measurements
500-token response
11.78 s
Response starts
0.67 s
Output speed
45.0 tok/s
Endpoint details
Input price
$0.05 / 1M tokens
Output price
$0.25 / 1M tokens
Uptime (30 min)
80.20%
Context
131.1K
#13Provider / route
Phalaphala
Time to first token0.91 sSpeed measurements
500-token response
7.95 s
Response starts
0.91 s
Output speed
71.0 tok/s
Endpoint details
Input price
$0.15 / 1M tokens
Output price
$0.6 / 1M tokens
Uptime (30 min)
99.47%
Context
131.1K
#14Provider / route
MARAmara
Time to first token1.07 sSpeed measurements
500-token response
4.09 s
Response starts
1.07 s
Output speed
166.0 tok/s
Endpoint details
Input price
$0.15 / 1M tokens
Output price
$0.75 / 1M tokens
Uptime (30 min)
91.76%
Context
131.1K
#15Provider / route
DekaLLMdekallm/bf16
Time to first token1.11 sSpeed measurements
500-token response
16.74 s
Response starts
1.11 s
Output speed
32.0 tok/s
Endpoint details
Input price
$0.03 / 1M tokens
Output price
$0.18 / 1M tokens
Uptime (30 min)
96.73%
Context
131.1K
#16Provider / route
SiliconFlowsiliconflow/fp8
Time to first token1.30 sSpeed measurements
500-token response
22.14 s
Response starts
1.30 s
Output speed
24.0 tok/s
Endpoint details
Input price
$0.05 / 1M tokens
Output price
$0.45 / 1M tokens
Uptime (30 min)
100.00%
Context
131.1K
#17Provider / route
Mancermancer/fp4
Time to first token1.56 sSpeed measurements
500-token response
15.08 s
Response starts
1.56 s
Output speed
37.0 tok/s
Endpoint details
Input price
$0.045 / 1M tokens
Output price
$0.375 / 1M tokens
Uptime (30 min)
88.11%
Context
131.1K
#18Provider / route
Amazon Bedrockamazon-bedrock
Time to first token2.07 sSpeed measurements
500-token response
5.32 s
Response starts
2.07 s
Output speed
154.0 tok/s
Endpoint details
Input price
$0.15 / 1M tokens
Output price
$0.6 / 1M tokens
Uptime (30 min)
100.00%
Context
131.1K
#19Provider / route
DigitalOceandigitalocean
Time to first token3.42 sSpeed measurements
500-token response
24.25 s
Response starts
3.42 s
Output speed
24.0 tok/s
Endpoint details
Input price
$0.07 / 1M tokens
Output price
$0.49 / 1M tokens
Uptime (30 min)
98.54%
Context
128K
#20Provider / route
DeepInfradeepinfra/bf16
Time to first token8.13 sSpeed measurements
500-token response
20.95 s
Response starts
8.13 s
Output speed
39.0 tok/s
Endpoint details
Input price
$0.037 / 1M tokens
Output price
$0.17 / 1M tokens
Uptime (30 min)
70.18%
Context
131.1K
Provider / route
Amazon Bedrockamazon-bedrock/eu-west-1
Time to first tokenInsufficient recent dataSpeed measurements
500-token response
Insufficient recent data
Response starts
Insufficient recent data
Output speed
Insufficient recent data
Endpoint details
Input price
$0.15 / 1M tokens
Output price
$0.6 / 1M tokens
Uptime (30 min)
Insufficient recent data
Context
131.1K

Endpoint data fetched .

gpt-oss-120b endpoint guide

How to interpret the Fastest First-Token gpt-oss-120b Inference Providers

20 of 21 gpt-oss-120b endpoints currently have the published data required for this ranking. Groq leads at 0.14 s via groq. The table keeps unranked routes visible so missing measurements do not look like missing provider availability.

How response-start time is ranked

The first-token ranking orders endpoints by the recent median time before output begins. This is useful for interactive applications, but it should be read alongside throughput because the first provider to start is not always the first to finish a long answer.

Compare Groq with the next option

Cerebras currently ranks second at 0.23 s. Compare that gap with input and output price, response-start time, output speed, 30-minute uptime, context length, and the exact route before deciding whether first place is meaningful for your workload.

Use the route, not only the provider name

gpt-oss-120b has 21 published provider options, and performance data is matched to each exact OpenRouter routing tag. Different quantization, context, regional deployment, or provider configuration can change price and behavior even when the underlying model name is identical.