Skip to content

Fastest First-Token Gemma 4 31B Inference Providers

Ranks providers by how quickly the first generated token appears. Providers without enough recent data remain visible after ranked rows.

Cerebras currently ranks first at 0.20 s via cerebras/fp16.

Provider options:
14
Ranked:
14
Metric:
Time to first token

Fastest first token endpoint ranking

Fastest First-Token Gemma 4 31B Inference Providers
RankProvider / routeTime to first tokenSpeed measurementsEndpoint details
#1Provider / route
Cerebrascerebras/fp16
Time to first token0.20 sSpeed measurements
500-token response
14.09 s
Response starts
0.20 s
Output speed
36.0 tok/s
Endpoint details
Input price
$0.99 / 1M tokens
Output price
$1.49 / 1M tokens
Uptime (30 min)
99.98%
Context
131.1K
#2Provider / route
Time to first token0.35 sSpeed measurements
500-token response
12.85 s
Response starts
0.35 s
Output speed
40.0 tok/s
Endpoint details
Input price
$0.12 / 1M tokens
Output price
$0.35 / 1M tokens
Uptime (30 min)
99.96%
Context
262.1K
#3Provider / route
ModelRunmodelrun/fp4
Time to first token0.56 sSpeed measurements
500-token response
3.92 s
Response starts
0.56 s
Output speed
149.0 tok/s
Endpoint details
Input price
$0.22 / 1M tokens
Output price
$0.55 / 1M tokens
Uptime (30 min)
98.72%
Context
262.1K
#4Provider / route
DeepInfradeepinfra/turbo
Time to first token0.68 sSpeed measurements
500-token response
18.53 s
Response starts
0.68 s
Output speed
28.0 tok/s
Endpoint details
Input price
$0.12 / 1M tokens
Output price
$0.37 / 1M tokens
Uptime (30 min)
99.37%
Context
262.1K
#5Provider / route
DeepInfradeepinfra/fp8
Time to first token0.82 sSpeed measurements
500-token response
22.56 s
Response starts
0.82 s
Output speed
23.0 tok/s
Endpoint details
Input price
$0.13 / 1M tokens
Output price
$0.38 / 1M tokens
Uptime (30 min)
99.78%
Context
262.1K
#6Provider / route
Parasailparasail/fp8
Time to first token0.97 sSpeed measurements
500-token response
23.70 s
Response starts
0.97 s
Output speed
22.0 tok/s
Endpoint details
Input price
$0.15 / 1M tokens
Output price
$0.4 / 1M tokens
Uptime (30 min)
96.67%
Context
262.1K
#7Provider / route
Togethertogether
Time to first token1.01 sSpeed measurements
500-token response
15.30 s
Response starts
1.01 s
Output speed
35.0 tok/s
Endpoint details
Input price
$0.28 / 1M tokens
Output price
$0.86 / 1M tokens
Uptime (30 min)
90.00%
Context
262.1K
#8Provider / route
Togethertogether
Time to first token1.01 sSpeed measurements
500-token response
15.30 s
Response starts
1.01 s
Output speed
35.0 tok/s
Endpoint details
Input price
$0.39 / 1M tokens
Output price
$0.97 / 1M tokens
Uptime (30 min)
99.05%
Context
262.1K
#9Provider / route
Venicevenice/bf16
Time to first token1.10 sSpeed measurements
500-token response
17.23 s
Response starts
1.10 s
Output speed
31.0 tok/s
Endpoint details
Input price
$0.12 / 1M tokens
Output price
$0.36 / 1M tokens
Uptime (30 min)
99.36%
Context
256K
#10Provider / route
NovitaAInovita/bf16
Time to first token1.58 sSpeed measurements
500-token response
40.04 s
Response starts
1.58 s
Output speed
13.0 tok/s
Endpoint details
Input price
$0.14 / 1M tokens
Output price
$0.4 / 1M tokens
Uptime (30 min)
99.89%
Context
262.1K
#11Provider / route
SambaNovasambanova
Time to first token1.90 sSpeed measurements
500-token response
7.16 s
Response starts
1.90 s
Output speed
95.0 tok/s
Endpoint details
Input price
$0.38 / 1M tokens
Output price
$1.15 / 1M tokens
Uptime (30 min)
99.96%
Context
131.1K
#12Provider / route
Chuteschutes/fp4
Time to first token2.95 sSpeed measurements
500-token response
41.41 s
Response starts
2.95 s
Output speed
13.0 tok/s
Endpoint details
Input price
$0.12 / 1M tokens
Output price
$0.37 / 1M tokens
Uptime (30 min)
88.22%
Context
131.1K
#13Provider / route
Phalaphala
Time to first token3.76 sSpeed measurements
500-token response
53.76 s
Response starts
3.76 s
Output speed
10.0 tok/s
Endpoint details
Input price
$0.15 / 1M tokens
Output price
$0.46 / 1M tokens
Uptime (30 min)
89.00%
Context
262.1K
#14Provider / route
SiliconFlowsiliconflow/fp8
Time to first token6.83 sSpeed measurements
500-token response
78.26 s
Response starts
6.83 s
Output speed
7.0 tok/s
Endpoint details
Input price
$0.13 / 1M tokens
Output price
$0.4 / 1M tokens
Uptime (30 min)
Insufficient recent data
Context
262.1K

Endpoint data fetched .

Gemma 4 31B endpoint guide

How to interpret the Fastest First-Token Gemma 4 31B Inference Providers

14 of 14 Gemma 4 31B endpoints currently have the published data required for this ranking. Cerebras leads at 0.20 s via cerebras/fp16. The table keeps unranked routes visible so missing measurements do not look like missing provider availability.

How response-start time is ranked

The first-token ranking orders endpoints by the recent median time before output begins. This is useful for interactive applications, but it should be read alongside throughput because the first provider to start is not always the first to finish a long answer.

Compare Cerebras with the next option

Weights & Biases currently ranks second at 0.35 s. Compare that gap with input and output price, response-start time, output speed, 30-minute uptime, context length, and the exact route before deciding whether first place is meaningful for your workload.

Use the route, not only the provider name

Gemma 4 31B has 14 published provider options, and performance data is matched to each exact OpenRouter routing tag. Different quantization, context, regional deployment, or provider configuration can change price and behavior even when the underlying model name is identical.