Skip to content

Fastest Gemma 4 31B Inference Providers

Ranks providers by estimated time to return 500 tokens, combining the wait for the first token with output speed.

ModelRun currently ranks first at 3.92 s via modelrun/fp4.

Provider options:
14
Ranked:
14
Metric:
Estimated response time

Fastest response endpoint ranking

Fastest Gemma 4 31B Inference Providers
RankProvider / routeEstimated response timeSpeed measurementsEndpoint details
#1Provider / route
ModelRunmodelrun/fp4
Estimated response time3.92 sSpeed measurements
500-token response
3.92 s
Response starts
0.56 s
Output speed
149.0 tok/s
Endpoint details
Input price
$0.22 / 1M tokens
Output price
$0.55 / 1M tokens
Uptime (30 min)
98.72%
Context
262.1K
#2Provider / route
SambaNovasambanova
Estimated response time7.16 sSpeed measurements
500-token response
7.16 s
Response starts
1.90 s
Output speed
95.0 tok/s
Endpoint details
Input price
$0.38 / 1M tokens
Output price
$1.15 / 1M tokens
Uptime (30 min)
99.96%
Context
131.1K
#3Provider / route
Estimated response time12.85 sSpeed measurements
500-token response
12.85 s
Response starts
0.35 s
Output speed
40.0 tok/s
Endpoint details
Input price
$0.12 / 1M tokens
Output price
$0.35 / 1M tokens
Uptime (30 min)
99.96%
Context
262.1K
#4Provider / route
Cerebrascerebras/fp16
Estimated response time14.09 sSpeed measurements
500-token response
14.09 s
Response starts
0.20 s
Output speed
36.0 tok/s
Endpoint details
Input price
$0.99 / 1M tokens
Output price
$1.49 / 1M tokens
Uptime (30 min)
99.98%
Context
131.1K
#5Provider / route
Togethertogether
Estimated response time15.30 sSpeed measurements
500-token response
15.30 s
Response starts
1.01 s
Output speed
35.0 tok/s
Endpoint details
Input price
$0.28 / 1M tokens
Output price
$0.86 / 1M tokens
Uptime (30 min)
90.00%
Context
262.1K
#6Provider / route
Togethertogether
Estimated response time15.30 sSpeed measurements
500-token response
15.30 s
Response starts
1.01 s
Output speed
35.0 tok/s
Endpoint details
Input price
$0.39 / 1M tokens
Output price
$0.97 / 1M tokens
Uptime (30 min)
99.05%
Context
262.1K
#7Provider / route
Venicevenice/bf16
Estimated response time17.23 sSpeed measurements
500-token response
17.23 s
Response starts
1.10 s
Output speed
31.0 tok/s
Endpoint details
Input price
$0.12 / 1M tokens
Output price
$0.36 / 1M tokens
Uptime (30 min)
99.36%
Context
256K
#8Provider / route
DeepInfradeepinfra/turbo
Estimated response time18.53 sSpeed measurements
500-token response
18.53 s
Response starts
0.68 s
Output speed
28.0 tok/s
Endpoint details
Input price
$0.12 / 1M tokens
Output price
$0.37 / 1M tokens
Uptime (30 min)
99.37%
Context
262.1K
#9Provider / route
DeepInfradeepinfra/fp8
Estimated response time22.56 sSpeed measurements
500-token response
22.56 s
Response starts
0.82 s
Output speed
23.0 tok/s
Endpoint details
Input price
$0.13 / 1M tokens
Output price
$0.38 / 1M tokens
Uptime (30 min)
99.78%
Context
262.1K
#10Provider / route
Parasailparasail/fp8
Estimated response time23.70 sSpeed measurements
500-token response
23.70 s
Response starts
0.97 s
Output speed
22.0 tok/s
Endpoint details
Input price
$0.15 / 1M tokens
Output price
$0.4 / 1M tokens
Uptime (30 min)
96.67%
Context
262.1K
#11Provider / route
NovitaAInovita/bf16
Estimated response time40.04 sSpeed measurements
500-token response
40.04 s
Response starts
1.58 s
Output speed
13.0 tok/s
Endpoint details
Input price
$0.14 / 1M tokens
Output price
$0.4 / 1M tokens
Uptime (30 min)
99.89%
Context
262.1K
#12Provider / route
Chuteschutes/fp4
Estimated response time41.41 sSpeed measurements
500-token response
41.41 s
Response starts
2.95 s
Output speed
13.0 tok/s
Endpoint details
Input price
$0.12 / 1M tokens
Output price
$0.37 / 1M tokens
Uptime (30 min)
88.22%
Context
131.1K
#13Provider / route
Phalaphala
Estimated response time53.76 sSpeed measurements
500-token response
53.76 s
Response starts
3.76 s
Output speed
10.0 tok/s
Endpoint details
Input price
$0.15 / 1M tokens
Output price
$0.46 / 1M tokens
Uptime (30 min)
89.00%
Context
262.1K
#14Provider / route
SiliconFlowsiliconflow/fp8
Estimated response time78.26 sSpeed measurements
500-token response
78.26 s
Response starts
6.83 s
Output speed
7.0 tok/s
Endpoint details
Input price
$0.13 / 1M tokens
Output price
$0.4 / 1M tokens
Uptime (30 min)
Insufficient recent data
Context
262.1K

Endpoint data fetched .

Gemma 4 31B endpoint guide

How to interpret the Fastest Gemma 4 31B Inference Providers

14 of 14 Gemma 4 31B endpoints currently have the published data required for this ranking. ModelRun leads at 3.92 s via modelrun/fp4. The table keeps unranked routes visible so missing measurements do not look like missing provider availability.

How complete response time is ranked

The fastest ranking estimates a 500-token answer by adding the recent median first-token wait to 500 divided by median output throughput. It represents an example complete response, not a guarantee for every prompt or request size.

Compare ModelRun with the next option

SambaNova currently ranks second at 7.16 s. Compare that gap with input and output price, response-start time, output speed, 30-minute uptime, context length, and the exact route before deciding whether first place is meaningful for your workload.

Use the route, not only the provider name

Gemma 4 31B has 14 published provider options, and performance data is matched to each exact OpenRouter routing tag. Different quantization, context, regional deployment, or provider configuration can change price and behavior even when the underlying model name is identical.