Skip to content

Highest Output-Speed Mistral Nemo Inference Providers

Ranks providers by their recent typical output speed in tokens per second. Providers without enough recent data remain visible after ranked rows.

NovitaAI currently ranks first at 38.0 tok/s via novita/fp8.

Provider options:
4
Ranked:
4
Metric:
Output speed

Highest output speed endpoint ranking

Highest Output-Speed Mistral Nemo Inference Providers
RankProvider / routeOutput speedSpeed measurementsEndpoint details
#1Provider / route
NovitaAInovita/fp8
Output speed38.0 tok/sSpeed measurements
500-token response
13.77 s
Response starts
0.61 s
Output speed
38.0 tok/s
Endpoint details
Input price
$0.04 / 1M tokens
Output price
$0.17 / 1M tokens
Uptime (30 min)
91.06%
Context
60.3K
#2Provider / route
Mistralmistral
Output speed28.0 tok/sSpeed measurements
500-token response
18.28 s
Response starts
0.42 s
Output speed
28.0 tok/s
Endpoint details
Input price
$0.15 / 1M tokens
Output price
$0.15 / 1M tokens
Uptime (30 min)
99.62%
Context
131.1K
#3Provider / route
DeepInfradeepinfra/fp8
Output speed26.0 tok/sSpeed measurements
500-token response
22.16 s
Response starts
2.93 s
Output speed
26.0 tok/s
Endpoint details
Input price
$0.02 / 1M tokens
Output price
$0.04 / 1M tokens
Uptime (30 min)
97.74%
Context
131.1K
#4Provider / route
DekaLLMdekallm/fp8
Output speed23.0 tok/sSpeed measurements
500-token response
22.55 s
Response starts
0.81 s
Output speed
23.0 tok/s
Endpoint details
Input price
$0.02 / 1M tokens
Output price
$0.03 / 1M tokens
Uptime (30 min)
95.51%
Context
131.1K

Endpoint data fetched .

Mistral Nemo endpoint guide

How to interpret the Highest Output-Speed Mistral Nemo Inference Providers

4 of 4 Mistral Nemo endpoints currently have the published data required for this ranking. NovitaAI leads at 38.0 tok/s via novita/fp8. The table keeps unranked routes visible so missing measurements do not look like missing provider availability.

How generation throughput is ranked

The output-speed ranking compares recent median generated tokens per second. It favors routes that complete long generations quickly, while first-token latency remains a separate measure of how responsive the endpoint feels at the beginning.

Compare NovitaAI with the next option

Mistral currently ranks second at 28.0 tok/s. Compare that gap with input and output price, response-start time, output speed, 30-minute uptime, context length, and the exact route before deciding whether first place is meaningful for your workload.

Use the route, not only the provider name

Mistral Nemo has 4 published provider options, and performance data is matched to each exact OpenRouter routing tag. Different quantization, context, regional deployment, or provider configuration can change price and behavior even when the underlying model name is identical.