Skip to content

Highest Output-Speed Hermes 4 405B Inference Providers

Ranks providers by their recent typical output speed in tokens per second. Providers without enough recent data remain visible after ranked rows.

Nebius currently ranks first at 29.0 tok/s via nebius/fp8.

Provider options:
1
Ranked:
1
Metric:
Output speed

Highest output speed endpoint ranking

Highest Output-Speed Hermes 4 405B Inference Providers
RankProvider / routeOutput speedSpeed measurementsEndpoint details
#1Provider / route
Nebiusnebius/fp8
Output speed29.0 tok/sSpeed measurements
500-token response
17.67 s
Response starts
0.43 s
Output speed
29.0 tok/s
Endpoint details
Input price
$1 / 1M tokens
Output price
$3 / 1M tokens
Uptime (30 min)
100.00%
Context
131.1K

Endpoint data fetched .

Hermes 4 405B endpoint guide

How to interpret the Highest Output-Speed Hermes 4 405B Inference Providers

1 of 1 Hermes 4 405B endpoint currently have the published data required for this ranking. Nebius leads at 29.0 tok/s via nebius/fp8. The table keeps unranked routes visible so missing measurements do not look like missing provider availability.

How generation throughput is ranked

The output-speed ranking compares recent median generated tokens per second. It favors routes that complete long generations quickly, while first-token latency remains a separate measure of how responsive the endpoint feels at the beginning.

Compare Nebius with the next option

Only 1 route currently qualifies, so the rank alone provides limited choice. Review every visible endpoint for price, speed, uptime, context length, and route-specific configuration.

Use the route, not only the provider name

Hermes 4 405B has 1 published provider option, and performance data is matched to each exact OpenRouter routing tag. Different quantization, context, regional deployment, or provider configuration can change price and behavior even when the underlying model name is identical.