Start typing to search.
Ranks providers by their recent typical output speed in tokens per second. Providers without enough recent data remain visible after ranked rows.
DeepInfra currently ranks first at 41.0 tok/s via deepinfra/fp8.
| Rank | Provider / route | Output speed | Speed measurements | Endpoint details |
|---|---|---|---|---|
| #1 | Provider / route DeepInfra deepinfra/fp8 | Output speed41.0 tok/s | Speed measurements
| Endpoint details
|
| #2 | Provider / route GMICloud gmicloud/bf16 | Output speed17.0 tok/s | Speed measurements
| Endpoint details
|
| #3 | Provider / route AtlasCloud atlas-cloud/fp8 | Output speed16.0 tok/s | Speed measurements
| Endpoint details
|
Endpoint data fetched .
Hy3 endpoint guide
3 of 3 Hy3 endpoints currently have the published data required for this ranking. DeepInfra leads at 41.0 tok/s via deepinfra/fp8. The table keeps unranked routes visible so missing measurements do not look like missing provider availability.
The output-speed ranking compares recent median generated tokens per second. It favors routes that complete long generations quickly, while first-token latency remains a separate measure of how responsive the endpoint feels at the beginning.
GMICloud currently ranks second at 17.0 tok/s. Compare that gap with input and output price, response-start time, output speed, 30-minute uptime, context length, and the exact route before deciding whether first place is meaningful for your workload.
Hy3 has 3 published provider options, and performance data is matched to each exact OpenRouter routing tag. Different quantization, context, regional deployment, or provider configuration can change price and behavior even when the underlying model name is identical.
