Skip to content

LLM Providers: Speed Leaderboard & Benchmarks

The model-adjusted rating compares consistent 500-token response speed across exact-model comparisons, so one unusually strong model cannot dominate the result. A model-adjusted rating requires at least three exact models measured on another provider. Providers with only their own models remain visible using raw published catalog speed.

Models reviewed:
98
Model-adjusted providers:
43

Showing 48 providers

LLM Providers: Speed Leaderboard & Benchmarks
PositionProviderSpeed measurementsData coverage
Rank
#1
Speed measurements
Output speed ↗
215.0 tok/s
Data coverage
Models offered
3
Speed measured
3
Shared comparisons
3
Rating basis
Based on shared models
#2Speed measurements
Output speed ↗
263.0 tok/s
Data coverage
Models offered
11
Speed measured
5
Shared comparisons
5
Rating basis
Based on shared models
#3Speed measurements
Data coverage
Models offered
5
Speed measured
5
Shared comparisons
5
Rating basis
Based on shared models
#4Speed measurements
Data coverage
Models offered
6
Speed measured
6
Shared comparisons
6
Rating basis
Based on shared models
#5Speed measurements
Data coverage
Models offered
4
Speed measured
4
Shared comparisons
4
Rating basis
Based on shared models
#6Speed measurements
Output speed ↗
112.0 tok/s
Data coverage
Models offered
8
Speed measured
5
Shared comparisons
0
Rating basis
Based on own-model catalog
#7Speed measurements
Data coverage
Models offered
5
Speed measured
5
Shared comparisons
5
Rating basis
Based on shared models
#8Speed measurements
Output speed ↗
193.8 tok/s
Data coverage
Models offered
4
Speed measured
4
Shared comparisons
4
Rating basis
Based on shared models
#9Speed measurements
Data coverage
Models offered
8
Speed measured
8
Shared comparisons
8
Rating basis
Based on shared models
#10Speed measurements
Data coverage
Models offered
19
Speed measured
10
Shared comparisons
10
Rating basis
Based on shared models
#11Speed measurements
Data coverage
Models offered
3
Speed measured
3
Shared comparisons
3
Rating basis
Based on shared models
#12Speed measurements
Data coverage
Models offered
48
Speed measured
9
Shared comparisons
8
Rating basis
Based on shared models
#13Speed measurements
Data coverage
Models offered
49
Speed measured
19
Shared comparisons
19
Rating basis
Based on shared models
#14Speed measurements
Data coverage
Models offered
23
Speed measured
7
Shared comparisons
5
Rating basis
Based on shared models
#15Speed measurements
Data coverage
Models offered
9
Speed measured
5
Shared comparisons
5
Rating basis
Based on shared models
#16Speed measurements
Data coverage
Models offered
35
Speed measured
20
Shared comparisons
20
Rating basis
Based on shared models
#17Speed measurements
Data coverage
Models offered
12
Speed measured
5
Shared comparisons
5
Rating basis
Based on shared models
#18Speed measurements
Data coverage
Models offered
7
Speed measured
5
Shared comparisons
0
Rating basis
Based on own-model catalog
#19Speed measurements
Data coverage
Models offered
35
Speed measured
21
Shared comparisons
21
Rating basis
Based on shared models
#20Speed measurements
Output speed ↗
101.0 tok/s
Data coverage
Models offered
22
Speed measured
5
Shared comparisons
5
Rating basis
Based on shared models
#21Speed measurements
Data coverage
Models offered
72
Speed measured
5
Shared comparisons
5
Rating basis
Based on shared models
#22Speed measurements
Data coverage
Models offered
8
Speed measured
4
Shared comparisons
0
Rating basis
Based on own-model catalog
#23Speed measurements
Data coverage
Models offered
23
Speed measured
8
Shared comparisons
8
Rating basis
Based on shared models
#24Speed measurements
Data coverage
Models offered
8
Speed measured
4
Shared comparisons
0
Rating basis
Based on own-model catalog
#25Speed measurements
Data coverage
Models offered
3
Speed measured
3
Shared comparisons
3
Rating basis
Based on shared models
#26Speed measurements
Data coverage
Models offered
13
Speed measured
5
Shared comparisons
5
Rating basis
Based on shared models
#27Speed measurements
Data coverage
Models offered
5
Speed measured
5
Shared comparisons
3
Rating basis
Based on shared models
#28Speed measurements
Data coverage
Models offered
12
Speed measured
7
Shared comparisons
7
Rating basis
Based on shared models
#29Speed measurements
Data coverage
Models offered
7
Speed measured
7
Shared comparisons
7
Rating basis
Based on shared models
#30Speed measurements
Data coverage
Models offered
11
Speed measured
5
Shared comparisons
5
Rating basis
Based on shared models
#31Speed measurements
Data coverage
Models offered
3
Speed measured
3
Shared comparisons
3
Rating basis
Based on shared models
#32Speed measurements
Data coverage
Models offered
4
Speed measured
4
Shared comparisons
0
Rating basis
Based on own-model catalog
#33Speed measurements
Data coverage
Models offered
20
Speed measured
12
Shared comparisons
12
Rating basis
Based on shared models
#34Speed measurements
Data coverage
Models offered
50
Speed measured
9
Shared comparisons
9
Rating basis
Based on shared models
#35Speed measurements
Data coverage
Models offered
87
Speed measured
31
Shared comparisons
31
Rating basis
Based on shared models
#36Speed measurements
Data coverage
Models offered
4
Speed measured
4
Shared comparisons
4
Rating basis
Based on shared models
#37Speed measurements
Data coverage
Models offered
5
Speed measured
5
Shared comparisons
5
Rating basis
Based on shared models
#38Speed measurements
Data coverage
Models offered
7
Speed measured
5
Shared comparisons
5
Rating basis
Based on shared models
#39Speed measurements
Data coverage
Models offered
13
Speed measured
7
Shared comparisons
7
Rating basis
Based on shared models
#40Speed measurements
Data coverage
Models offered
8
Speed measured
7
Shared comparisons
7
Rating basis
Based on shared models
#41Speed measurements
Data coverage
Models offered
67
Speed measured
31
Shared comparisons
31
Rating basis
Based on shared models
#42Speed measurements
Data coverage
Models offered
19
Speed measured
15
Shared comparisons
15
Rating basis
Based on shared models
#43Speed measurements
Data coverage
Models offered
36
Speed measured
20
Shared comparisons
20
Rating basis
Based on shared models
#44Speed measurements
Data coverage
Models offered
7
Speed measured
5
Shared comparisons
5
Rating basis
Based on shared models
#45Speed measurements
Data coverage
Models offered
15
Speed measured
11
Shared comparisons
11
Rating basis
Based on shared models
#46Speed measurements
Data coverage
Models offered
18
Speed measured
13
Shared comparisons
13
Rating basis
Based on shared models
#47Speed measurements
Data coverage
Models offered
16
Speed measured
12
Shared comparisons
12
Rating basis
Based on shared models
#48Speed measurements
Data coverage
Models offered
31
Speed measured
18
Shared comparisons
18
Rating basis
Based on shared models

See the complete methodology and worked rating example.

Ranking data fetched .

Provider benchmark guide

How to use the LLM Providers: Speed Leaderboard & Benchmarks

43 providers currently have enough shared measurements for this benchmark. Cerebras is currently first, with a published catalog median of 3.46 seconds. Review response time, response start, output speed, and coverage together before choosing a provider.

What fastest response measures

The response-time rank estimates how long a 500-token answer takes from request to completion. It favors providers that perform consistently across several models instead of relying on one unusually fast result.

How provider catalogs are represented

This overall view reviewed 98 candidate models selected across provider catalogs. Each observation is normalized against other providers running the exact same model.

Read the coverage before choosing

This page reviewed 98 candidate models and currently has shared comparison data for 43 providers. The Rating basis field distinguishes model-adjusted rows from providers positioned using only their own-model catalog measurements.