Best cost/speed trade-off
NovitaAI
novita/bf16$0.62 / 1M tokens
39.52 s estimated response
WizardLM-2 8x22B provider comparison
microsoft/wizardlm-2-8x22b
WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models. It is...
- Endpoints:
- 1
- Context:
- 65.5K
- Input:
- text
- Output:
- text
At a glance
Comparison winners
Based on 1,000 input and 500 output tokens using the latest published median speed data.
Visual comparison
Price and performance charts
Compare published endpoint pricing and estimated response time visually.
USD per 1 million tokens for input and output. Lower is better.
NovitaAI has the lowest estimated cost for 1,000 input and 500 output tokens at $0.00093.
Based on 1,000 input and 500 output tokens. Cost is shown in USD per 1 million tokens. Lower and further left is better; the single best cost/speed trade-off appears at full opacity.
1 provider has complete pricing and speed data. NovitaAI is closest to the ideal combination of lowest cost and fastest response.
Server-rendered comparison
Provider endpoints
Prompt and completion prices are effective USD per token as published by OpenRouter. Missing speed data never removes an endpoint.
Rank providers by
| Provider / route | Current pricing ↗ | Speed measurements | Endpoint details |
|---|---|---|---|
| Provider / route | Current pricing
| Speed measurements
| Endpoint details
10 parametersfrequency_penalty, max_tokens, presence_penalty, repetition_penalty, response_format, seed, stop, temperature, top_k, top_p |
Endpoint data fetched .
WizardLM-2 8x22B deployment guide
How to choose a WizardLM-2 8x22B inference provider
WizardLM-2 8x22B is indexed here as a text model by microsoft, with 1 provider endpoint from NovitaAI. The comparison preserves each exact OpenRouter routing tag so pricing and performance observations can be connected to the route an application would actually request.
Match the endpoint to the workload
The model publishes a 65.5K-token context window. It accepts text input and returns text output. 10 distinct supported parameters appear across the listed routes. Confirm limits on the specific endpoint rather than assuming every host exposes the same configuration.
Compare the real request economics
NovitaAI currently has the lowest estimated cost for the standard 1,000-input/500-output-token sample at $0.00093. Input-heavy and output-heavy applications can produce a different result, so review both per-million-token prices in the endpoint table.
Balance response start and generation speed
NovitaAI currently has the shortest estimated 500-token response at 39.52 seconds. NovitaAI is the single endpoint closest to the current ideal cost/speed combination. Recent observations can change, so validate finalists with your own prompts.