Best cost/speed trade-off
DeepInfra
deepinfra/fp8$0.7 / 1M tokens
17.72 s estimated response
Nous: Hermes 3 70B Instruct provider comparison
nousresearch/hermes-3-llama-3.1-70b
Hermes 3 is a generalist language model with many improvements over [Hermes 2](/models/nousresearch/nous-hermes-2-mistral-7b-dpo), including advanced agentic capabilities, much better roleplaying, reasoning, multi-turn conversation, long context coherence, and improvements across the...
- Endpoints:
- 1
- Context:
- 131.1K
- Input:
- text
- Output:
- text
At a glance
Comparison winners
Based on 1,000 input and 500 output tokens using the latest published median speed data.
Visual comparison
Price and performance charts
Compare published endpoint pricing and estimated response time visually.
USD per 1 million tokens for input and output. Lower is better.
DeepInfra has the lowest estimated cost for 1,000 input and 500 output tokens at $0.00105.
Based on 1,000 input and 500 output tokens. Cost is shown in USD per 1 million tokens. Lower and further left is better; the single best cost/speed trade-off appears at full opacity.
1 provider has complete pricing and speed data. DeepInfra is closest to the ideal combination of lowest cost and fastest response.
Server-rendered comparison
Provider endpoints
Prompt and completion prices are effective USD per token as published by OpenRouter. Missing speed data never removes an endpoint.
Rank providers by
| Provider / route | Current pricing ↗ | Speed measurements | Endpoint details |
|---|---|---|---|
| Provider / route | Current pricing
| Speed measurements
| Endpoint details
13 parametersfrequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, top_k, top_p |
Endpoint data fetched .
Hermes 3 70B Instruct deployment guide
How to choose a Hermes 3 70B Instruct inference provider
Hermes 3 70B Instruct is indexed here as a text model by Nous, with 1 provider endpoint from DeepInfra. The comparison preserves each exact OpenRouter routing tag so pricing and performance observations can be connected to the route an application would actually request.
Match the endpoint to the workload
The model publishes a 131.1K-token context window. It accepts text input and returns text output. 13 distinct supported parameters appear across the listed routes. Confirm limits on the specific endpoint rather than assuming every host exposes the same configuration.
Compare the real request economics
DeepInfra currently has the lowest estimated cost for the standard 1,000-input/500-output-token sample at $0.00105. Input-heavy and output-heavy applications can produce a different result, so review both per-million-token prices in the endpoint table.
Balance response start and generation speed
DeepInfra currently has the shortest estimated 500-token response at 17.72 seconds. DeepInfra is the single endpoint closest to the current ideal cost/speed combination. Recent observations can change, so validate finalists with your own prompts.