Skip to content

DeepInfra

HQ: United StatesDatacenters: N/aStatusPrivacyTerms

Average response time

19.35 s

Estimated 500-token answer. Across 67 models with recent complete speed data.

Average response start

0.83 s

Wait until the first token. Across 67 models with recent response start data.

Average output speed

41.2 tok/s

Generated tokens per second. Across 67 models with recent output speed data.

AI Models available from DeepInfra

Prices and recent speed measurements below are for DeepInfra endpoints. A 500-token response combines the wait for the first token with the time to generate 500 output tokens.

Models

Showing 87 models

  • Model
    Tencent: Hy3

    tencent/hy3

    Text
    Current pricing & context
    Input price
    $0.14 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    15.13 s
    Response starts
    0.64 s
    Output speed
    34.5 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Z.ai: GLM 5.2

    z-ai/glm-5.2

    Text
    Current pricing & context
    Input price
    $0.93 / 1M tokens
    Context
    1M
    Speed measurements
    500-token response
    19.88 s
    Response starts
    0.65 s
    Output speed
    26.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    MoonshotAI: Kimi K2.7 Code

    moonshotai/kimi-k2.7-code

    Text
    Current pricing & context
    Input price
    $0.74 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    11.01 s
    Response starts
    0.60 s
    Output speed
    48.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    NVIDIA: Nemotron 3 Ultra

    nvidia/nemotron-3-ultra-550b-a55b

    Text
    Current pricing & context
    Input price
    $0.5 / 1M tokens
    Context
    1M
    Speed measurements
    500-token response
    8.88 s
    Response starts
    2.21 s
    Output speed
    75.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    MiniMax: MiniMax M3

    minimax/minimax-m3

    Text
    Current pricing & context
    Input price
    $0.3 / 1M tokens
    Context
    1M
    Speed measurements
    500-token response
    15.52 s
    Response starts
    2.01 s
    Output speed
    37.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    StepFun: Step 3.7 Flash

    stepfun/step-3.7-flash

    Text
    Current pricing & context
    Input price
    $0.2 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    5.11 s
    Response starts
    0.31 s
    Output speed
    104.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Qwen: Qwen3.6 27B

    qwen/qwen3.6-27b

    Text
    Current pricing & context
    Input price
    $0.32 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    25.62 s
    Response starts
    0.62 s
    Output speed
    20.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    DeepSeek: DeepSeek V4 Pro

    deepseek/deepseek-v4-pro

    Text
    Current pricing & context
    Input price
    $1.3 / 1M tokens
    Context
    1M
    Speed measurements
    500-token response
    19.97 s
    Response starts
    0.74 s
    Output speed
    26.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    DeepSeek: DeepSeek V4 Flash

    deepseek/deepseek-v4-flash

    Text
    Current pricing & context
    Input price
    $0.09 / 1M tokens
    Context
    1M
    Speed measurements
    500-token response
    21.20 s
    Response starts
    1.20 s
    Output speed
    25.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Zyphra: Zonos v0.1 Transformer

    zyphra/zonos-v0.1-transformer

    Speech
    Current pricing & context
    Input price
    $7 / 1M tokens
    Context
    4.1K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Speech
    Provider options
    1
  • Model
    Zyphra: Zonos v0.1 Hybrid

    zyphra/zonos-v0.1-hybrid

    Speech
    Current pricing & context
    Input price
    $7 / 1M tokens
    Context
    4.1K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Speech
    Provider options
    1
  • Model
    Canopy Labs: Orpheus 3B

    canopylabs/orpheus-3b-0.1-ft

    Speech
    Current pricing & context
    Input price
    $7 / 1M tokens
    Context
    4.1K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Speech
    Provider options
    1
  • Model
    Sesame: CSM 1B

    sesame/csm-1b

    Speech
    Current pricing & context
    Input price
    $7 / 1M tokens
    Context
    4.1K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Speech
    Provider options
    1
  • Model
    hexgrad: Kokoro 82M

    hexgrad/kokoro-82m

    Speech
    Current pricing & context
    Input price
    $0.62 / 1M tokens
    Context
    4.1K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Speech
    Provider options
    1
  • Model
    Xiaomi: MiMo-V2.5-Pro

    xiaomi/mimo-v2.5-pro

    Text
    Current pricing & context
    Input price
    $1 / 1M tokens
    Context
    1M
    Speed measurements
    500-token response
    10.33 s
    Response starts
    0.52 s
    Output speed
    51.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Xiaomi: MiMo-V2.5

    xiaomi/mimo-v2.5

    Text
    Current pricing & context
    Input price
    $0.4 / 1M tokens
    Context
    1M
    Speed measurements
    500-token response
    12.42 s
    Response starts
    0.51 s
    Output speed
    42.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    MoonshotAI: Kimi K2.6

    moonshotai/kimi-k2.6

    Text
    Current pricing & context
    Input price
    $0.75 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    7.96 s
    Response starts
    0.82 s
    Output speed
    70.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Z.ai: GLM 5.1

    z-ai/glm-5.1

    Text
    Current pricing & context
    Input price
    $1.05 / 1M tokens
    Context
    202.8K
    Speed measurements
    500-token response
    9.32 s
    Response starts
    0.85 s
    Output speed
    59.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Google: Gemma 4 26B A4B

    google/gemma-4-26b-a4b-it

    Text
    Current pricing & context
    Input price
    $0.07 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    18.32 s
    Response starts
    0.47 s
    Output speed
    28.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Google: Gemma 4 31B

    google/gemma-4-31b-it

    Text
    Current pricing & context
    Input price
    $0.12 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    46.34 s
    Response starts
    0.71 s
    Output speed
    11.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    MiniMax: MiniMax M2.7

    minimax/minimax-m2.7

    Text
    Current pricing & context
    Input price
    $0.25 / 1M tokens
    Context
    204.8K
    Speed measurements
    500-token response
    6.74 s
    Response starts
    0.96 s
    Output speed
    101.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    NVIDIA: Nemotron 3 Super

    nvidia/nemotron-3-super-120b-a12b

    Text
    Current pricing & context
    Input price
    $0.085 / 1M tokens
    Context
    1M
    Speed measurements
    500-token response
    12.55 s
    Response starts
    3.46 s
    Output speed
    55.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Qwen: Qwen3.5-9B

    qwen/qwen3.5-9b

    Text
    Current pricing & context
    Input price
    $0.1 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    26.69 s
    Response starts
    0.37 s
    Output speed
    19.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Qwen: Qwen3.5-35B-A3B

    qwen/qwen3.5-35b-a3b

    Text
    Current pricing & context
    Input price
    $0.14 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    5.41 s
    Response starts
    0.26 s
    Output speed
    97.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Qwen: Qwen3.5-27B

    qwen/qwen3.5-27b

    Text
    Current pricing & context
    Input price
    $0.26 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    29.86 s
    Response starts
    2.08 s
    Output speed
    18.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Qwen: Qwen3.5-122B-A10B

    qwen/qwen3.5-122b-a10b

    Text
    Current pricing & context
    Input price
    $0.29 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    20.84 s
    Response starts
    0.83 s
    Output speed
    25.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Qwen: Qwen3.5 397B A17B

    qwen/qwen3.5-397b-a17b

    Text
    Current pricing & context
    Input price
    $0.45 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    12.31 s
    Response starts
    0.68 s
    Output speed
    43.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    MiniMax: MiniMax M2.5

    minimax/minimax-m2.5

    Text
    Current pricing & context
    Input price
    $0.15 / 1M tokens
    Context
    204.8K
    Speed measurements
    500-token response
    7.62 s
    Response starts
    0.67 s
    Output speed
    72.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Z.ai: GLM 5

    z-ai/glm-5

    Text
    Current pricing & context
    Input price
    $0.6 / 1M tokens
    Context
    202.8K
    Speed measurements
    500-token response
    16.84 s
    Response starts
    1.22 s
    Output speed
    32.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    MoonshotAI: Kimi K2.5

    moonshotai/kimi-k2.5

    Text
    Current pricing & context
    Input price
    $0.45 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    8.16 s
    Response starts
    0.86 s
    Output speed
    68.5 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Z.ai: GLM 4.7 Flash

    z-ai/glm-4.7-flash

    Text
    Current pricing & context
    Input price
    $0.06 / 1M tokens
    Context
    202.8K
    Speed measurements
    500-token response
    12.37 s
    Response starts
    0.46 s
    Output speed
    42.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Z.ai: GLM 4.7

    z-ai/glm-4.7

    Text
    Current pricing & context
    Input price
    $0.4 / 1M tokens
    Context
    202.8K
    Speed measurements
    500-token response
    12.46 s
    Response starts
    0.83 s
    Output speed
    43.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    NVIDIA: Nemotron 3 Nano 30B A3B

    nvidia/nemotron-3-nano-30b-a3b

    Text
    Current pricing & context
    Input price
    $0.05 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    9.57 s
    Response starts
    1.37 s
    Output speed
    61.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    DeepSeek: DeepSeek V3.2

    deepseek/deepseek-v3.2

    Text
    Current pricing & context
    Input price
    $0.26 / 1M tokens
    Context
    163.8K
    Speed measurements
    500-token response
    46.31 s
    Response starts
    0.86 s
    Output speed
    11.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Thenlper: GTE-Base

    thenlper/gte-base

    Embeddings
    Current pricing & context
    Input price
    $0.005 / 1M tokens
    Context
    8.2K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Embeddings
    Provider options
    1
  • Model
    Thenlper: GTE-Large

    thenlper/gte-large

    Embeddings
    Current pricing & context
    Input price
    $0.01 / 1M tokens
    Context
    8.2K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Embeddings
    Provider options
    1
  • Model
    Intfloat: E5-Large-v2

    intfloat/e5-large-v2

    Embeddings
    Current pricing & context
    Input price
    $0.01 / 1M tokens
    Context
    8.2K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Embeddings
    Provider options
    1
  • Model
    Intfloat: E5-Base-v2

    intfloat/e5-base-v2

    Embeddings
    Current pricing & context
    Input price
    $0.005 / 1M tokens
    Context
    8.2K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Embeddings
    Provider options
    1
  • Model
    Intfloat: Multilingual-E5-Large

    intfloat/multilingual-e5-large

    Embeddings
    Current pricing & context
    Input price
    $0.01 / 1M tokens
    Context
    8.2K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Embeddings
    Provider options
    1
  • Model
    Sentence Transformers: paraphrase-MiniLM-L6-v2

    sentence-transformers/paraphrase-minilm-l6-v2

    Embeddings
    Current pricing & context
    Input price
    $0.005 / 1M tokens
    Context
    8.2K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Embeddings
    Provider options
    1
  • Model
    Sentence Transformers: all-MiniLM-L12-v2

    sentence-transformers/all-minilm-l12-v2

    Embeddings
    Current pricing & context
    Input price
    $0.005 / 1M tokens
    Context
    8.2K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Embeddings
    Provider options
    1
  • Model
    BAAI: bge-base-en-v1.5

    baai/bge-base-en-v1.5

    Embeddings
    Current pricing & context
    Input price
    $0.005 / 1M tokens
    Context
    8.2K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Embeddings
    Provider options
    1
  • Model
    Sentence Transformers: multi-qa-mpnet-base-dot-v1

    sentence-transformers/multi-qa-mpnet-base-dot-v1

    Embeddings
    Current pricing & context
    Input price
    $0.005 / 1M tokens
    Context
    8.2K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Embeddings
    Provider options
    1
  • Model
    BAAI: bge-large-en-v1.5

    baai/bge-large-en-v1.5

    Embeddings
    Current pricing & context
    Input price
    $0.01 / 1M tokens
    Context
    8.2K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Embeddings
    Provider options
    1
  • Model
    BAAI: bge-m3

    baai/bge-m3

    Embeddings
    Current pricing & context
    Input price
    $0.01 / 1M tokens
    Context
    8.2K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Embeddings
    Provider options
    1
  • Model
    Sentence Transformers: all-mpnet-base-v2

    sentence-transformers/all-mpnet-base-v2

    Embeddings
    Current pricing & context
    Input price
    $0.005 / 1M tokens
    Context
    8.2K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Embeddings
    Provider options
    1
  • Model
    Sentence Transformers: all-MiniLM-L6-v2

    sentence-transformers/all-minilm-l6-v2

    Embeddings
    Current pricing & context
    Input price
    $0.005 / 1M tokens
    Context
    8.2K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Embeddings
    Provider options
    1
  • Model
    Qwen: Qwen3 Embedding 8B

    qwen/qwen3-embedding-8b

    Embeddings
    Current pricing & context
    Input price
    $0.01 / 1M tokens
    Context
    32.8K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Embeddings
    Provider options
    1
  • Model
    Qwen: Qwen3 Embedding 4B

    qwen/qwen3-embedding-4b

    Embeddings
    Current pricing & context
    Input price
    $0.02 / 1M tokens
    Context
    32.8K
    Speed measurements
    500-token response
    N/a
    Response starts
    N/a
    Output speed
    N/a
    Model details
    Model type
    Embeddings
    Provider options
    1
  • Model
    NVIDIA: Llama 3.3 Nemotron Super 49B V1.5

    nvidia/llama-3.3-nemotron-super-49b-v1.5

    Text
    Current pricing & context
    Input price
    $0.4 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    10.56 s
    Response starts
    0.14 s
    Output speed
    48.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Qwen: Qwen3 VL 30B A3B Instruct

    qwen/qwen3-vl-30b-a3b-instruct

    Text
    Current pricing & context
    Input price
    $0.15 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    20.40 s
    Response starts
    0.40 s
    Output speed
    25.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Z.ai: GLM 4.6

    z-ai/glm-4.6

    Text
    Current pricing & context
    Input price
    $0.5 / 1M tokens
    Context
    202.8K
    Speed measurements
    500-token response
    25.64 s
    Response starts
    0.64 s
    Output speed
    20.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Qwen: Qwen3 VL 235B A22B Instruct

    qwen/qwen3-vl-235b-a22b-instruct

    Text
    Current pricing & context
    Input price
    $0.2 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    32.31 s
    Response starts
    1.06 s
    Output speed
    16.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    DeepSeek: DeepSeek V3.1 Terminus

    deepseek/deepseek-v3.1-terminus

    Text
    Current pricing & context
    Input price
    $0.27 / 1M tokens
    Context
    163.8K
    Speed measurements
    500-token response
    12.00 s
    Response starts
    0.89 s
    Output speed
    45.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Qwen: Qwen3 Next 80B A3B Instruct

    qwen/qwen3-next-80b-a3b-instruct

    Text
    Current pricing & context
    Input price
    $0.09 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    10.67 s
    Response starts
    0.67 s
    Output speed
    50.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    DeepSeek: DeepSeek V3.1

    deepseek/deepseek-chat-v3.1

    Text
    Current pricing & context
    Input price
    $0.25 / 1M tokens
    Context
    163.8K
    Speed measurements
    500-token response
    51.23 s
    Response starts
    1.23 s
    Output speed
    10.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    OpenAI: gpt-oss-120b

    openai/gpt-oss-120b

    Text
    Current pricing & context
    Input price
    $0.037 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    4.10 s
    Response starts
    0.51 s
    Output speed
    139.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    OpenAI: gpt-oss-20b

    openai/gpt-oss-20b

    Text
    Current pricing & context
    Input price
    $0.03 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    5.66 s
    Response starts
    0.76 s
    Output speed
    102.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Qwen: Qwen3 235B A22B Thinking 2507

    qwen/qwen3-235b-a22b-thinking-2507

    Text
    Current pricing & context
    Input price
    $0.23 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    10.04 s
    Response starts
    1.11 s
    Output speed
    56.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Qwen: Qwen3 Coder 480B A35B

    qwen/qwen3-coder

    Text
    Current pricing & context
    Input price
    $0.3 / 1M tokens
    Context
    1M
    Speed measurements
    500-token response
    8.36 s
    Response starts
    0.42 s
    Output speed
    63.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Qwen: Qwen3 235B A22B Instruct 2507

    qwen/qwen3-235b-a22b-2507

    Text
    Current pricing & context
    Input price
    $0.09 / 1M tokens
    Context
    262.1K
    Speed measurements
    500-token response
    24.18 s
    Response starts
    0.37 s
    Output speed
    21.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Mistral: Mistral Small 3.2 24B

    mistralai/mistral-small-3.2-24b-instruct

    Text
    Current pricing & context
    Input price
    $0.075 / 1M tokens
    Context
    128K
    Speed measurements
    500-token response
    9.64 s
    Response starts
    0.38 s
    Output speed
    54.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    DeepSeek: R1 0528

    deepseek/deepseek-r1-0528

    Text
    Current pricing & context
    Input price
    $0.5 / 1M tokens
    Context
    163.8K
    Speed measurements
    500-token response
    22.55 s
    Response starts
    0.81 s
    Output speed
    23.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Meta: Llama Guard 4 12B

    meta-llama/llama-guard-4-12b

    Text
    Current pricing & context
    Input price
    $0.18 / 1M tokens
    Context
    163.8K
    Speed measurements
    500-token response
    50.28 s
    Response starts
    0.28 s
    Output speed
    10.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Qwen: Qwen3 30B A3B

    qwen/qwen3-30b-a3b

    Text
    Current pricing & context
    Input price
    $0.12 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    8.85 s
    Response starts
    0.23 s
    Output speed
    58.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Qwen: Qwen3 14B

    qwen/qwen3-14b

    Text
    Current pricing & context
    Input price
    $0.12 / 1M tokens
    Context
    131.7K
    Speed measurements
    500-token response
    8.57 s
    Response starts
    0.37 s
    Output speed
    61.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Qwen: Qwen3 32B

    qwen/qwen3-32b

    Text
    Current pricing & context
    Input price
    $0.08 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    15.90 s
    Response starts
    0.28 s
    Output speed
    32.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Meta: Llama 4 Maverick

    meta-llama/llama-4-maverick

    Text
    Current pricing & context
    Input price
    $0.2 / 1M tokens
    Context
    1M
    Speed measurements
    500-token response
    29.89 s
    Response starts
    0.48 s
    Output speed
    17.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Meta: Llama 4 Scout

    meta-llama/llama-4-scout

    Text
    Current pricing & context
    Input price
    $0.1 / 1M tokens
    Context
    10M
    Speed measurements
    500-token response
    13.82 s
    Response starts
    0.30 s
    Output speed
    37.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    DeepSeek: DeepSeek V3 0324

    deepseek/deepseek-chat-v3-0324

    Text
    Current pricing & context
    Input price
    $0.24 / 1M tokens
    Context
    163.8K
    Speed measurements
    500-token response
    49.53 s
    Response starts
    4.08 s
    Output speed
    11.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Google: Gemma 3 4B

    google/gemma-3-4b-it

    Text
    Current pricing & context
    Input price
    $0.05 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    50.33 s
    Response starts
    0.33 s
    Output speed
    10.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Google: Gemma 3 12B

    google/gemma-3-12b-it

    Text
    Current pricing & context
    Input price
    $0.05 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    45.95 s
    Response starts
    0.50 s
    Output speed
    11.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Google: Gemma 3 27B

    google/gemma-3-27b-it

    Text
    Current pricing & context
    Input price
    $0.08 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    27.34 s
    Response starts
    1.03 s
    Output speed
    19.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Mistral: Mistral Small 3

    mistralai/mistral-small-24b-instruct-2501

    Text
    Current pricing & context
    Input price
    $0.05 / 1M tokens
    Context
    32.8K
    Speed measurements
    500-token response
    16.57 s
    Response starts
    0.44 s
    Output speed
    31.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Microsoft: Phi 4

    microsoft/phi-4

    Text
    Current pricing & context
    Input price
    $0.07 / 1M tokens
    Context
    16.4K
    Speed measurements
    500-token response
    9.36 s
    Response starts
    0.27 s
    Output speed
    55.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    DeepSeek: DeepSeek V3

    deepseek/deepseek-chat

    Text
    Current pricing & context
    Input price
    $0.32 / 1M tokens
    Context
    163.8K
    Speed measurements
    500-token response
    17.10 s
    Response starts
    0.43 s
    Output speed
    30.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Meta: Llama 3.3 70B Instruct

    meta-llama/llama-3.3-70b-instruct

    Text
    Current pricing & context
    Input price
    $0.1 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    56.08 s
    Response starts
    0.52 s
    Output speed
    9.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Meta: Llama 3.2 11B Vision Instruct

    meta-llama/llama-3.2-11b-vision-instruct

    Text
    Current pricing & context
    Input price
    $0.345 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    11.77 s
    Response starts
    0.41 s
    Output speed
    44.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Qwen2.5 72B Instruct

    qwen/qwen-2.5-72b-instruct

    Text
    Current pricing & context
    Input price
    $0.36 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    19.56 s
    Response starts
    0.33 s
    Output speed
    26.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Sao10K: Llama 3.1 Euryale 70B v2.2

    sao10k/l3.1-euryale-70b

    Text
    Current pricing & context
    Input price
    $0.85 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    10.95 s
    Response starts
    0.31 s
    Output speed
    47.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Nous: Hermes 3 70B Instruct

    nousresearch/hermes-3-llama-3.1-70b

    Text
    Current pricing & context
    Input price
    $0.7 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    17.11 s
    Response starts
    0.44 s
    Output speed
    30.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Nous: Hermes 3 405B Instruct

    nousresearch/hermes-3-llama-3.1-405b

    Text
    Current pricing & context
    Input price
    $1 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    26.94 s
    Response starts
    0.62 s
    Output speed
    19.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Sao10K: Llama 3 8B Lunaris

    sao10k/l3-lunaris-8b

    Text
    Current pricing & context
    Input price
    $0.04 / 1M tokens
    Context
    8.2K
    Speed measurements
    500-token response
    7.86 s
    Response starts
    0.16 s
    Output speed
    65.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Meta: Llama 3.1 70B Instruct

    meta-llama/llama-3.1-70b-instruct

    Text
    Current pricing & context
    Input price
    $0.4 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    19.51 s
    Response starts
    0.28 s
    Output speed
    26.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Meta: Llama 3.1 8B Instruct

    meta-llama/llama-3.1-8b-instruct

    Text
    Current pricing & context
    Input price
    $0.02 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    13.50 s
    Response starts
    0.34 s
    Output speed
    38.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    Mistral: Mistral Nemo

    mistralai/mistral-nemo

    Text
    Current pricing & context
    Input price
    $0.02 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    35.41 s
    Response starts
    6.00 s
    Output speed
    17.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1
  • Model
    MythoMax 13B

    gryphe/mythomax-l2-13b

    Text
    Current pricing & context
    Input price
    $0.4 / 1M tokens
    Context
    4.1K
    Speed measurements
    500-token response
    12.16 s
    Response starts
    0.26 s
    Output speed
    42.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1

Model data fetched .

Practical comparison guide

How to evaluate DeepInfra as an AI inference provider

DeepInfra currently has 87 indexed models on this site, including 15 embeddings, 5 speech, 67 text. This page combines the provider-specific catalog with published pricing and recent performance data so you can identify suitable models and then compare DeepInfra with alternative hosts on each model page.

Review model coverage

DeepInfra offers model-specific routes rather than one interchangeable service. Check modality, context window, supported inputs, and parameter support before comparing price. The largest published context window in this catalog is 10M tokens.

Interpret price and speed together

The lowest published input price shown here is $0.005 / 1M tokens. Recent 500-token response measurements are available for 67 models; missing measurements remain visible and are never estimated.

Confirm deployment requirements

DeepInfra lists its headquarters as US. Published datacenter coverage: no datacenter regions are currently published. Headquarters and hosting regions describe different things, so verify data residency, service terms, and current availability directly with the provider.