Skip to content

OpenInference

HQ: United StatesDatacenters: N/aPrivacyTerms

Average response time

14.37 s

Estimated 500-token answer. Across 1 model with recent complete speed data.

Average response start

0.48 s

Wait until the first token. Across 1 model with recent response start data.

Average output speed

36.0 tok/s

Generated tokens per second. Across 1 model with recent output speed data.

AI Models available from OpenInference

Prices and recent speed measurements below are for OpenInference endpoints. A 500-token response combines the wait for the first token with the time to generate 500 output tokens.

Models

Showing 1 model

  • Model
    OpenAI: gpt-oss-120b

    openai/gpt-oss-120b

    Text
    Current pricing & context
    Input price
    $0.03 / 1M tokens
    Context
    131.1K
    Speed measurements
    500-token response
    14.37 s
    Response starts
    0.48 s
    Output speed
    36.0 tok/s
    Model details
    Model type
    Text
    Provider options
    1

Model data fetched .

Practical comparison guide

How to evaluate OpenInference as an AI inference provider

OpenInference currently has 1 indexed model on this site, including 1 text. This page combines the provider-specific catalog with published pricing and recent performance data so you can identify suitable models and then compare OpenInference with alternative hosts on each model page.

Review model coverage

OpenInference offers model-specific routes rather than one interchangeable service. Check modality, context window, supported inputs, and parameter support before comparing price. The largest published context window in this catalog is 131.1K tokens.

Interpret price and speed together

The lowest published input price shown here is $0.03 / 1M tokens. Recent 500-token response measurements are available for 1 model; missing measurements remain visible and are never estimated.

Confirm deployment requirements

OpenInference lists its headquarters as US. Published datacenter coverage: no datacenter regions are currently published. Headquarters and hosting regions describe different things, so verify data residency, service terms, and current availability directly with the provider.