How the model pages are made

Where every number on a model page comes from, and what it does not tell you.

Get an API key

Where the data comes from

  • Prices, context size and abilities come from One API's public price feed, https://gateway.plungeai.com/v1/pricing. It needs no key. Each model carries the maker's list price and our price.
  • Limits and request parameters come from each model's endpoint record on the same gateway.
  • Speed and the price of a call are measured by us with test calls, described below.

The pages are rebuilt from these sources. "Data checked" on a page is the day of the last build. "Last changed" moves only when a price, a limit or an ability of that page changed.

The test calls

For each chat model we make three calls through a One API key on the public API, https://api.plungeai.com/v1:

  1. Two streamed calls with a fixed counting task and an answer limit of 160 tokens (1,500 for a model that spends its first tokens on reasoning and shows none in 160). We record the time until the first token arrives and the tokens per second after it, and keep the median of the two. Hidden reasoning tokens are not counted as output. When an answer arrives in one burst, no output speed is shown.
  2. One plain call with the same task. We record the price of the call as the API states it in the x-ocean-cost-usd response header.

An embedding model gets three embedding calls of one sentence; we record the time to the answer.

A model that does not answer these calls gets no page. A measurement older than 45 days is never shown: the build fails until the calls are run again.

What the numbers do not show

  • Quality. The calls measure time and price. They say nothing about how good an answer is.
  • Your location. The calls enter Cloudflare at the place named on each page. Times from elsewhere differ.
  • Load. Each number is from a few calls on one day, not an average over weeks.
  • Long prompts. The task is short. A long prompt takes longer to the first token.
  • Tools and images. The calls are plain text. Tool calling and image input are listed from the price feed, not tested.

Models we do not list

Models that One API passes through from another aggregator are not listed yet: their data is that aggregator's, not ours.

See the data

How this page is made

Written by PlungeAI. It describes the build of the model pages as it runs today.

Data checked · Last changed

Get an API key