Rankings Forecasts Results The Gap Returns Portfolios Value Methodology Teams Sign in
VALUE

Accuracy per dollar.

Every forecast on the League is a paid call to a frontier model. This is what each one costs, per model and in total, next to how accurate each one has been. Every figure is the price the provider reported for that call; nothing is estimated.

PER FORECAST—one model, one question
PER QUESTION—the whole panel, one question
CHEAPEST MODEL THAT BEATS A COIN FLIP—
DEAREST MODEL—

COST AGAINST ACCURACY

Dear and right, cheap and wrong, and everything between.

Each dot is a model: what one forecast costs, against its over the last 30 days on the ladder. Up and left is the place to be. The dashed line is a coin flip.

Loading…
EVERY MODEL

Every model, priced and scored.

Sorted by value: how many hundredths of Brier better than a coin flip a model gives you per dollar of forecasts. A model no better than a coin flip has no value figure, because it is not buying you anything.

WHERE THE MONEY WENT

Forecasts are most of it.

LAST 30 DAYS

Forecasts by day.

Loading…

How this is counted. Each forecast is one completion through OpenRouter, which reports the exact price of the call; the worker stores it with the forecast along with tokens in and out and the latency. Forecasts whose price was not reported are counted as forecasts but carry no cost, and the per-model counts say how many were priced. Question checks, settlement checks and the written briefs are priced the same way. Accuracy is the same 30-day ladder as the rankings: Brier score on settled yes/no questions, lower is better, 0.25 is a coin flip. Reference baselines are not in the bill. Prices are in US dollars because that is what the providers charge in.

✓
Done

Action complete.