What the Iowa comparison really measured
Berg, Nelson and Rietz compared Iowa Electronic Markets forecasts with 964 polls over five US presidential elections. The market was closer to the eventual result in 74% of those comparisons. The study covers a particular election era and a poll baseline; it does not mean every current event market is right 74% of the time.
Forecasting rates and inflation
Federal Reserve researchers have examined the information in event-contract prices about economic releases and policy decisions. Their findings show that market-based forecasts can be useful against selected benchmarks. A useful forecast can still miss, and a contract price has to be interpreted with its exact settlement rule and observed trading depth.
Why timing changes the score
A Brier score measures how far a probability forecast is from the binary outcome; lower is better. Semafor reported a Kalshi-authored analysis with scores of roughly 0.09 three months before resolution and 0.02 near close. Late certainty is easier to achieve than early insight, and platform-authored studies need an independent reading of methods.
Where markets can go wrong
Thin order books, ambiguous questions, selective participation and sudden new information can distort prices. Comparing a market near settlement with a months-earlier poll is not a like-for-like test. Treat prices as one evidence stream alongside reporting, expert analysis and the written contract—not as a guarantee.
Kalshi-reported Brier scores by lead time
| Measure | Brier score |
|---|---|
| Three months out | 0.09 |
| Near close | 0.02 |
Reading note. Platform-authored study reported by Semafor; the chart is not an independent validation.
Methodology.
The Iowa paper covers elections through 2004; the Federal Reserve analysis concerns selected economic contracts; the Brier comparison comes from a Kalshi-authored study reported by Semafor. Their measures are not interchangeable, and none describes UK platforms generally.
Sources.
-
01
Prediction Market Accuracy in the Long Run (opens in a new tab)
Research papersFunder: University of Iowa academic working draft; see acknowledgements.
Berg, Nelson and Rietz compare Iowa Electronic Markets forecasts with 964 polls across five US elections through 2004.
-
02
Federal Reserve FEDS paper on prediction-market economic forecasts (opens in a new tab)
Research papersFunder: Federal Reserve Board research series; findings are the authors’ own.
Study of event-contract forecasts for economic releases and policy decisions; not a blanket accuracy ranking.
-
03
Kalshi banks on its predictions’ accuracy (opens in a new tab)
ReportingFunder: Semafor reporting; the analysed accuracy study was conducted by Kalshi researchers.
Reports Brier scores of approximately 0.09 three months before close and 0.02 near close. Platform-authored evidence warrants caution.
Follow the original documents for definitions, scope and subsequent revisions. Browse the full source library ↗