Forecasting is a skill.
Good forecasters improve through practice and feedback. Tetlock found that people who kept score and studied their misses improved year after year.
Superforecasting
Philip E. Tetlock and Dan Gardner
Best for: Analysts, investors, leaders and anyone who wants to predict better.
1 min read · 3 lessons
Good forecasting is a learnable skill, not a gift.
Philip Tetlock spent years studying expert predictions and found many experts did little better than chance. Then he ran the Good Judgment Project, part of a forecasting tournament funded by a US intelligence research agency.
A small group of ordinary volunteers, which he called superforecasters, consistently beat others, including some intelligence analysts with access to classified information.
With journalist Dan Gardner, Tetlock explains what made them so good: their habits of mind, not genius.
Superforecasting showed that good judgment can be measured and improved. It is widely used by analysts, investors and policymakers.
Good forecasters improve through practice and feedback. Tetlock found that people who kept score and studied their misses improved year after year.
Split big questions into smaller, answerable parts. Fermi-style estimates turn a scary unknown into a chain of smaller guesses you can reason about.
Begin with how often similar events happen, then adjust for specifics. This is the outside view: what usually happens to cases like this one, before you look at the details.
Change your mind often, but in small steps, as new information comes in. Big swings in opinion are a warning sign. Steady, small corrections track reality better.
Use specific probabilities rather than vague words like likely. Saying 70 percent instead of 'probably' lets you be checked, and being checked is how you get better.
Track forecasts, measure accuracy and learn from mistakes. Superforecasters ran honest postmortems on their hits and misses alike, asking what they got right for the wrong reasons.
Superforecasters split impossible questions into pieces they can estimate, the way physicist Enrico Fermi did.
The best forecasters change their minds frequently, but by small amounts as evidence arrives.
You cannot improve what you do not measure. Write predictions down with probabilities and check them later.
Analysts, investors, leaders and anyone who wants to predict better.
You want simple answers about the future.
The tournament questions were mostly short-term, so the methods are harder to apply to rare or long-range events.