What is a common regression to the mean mistake?
Praising a manager for improvement after a bad quarter, when performance would have bounced back regardless of any intervention.
Mental Models
When a variable is extreme on one measurement, it will tend to be closer to the average on the next.
Regression to the mean prevents overreaction to outlier events by reminding you that variance naturally pulls results back toward the average.
Is this extreme result likely to persist, or is it partly random and due to revert?
A sales rep has a record quarter. Before restructuring the entire team's strategy around her approach, consider that some of that performance is random variance that will naturally regress.
Praising a manager for improvement after a bad quarter, when performance would have bounced back regardless of any intervention.
Only partially. The larger the luck component in an outcome, the stronger the regression effect. Pure skill activities regress less.
Think in likelihoods and ranges instead of certainties.
Specific stories can drown out general probabilities.
Distinguish meaningful patterns from random variation.