Within False Cause
When Improvement Was Already Likely
Extreme results often move closer to normal on their own, making weak interventions look more effective than they are.
On this page
- Why extreme results tend to soften over time
- How regression creates false success stories
- Examples from health, business, and performance
Page outline Jump by section
Introduction
Regression to the mean is one of the most common hidden explanations behind persuasive post hoc stories. When an outcome is unusually good or unusually bad, the next measurement is often closer to average even if nothing important has changed. As a result, an intervention introduced after an extreme result can appear effective simply because improvement was already likely. This creates a powerful form of false-cause reasoning: a treatment, management decision, motivational speech, policy change, or training programme receives credit for a recovery that would probably have happened anyway. Statistical researchers have long warned that regression to the mean can make ordinary variation look like genuine change, especially when attention is focused on unusually extreme cases. [PubMed]pubmed.ncbi.nlm.nih.govPubMedRegression to the mean: what it is and how to deal with itby AG Barnett · 2005 · Cited by 2448 — Regression to the mean (RTM) is a… [OUP]academic.oup.comOUP AcademicRegression to the mean: what it is and how to deal with itby AG Barnett · 2005 · Cited by 2470 — Regression to the mean (RTM)…
Within the broader family of post hoc fallacies, regression to the mean matters because it offers a specific alternative explanation. The question is not merely “Did improvement happen after the intervention?” but “Was improvement likely because the starting point was unusually extreme?” [PMC]pmc.ncbi.nlm.nih.govPMCCombined bias suppression in single-arm therapy studiesPMCby HJ Hamre · 2008 · Cited by 44 — Regression to the mean from self-selection at symptom peaks can be suppressed in three ways: by usi…
Why Extreme Results Tend to Soften Over Time
Regression to the mean occurs when measurements are influenced by both stable factors and temporary fluctuations. An extreme score often reflects a mixture of genuine underlying conditions and short-term influences such as luck, timing, measurement error, fatigue, stress, or random variation. Because those temporary influences are unlikely to repeat in exactly the same way, later measurements tend to move closer to the long-run average. OUP Academic [Statistics By Jim]statisticsbyjim.comregression to the meanStatistics By JimRegression to the Mean: Definition & ExamplesMar 28, 2024 — Regression to the mean is the statistical tendency for an un…
A classic example involves test scores. A student who performs extraordinarily well on one test may have benefited from unusually favourable circumstances. Another student who performs extraordinarily badly may have suffered from temporary disadvantages. On a later test, both students are likely to move somewhat closer to their typical level of performance. This does not require any intervention. It is a consequence of how variation works when outcomes are not perfectly consistent. [Wikipedia]WikipediaRegression toward the meanRegression toward the mean
The key point is that regression to the mean is statistical rather than causal. It does not mean that some force is pushing outcomes back to average. Instead, extreme observations often contain a larger component of chance than ordinary observations, making repetition of the same extreme result unlikely. [Statistics By Jim]statisticsbyjim.comregression to the meanStatistics By JimRegression to the Mean: Definition & ExamplesMar 28, 2024 — Regression to the mean is the statistical tendency for an un… [ABC News]abc.net.auABC News What does regression to the mean, mean?What does regression to the mean, mean?May 12, 2015 — Regression is caused by performances fluctuating about ability, so that performance…
How Regression Creates False Success Stories
The most misleading situations arise when people act only after a result becomes extreme.
Imagine a manager intervenes after a sales team records its worst month in years. The next month’s figures improve. The manager concludes that the intervention worked. Yet if the poor month was partly an outlier, some improvement may have been expected even if the manager had done nothing.
The same pattern appears repeatedly:
- An unusually bad outcome occurs.
- Someone introduces a remedy.
- Results improve.
- The remedy receives credit.
The problem is that step four often ignores the possibility that the initial result was selected precisely because it was extreme. Once extreme cases are chosen for attention, subsequent movement towards average performance is partly built into the situation. OUP Academic [Springer Link]link.springer.comSpringer LinkAssessing regression to the mean effects in health care…by A Linden · 2013 · Cited by 238 — In this paper, the author ful…
This is why before-and-after comparisons can be deceptive. A dramatic change between two observations does not automatically demonstrate that the intervention caused the improvement. Without a comparison group or longer-term evidence, regression to the mean remains a plausible alternative explanation. [PMC]pmc.ncbi.nlm.nih.govPMCCombined bias suppression in single-arm therapy studiesPMCby HJ Hamre · 2008 · Cited by 44 — Regression to the mean from self-selection at symptom peaks can be suppressed in three ways: by usi… [2onlinestatbook.com]onlinestatbook.comRegression Toward the MeanA related phenomenon is called the Sports Illustrated Cover Jinx. An experiment without a control group can con…
Health: Why Patients Often Improve After Seeking Treatment
Health care provides some of the clearest examples because patients frequently seek help when symptoms are at their worst.
A person suffering recurring pain, migraines, depression, allergies, or other fluctuating conditions is more likely to book an appointment during a severe episode than during a mild one. If symptoms naturally fluctuate, improvement may occur afterwards even without an effective treatment. Researchers have identified regression to the mean as a major challenge when evaluating therapies, particularly in studies that examine only patients before and after treatment without adequate controls. [PMC]pmc.ncbi.nlm.nih.govPMCCombined bias suppression in single-arm therapy studiesPMCby HJ Hamre · 2008 · Cited by 44 — Regression to the mean from self-selection at symptom peaks can be suppressed in three ways: by usi… [PMC]pmc.ncbi.nlm.nih.govPMCCombined bias suppression in single-arm therapy studiesPMCby HJ Hamre · 2008 · Cited by 44 — Regression to the mean from self-selection at symptom peaks can be suppressed in three ways: by usi…
This helps explain why ineffective treatments can accumulate impressive testimonials. Patients often remember that they sought treatment during an exceptionally bad period and then improved. The timing feels causal. Yet some of the observed recovery may simply reflect a return from an unusually severe episode towards the person’s typical state. [Strength Zone Training]strengthzonetraining.comStrength Zone Training Why Smart Trainers Believe Stupid Things: (Part 3sports world: The “Sports Illustrated jinx” and the “Madden curse…. Regression to the mean might very well be the true explanation for…
For this reason, controlled clinical trials are essential. By comparing treated individuals with similar untreated or differently treated groups, researchers can distinguish genuine treatment effects from improvements that would have occurred naturally. BMJ [OUP Academic]academic.oup.comOUP AcademicRegression to the mean: what it is and how to deal with itby AG Barnett · 2005 · Cited by 2470 — Regression to the mean (RTM)…
Business: The Illusion of the Successful Intervention
Businesses frequently reward or punish employees after unusually good or bad performance. This creates fertile ground for post hoc stories.
Suppose a sales representative has a terrible quarter. Management introduces a new coaching programme. The next quarter is better. The programme is celebrated as a success.
However, the same logic applies to exceptional success. A representative who achieves an extraordinary quarter may receive a special reward, only to perform less spectacularly afterwards. Observers may conclude that praise reduced motivation. In reality, both patterns can emerge from regression to the mean: extreme lows tend to rise and extreme highs tend to fall closer to typical performance. [Wikipedia]WikipediaSports Illustrated cover jinxSports Illustrated cover jinx
This phenomenon has influenced discussions of management practices for decades because it can create misleading impressions about the effectiveness of punishment, rewards, incentives, and organisational reforms. When interventions consistently follow unusually good or bad outcomes, natural statistical movement can masquerade as evidence. [PMC]pmc.ncbi.nlm.nih.govPMCCombined bias suppression in single-arm therapy studiesPMCby HJ Hamre · 2008 · Cited by 44 — Regression to the mean from self-selection at symptom peaks can be suppressed in three ways: by usi…
Performance and Sport: The Myth of the Jinx
Sport offers vivid examples because extraordinary performances attract attention.
The famous “Sports Illustrated cover jinx” claims that athletes featured on the magazine’s cover often decline afterwards. A more mundane explanation is that athletes are selected for the cover precisely because they have just achieved an exceptional performance. Since exceptional performances are difficult to sustain, subsequent results are likely to be less extraordinary. Regression to the mean predicts exactly this pattern. [Wikipedia]WikipediaRegression toward the meanRegression toward the mean [Psychology Today]psychologytoday.comthe sports illustrated cover jinxPsychology TodayThe Sports Illustrated Cover Jinx12 Oct 2016 — The Sports Illustrated Jinx and the Madden Curse are extreme examples of r…
The same logic appears in stories about rookie sensations, championship teams, and unexpectedly profitable business quarters. Exceptional outcomes often contain an element of luck or temporary advantage. When those temporary factors fade, performance appears to decline, creating the illusion that some new event caused the change. [The Guardian]theguardian.commagazine's long-held belief that the 'jinx' could be explained away by the theory of 'regression to the mean'. In plain language this mea…
Importantly, regression to the mean can also create apparent miracles. Athletes suffering unusually poor seasons often improve later without any dramatic causal explanation. Observers notice the recovery and credit whichever change happened most recently. [Wikipedia]WikipediaSports Illustrated cover jinxSports Illustrated cover jinx
How to Spot Regression in a Post Hoc Claim
Several warning signs suggest that regression to the mean may be operating behind a causal story:
- The intervention followed an unusually extreme result.
- The evidence relies mainly on before-and-after comparisons.
- The outcome naturally fluctuates over time.
- No comparable control group is available.
- The improvement is measured immediately after a peak or trough.
- The explanation assumes that any subsequent change must have been caused by the intervention.
When these conditions are present, a post hoc explanation deserves caution. Improvement may be real, but the observed change alone cannot establish why it happened. OUP Academic [Springer Link]link.springer.comSpringer LinkAssessing regression to the mean effects in health care…by A Linden · 2013 · Cited by 238 — In this paper, the author ful…
Why This Matters for Logical Reasoning
Regression to the mean does not prove that an intervention failed. Sometimes treatments, policies, coaching methods, or management decisions genuinely work. The lesson is narrower but important: improvement after an intervention is not sufficient evidence that the intervention caused the improvement.
In post hoc reasoning, people naturally focus on what changed most recently. Regression to the mean reminds us to examine what was already likely to happen. When an outcome begins from an extreme position, movement towards a more ordinary result may require no special cause at all. Ignoring that possibility turns a statistical tendency into a false success story and a common form of false-cause reasoning. [PMC]pmc.ncbi.nlm.nih.govPMCCombined bias suppression in single-arm therapy studiesPMCby HJ Hamre · 2008 · Cited by 44 — Regression to the mean from self-selection at symptom peaks can be suppressed in three ways: by usi… [PubMed]pubmed.ncbi.nlm.nih.govPubMedRegression to the mean: what it is and how to deal with itby AG Barnett · 2005 · Cited by 2448 — Regression to the mean (RTM) is a…
Amazon book picks
Further Reading
Books and field guides related to When Improvement Was Already Likely. Use these as the next step if you want deeper reading beyond the article.
Fooled by Randomness
Rating: 4.0/5 from 15 Google Books ratings
Shows how random variation creates false success stories.
eBay marketplace picks
Marketplace Samples
Example marketplace items related to this page. Use the search link to explore similar finds on eBay.
Endnotes
-
Source: academic.oup.com
Link: https://academic.oup.com/ije/article/34/1/215/638499Source snippet
OUP AcademicRegression to the mean: what it is and how to deal with itby AG Barnett · 2005 · Cited by 2470 — Regression to the mean (RTM)...
-
Source: pmc.ncbi.nlm.nih.gov
Link: https://pmc.ncbi.nlm.nih.gov/articles/PMC1125994/Source snippet
All healthcare professionals...
-
Source: link.springer.com
Link: https://link.springer.com/article/10.1186/1471-2288-13-119Source snippet
Springer LinkAssessing regression to the mean effects in health care...by A Linden · 2013 · Cited by 238 — In this paper, the author ful...
-
Source: Wikipedia
Title: Regression toward the mean
Link: https://en.wikipedia.org/wiki/Regression_toward_the_mean -
Source: onlinestatbook.com
Link: https://onlinestatbook.com/2/regression/regression_toward_mean.htmlSource snippet
Regression Toward the MeanA related phenomenon is called the Sports Illustrated Cover Jinx. An experiment without a control group can con...
-
Source: pmc.ncbi.nlm.nih.gov
Title: PMCCombined bias suppression in single-arm therapy studies
Link: https://pmc.ncbi.nlm.nih.gov/articles/PMC2695861/Source snippet
PMCby HJ Hamre · 2008 · Cited by 44 — Regression to the mean from self-selection at symptom peaks can be suppressed in three ways: by usi...
-
Source: bmj.com
Title: bmj 2024 081124
Link: https://www.bmj.com/content/389/bmj-2024-081124Source snippet
BMJCONSORT 2025 explanation and elaborationby S Hopewell · 2025 · Cited by 168 — The CONSORT (Consolidated Standards of Reporting Trials)...
-
Source: Wikipedia
Title: Sports Illustrated cover jinx
Link: https://en.wikipedia.org/wiki/Sports_Illustrated_cover_jinx -
Source: bmj.com
Link: https://www.bmj.com/about-bmj/resources-readers/publications/statistics-square-one/11-correlation-and-regressionSource snippet
11. Correlation and regressionIn this [context]({{ 'context/' | relative_url }}) “regression” (the term is a historical anomaly) simply means that the average value of y is...
-
Source: bmj.com
Title: regression mean
Link: https://www.bmj.com/rapid-response/2011/10/29/regression-meanSource snippet
Regression to the mean29 Mar 2003 — Cross sectional survey of effectiveness of lipid lowering drugs in reducing serum cholesterol concent...
-
Source: bmj.com
Title: bmj 2023 078276
Link: https://www.bmj.com/content/386/bmj-2023-078276Source snippet
Developing clinical prediction models: a step-by-step guideby O Efthimiou · 2024 · Cited by 325 — This article presents a step-by-step gu...
-
Source: bmj.com
Link: https://www.bmj.com/content/350/bmj.h2750Source snippet
Regression based quasi-experimental approach when...by E Kontopantelis · 2015 · Cited by 1073 — Interrupted time series analysis is a qu...
-
Source: bmj.com
Link: https://www.bmj.com/content/308/6933/896Source snippet
Statistics Notes: Correlation, regression, and repeated databy JM Bland · 1994 · Cited by 317 — The extreme case would occur if we had on...
-
Source: bmj.com
Link: https://www.bmj.com/content/341/bmj.c5004Source snippet
regression equation, so plots such as these show how much the individual units (in this case practices) differ from the mean. For the...
-
Source: bmj.com
Link: https://www.bmj.com/sites/default/files/attachments/bmj-article/pre-pub-history/second-response-15.2.20.pdfSource snippet
Response to the reviewersFor example, by 5 and 10 years after follow-up what is the average additional risk (or reduction in risk) for ea...
-
Source: bmj.com
Title: bmj 2023 074820
Link: https://www.bmj.com/content/384/bmj-2023-074820Source snippet
Evaluation of clinical prediction models (part 2)by RD Riley · 2024 · Cited by 308 — Multivariable Model-Building - A pragmatic approach...
-
Source: bmjopen.bmj.com
Link: https://bmjopen.bmj.com/content/10/12/e039921Source snippet
to statistical simulations in health researchby AL Boulesteix · 2020 · Cited by 83 — We aim to provide a first introduction to simulation...
-
Source: bmj.com
Title: response 04 mar 2025
Link: https://www.bmj.com/sites/default/files/attachments/bmj-article/pre-pub-history/response_04-mar-2025.pdfSource snippet
Point-to-point reply: BMJ-2024-082092 – 2nd revisionOur answer: We have now performed an additional analysis using days from T0 to T1 as...
-
Source: bmj.com
Link: https://www.bmj.com/content/350/bmj.h1302Source snippet
Precision medicine to improve use of bleeding avoidance...by JA Spertus · 2015 · Cited by 85 — In addition, among the nine study sites...
-
Source: bmjopen.bmj.com
Link: https://bmjopen.bmj.com/content/5/9/e008093.reviewer-commentsSource snippet
review historyThe authors should then add a paragraph "attrition analysis" and describe the students lost to follow-up. Methods: There is...
-
Source: bmj.com
Title: On the 12th Day of Christmas, a Statistician Sent to Me
Link: https://www.bmj.com/content/bmj/379/bmj-2022-072883.full.pdfSource snippet
by RD Riley · 2022 · Cited by 58 — Meta-regression is often used to examine the extent to which study level covariates (eg, mean age, dos...
-
Source: pubmed.ncbi.nlm.nih.gov
Link: https://pubmed.ncbi.nlm.nih.gov/15333621/Source snippet
PubMedRegression to the mean: what it is and how to deal with itby AG Barnett · 2005 · Cited by 2448 — Regression to the mean (RTM) is a...
-
Source: statisticsbyjim.com
Title: regression to the mean
Link: https://statisticsbyjim.com/basics/regression-to-the-mean/Source snippet
Statistics By JimRegression to the Mean: Definition & ExamplesMar 28, 2024 — Regression to the mean is the statistical tendency for an un...
-
Source: abc.net.au
Title: ABC News What does regression to the mean, mean?
Link: https://www.abc.net.au/science/articles/2015/05/12/4217146.htmSource snippet
What does regression to the mean, mean?May 12, 2015 — Regression is caused by performances fluctuating about ability, so that performance...
Published: May 12, 2015
-
Source: strengthzonetraining.com
Title: Strength Zone Training Why Smart Trainers Believe Stupid Things: (Part 3)
Link: https://www.strengthzonetraining.com/why-smart-trainers-believe-stupid-things-part-3-regression-to-the-mean/Source snippet
sports world: The “Sports Illustrated jinx” and the “Madden curse.... Regression to the mean might very well be the true explanation for...
-
Source: psychologytoday.com
Title: the sports illustrated cover jinx
Link: https://www.psychologytoday.com/gb/blog/what-the-luck/201610/the-sports-illustrated-cover-jinxSource snippet
Psychology TodayThe Sports Illustrated Cover Jinx12 Oct 2016 — The Sports Illustrated Jinx and the Madden Curse are extreme examples of r...
-
Source: theguardian.com
Link: https://www.theguardian.com/sport/2002/jan/20/ussport.lawrencedoneganSource snippet
magazine's long-held belief that the 'jinx' could be explained away by the theory of 'regression to the mean'. In plain language this mea...
-
Source: psychologytoday.com
Title: the sports illustrated cover jinx
Link: https://www.psychologytoday.com/us/blog/what-the-luck/201610/the-sports-illustrated-cover-jinxSource snippet
Oct 12, 2016 — This is a statistical phenomenon known as regression to the mean. There is regression in baseball and other athletic perfo...
-
Source: scribbr.com
Title: regression to the mean
Link: https://www.scribbr.com/research-bias/regression-to-the-mean/Source snippet
Definition & ExamplesOct 15, 2022 — Regression to the mean is observed when variables that are extremely high or low move closer to the a...
-
Source: psychologytoday.com
Link: https://www.psychologytoday.com/ca/blog/what-the-luck/201610/the-sports-illustrated-cover-jinxSource snippet
The Sports Illustrated Cover JinxOct 12, 2016 — The Sports Illustrated Jinx and the Madden Curse are extreme examples of regression...
Additional References
-
Source: convert.com
Link: https://www.convert.com/glossary/regression-to-the-mean/Source snippet
Definition of Regression to the MeanRegression to the mean is the statistical tendency for extreme values to move closer to the average o...
-
Source: nbastuffer.com
Link: https://www.nbastuffer.com/analytics101/regression-to-the-mean/Source snippet
NBAstufferRegression To The Mean in Sports ExplainedRegression to the mean in sports performance produced the “Sports Illustrated Jinx” s...
-
Source: medium.com
Link: https://medium.com/%40vplevris/regression-to-the-mean-why-extreme-results-rarely-last-and-what-we-can-do-about-it-01f11ac7766eSource snippet
Regression to the Mean: Why Extreme Results Rarely LastExtreme results tend to be followed by more typical ones. · Regression to the mean...
-
Source: brookbushinstitute.com
Link: https://brookbushinstitute.com/glossary/regression-to-the-meanSource snippet
Regression to the meanIf you select extreme cases on the first measurement, follow-up measures will likely be less extreme simply because...
-
Source: medium.com
Link: https://medium.com/data-science/regression-to-the-mean-and-its-implications-648660c9bf76Source snippet
Regression to the mean and its implicationsRegression to the mean occurs when you compare any two variables that aren't perfectly correla...
-
Source: bigthink.com
Link: https://bigthink.com/articles/a-simple-principle-that-explains-everything-from-the-perceived-success-of-speed-cameras-and-alternative-medicine-to-the-sports-illustrated-jinx/Source snippet
A simple principle that explains everything from the...25 Jan 2014 — A simple principle that explains everything from the perceived succ...
-
Source: www-users.york.ac.uk
Link: https://www-users.york.ac.uk/~mb55/talks/regmean.htmSource snippet
towards the meanby M Bland · Cited by 9 —... example of regression towards the mean. Hollywood Sequels. A... The 'Curse of Hello' and t...
-
Source: mathwords.com
Link: https://www.mathwords.com/r/reversiontothe_mean.htm -
Source: retractionwatch.com
Link: https://retractionwatch.com/2018/10/30/the-regression-to-the-mean-project-what-researchers-should-know-about-a-mistake-many-make/Source snippet
The “regression to the mean project:” What researchers...Oct 30, 2018 — For an example from the world of sports, consider “The Sports Il...
-
Source: physicsforums.com
Title: Sports Illustrated Jinx: Regression to the Mean
Link: https://www.physicsforums.com/threads/sports-illustrated-jinx-regression-to-the-mean.171887/Source snippet
May 27, 2007 — Concerns are raised about the reliability of linear regression models in predicting individual game outcomes, with some in...
Published: May 27, 2007
Topic Tree