Survivorship bias overstates the typical mutual fund's reported returns by roughly 1.6 percentage points a year, according to the University of Chicago's Center for Research in Security Prices: surviving U.S. stock funds averaged 8.8 percent over the decade ending 2003, while counting...
Survivorship bias overstates the typical mutual fund's reported returns by roughly 1.6 percentage points a year, according to the University of Chicago's Center for Research in Security Prices: surviving U.S. stock funds averaged 8.8 percent over the decade ending 2003, while counting the funds that quietly died dropped that to 7.2 percent (Wall Street Journal via NYU Stern). The same distortion sits underneath almost every best practice you copy. You study the winners because the winners are the only ones still around to study.
I study behavioral psychology because these errors are so quiet. Survivorship bias does not feel like a mistake. It feels like doing your homework. You read the case studies, you note what the successful companies had in common, you adopt it. The flaw is invisible because the counterexamples were removed from the data before you ever saw it.
The cleanest illustration comes from World War II. The U.S. military wanted to armor its bombers against enemy fire, but armor is heavy, so it could only go in a few places. Officers examined planes returning from missions, mapped where the bullet holes clustered, and proposed reinforcing those spots.
Abraham Wald, a statistician with the Statistical Research Group at Columbia University, saw the error. The damage on returning planes marked the hits an aircraft could absorb and still fly home. The engines, which came back relatively clean, were not safe. Planes hit there simply never returned to be counted (Wikipedia: Abraham Wald).
Wald's insight was to reconstruct the damage distribution for all aircraft that flew from data on only the aircraft that returned, and his work is now considered seminal in the young field of operational research (Wikipedia: Survivorship bias). The armor went where the bullet holes were not. That single reframe is the whole discipline: the sample you can see is filtered, and the filter is exactly the thing you are trying to understand.
Survivorship bias is a statistical error that comes from concentrating on the entities that passed a selection process while overlooking the ones that did not (Wikipedia: Survivorship bias). The selection process is usually invisible. Failed companies stop publishing. Dead funds get scrubbed from the databases. Founders who followed the same playbook and went under do not write memoirs.
The mechanism matters because it explains why the bias is so durable. It is not that people ignore failures out of laziness. The failures are structurally absent. You cannot interview a company that no longer exists, so the interview list is pre-filtered toward success before anyone asks a single question. I wrote more about how invisible filters like this steer decisions in the bias you don't see is the one making your technology decisions.
A best practice is a pattern observed among the people who succeeded. That sounds authoritative until you ask the second question: how many companies did the exact same thing and failed? If you never checked, the pattern explains nothing. A trait shared by winners and losers alike is not a cause of winning.
The most-sold business books have this problem baked in. In Search of Excellence studied 43 companies that were already known to be excellent and then extracted eight shared attributes. Good to Great selected 11 companies after seeing four decades of stock performance, then reverse-engineered the traits. The statistician Gary Smith points out that this is history dressed as prediction, because the companies were chosen precisely because they had already won (Scientific American).
The follow-up is more damning than the setup. Of the 35 publicly traded companies in In Search of Excellence, 20 later underperformed the market (Scientific American). The traits did not travel. They were coincidences that happened to co-occur with success in one window of time, and copying them offered no protection at all. When a competitor's playbook looks obviously correct, that is often the sign to slow down, which is the case I make in watch competitors, don't build their roadmap.
Finance quantifies survivorship bias better than almost any other field, because funds are counted precisely and then deleted precisely. When a fund performs badly it gets liquidated or merged away, and its record disappears from the databases advisers use to research live funds. What remains is a lineup of survivors, which looks stronger than the real population ever was.
The academic estimates are consistent. Brown, Goetzmann, and Ross found survivor bias overstated equity fund returns by roughly 1 to 2 percent a year, and Elton, Gruber, and Blake put it near 1.4 percent, noting the distortion grows with the length of the study and the volatility of returns (NYU Stern). A more recent analysis by Dimensional found that for U.S. equity funds from 1991 to 2020, survivorship bias overstated the median fund's annual alpha by about 0.60 percentage points, which was enough to move the median from clearly negative to almost break-even (Dimensional).
The lesson is not about funds. It is that the difference between the survivors and the full population is measurable, large, and always in the flattering direction. Any dataset built only from things that lasted carries the same upward tilt, whether it is funds, startups, or the tools your peers say they love.
The trap shows up the moment you make a decision by looking at who succeeded. You ask which CRM the fast-growing companies use, which tech stack the unicorns chose, which automation the efficient teams adopted. Every one of those questions samples only survivors, and every answer is tilted.
Consider the founder-drops-out-of-college story. It survives because the handful who dropped out and won are visible and celebrated, while the far larger group who dropped out and failed left no trace. The advice "drop out and build" is a survivorship artifact. The same shape appears when someone insists a risky architecture is fine because a famous company runs it at scale. The companies that tried it and collapsed are not on the panel.
Hiring copies the same shape. A job posting that lists the traits of your best current employees is a survivor sample, because it never captures the people who had those exact traits and still did not work out. So is a marketing channel decision made by asking which channel your successful peers swear by, when the peers who tried the same channel and got nothing are not in the room to warn you.
It compounds with the biases I have written about elsewhere. You keep a failing homegrown system because you built it, which is the endowment effect, and you keep pouring money into it because you already have, which is the sunk cost fallacy. Survivorship bias supplies the justification: you point to the one company where that same stubborn bet paid off and quietly ignore the graveyard of companies where it did not.
Wald's method was to model the planes that never came back. You can do a plain-language version of the same thing. Before you copy a practice, ask who tried it and failed, and go looking for them on purpose. If you cannot find any failures, that is not proof the practice works. It usually means the failures were filtered out before they reached you.
The finance data gives you a rule of thumb for how much to discount. If survivorship inflates fund returns by 1 to 2 percentage points a year, and the effect grows with the length and volatility of the sample (NYU Stern), then a success story spanning many years in a turbulent market deserves the heaviest discount of all. The longer and more dramatic the survival, the more competitors it quietly outlasted, and the fewer of them you will ever hear about.
Invert the question. Instead of "what did the winners do," ask "what did the losers also do." If a trait shows up in both groups, discard it. This is close to running a premortem on borrowed advice: assume the best practice will fail for you and reason about why, which surfaces the conditions the success stories never mention. It pairs well with resisting the pull toward more, which I unpack in default bias and in choosing the tasks you should never automate.
Weight base rates over anecdotes. One vivid success story is a sample size of one, drawn from a pool you cannot see. A boring statistic that counts the failures too, like the fund numbers above, is worth more than any founder's origin story. Studying real behavior at population scale, not the highlight reel, is exactly why I study consumer behavior. And when a vendor's pitch leans entirely on customer success stories, remember that a testimonial page is a survivorship machine by design, a point that connects to why platform comparisons don't count as guidance. We write more about building on evidence rather than folklore across the Kief Studio blog.
Survivorship bias is the error of drawing conclusions only from the things that made it through a selection process, while ignoring the things that did not. Because failures tend to disappear from the record, the survivors you can study look more impressive, and more representative, than the full population ever was.
During World War II, statistician Abraham Wald analyzed damage on returning bombers. Officers wanted to armor the areas with the most bullet holes, but Wald realized those were the survivable hits. The armor belonged where the returning planes showed no damage, because planes hit there had been shot down and never came back to be measured.
A best practice is a pattern spotted among companies that succeeded, but it rarely checks whether failed companies did the same thing. If winners and losers share a trait, that trait does not explain success. Popular studies like In Search of Excellence and Good to Great selected companies after they had already won, and many of those companies later underperformed the market.
Go looking for the failures on purpose before copying anyone. Ask what the companies that also tried this and lost had in common, weight base rates over vivid anecdotes, and treat any dataset that excludes closures or dropouts as tilted upward. Modeling the missing cases, the way Wald did, is the core correction.
The bias is structural, not lazy. The counterexamples are physically absent from the data: dead funds are deleted, closed businesses stop reporting, and failed founders write no books. Because the sample arrives pre-filtered toward success, doing thorough research on it can still leave you with a distorted conclusion.
In a famous experiment, owners demanded twice what buyers would pay for the same mug. That's the endowment effect, and it quietly distorts the cloud versus self-hosting decision in both directions. The fix is to decide as if you owned neither option.
In a set of experiments published in 2011, people who assembled a plain IKEA storage box valued it 63 percent higher than an identical prebuilt one. The IKEA effect, named by the researchers who ran that study, is the bias that makes you overvalue what you built yourself. It quietly...
Imagining that a project has already failed raises a team's ability to correctly identify the reasons for a future outcome by about 30 percent, according to research by Deborah Mitchell, Jay Russo, and Nancy Pennington published in the Journal of Behavioral Decision Making. That single...
Work With Us
Kief Studio builds, protects, automates, and supports full-stack systems for businesses up to $50M ARR.
Newsletter
Strategy, psychology, AI adoption, and the patterns that actually compound. No spam, easy to leave.
Subscribe
