The Available Evidence

People are inclined to make decisions based on how readily available information is to them. If you can easily recall something, you are likely to rely more on this information than other facts or observations. This means judgements tend to be heavily weighted on the most recent piece of information received or the simplest thing to recall.

In practice, research has shown that shoppers who can recall a few low-price products—perhaps because of a prominent ads or promotions—tend to think that a store offers low prices across the board, regardless of other evidence. And in a particularly devious experiment, a psychology professor (naturally) got his students to evaluate his teaching, with one group asked to list two things he could improve and another asked to list 10. Since it’s harder to think of 10 bad things than just two, the students asked to make a longer list gave the professor better ratings—seemingly concluding that if they couldn’t come up with enough critical things to fill out the form, then the course must be good.

Eshe Nelson writing in Quartz

The Base Rate Fallacy can get you in trouble

The Base Rate Fallacy comes into play when someone comes to a conclusion without considering all the relevant information. There’s a tendency to over-estimate the value of new information out of context. Consider also, an accurate test is not necessarily a very predictive test. And some facts are provably true but nevertheless can feel false when phrased a certain way. These factors can lead someone to hold misconceptions about medical tests and other data actually mean.

The Secret of Success

Survivorship bias pulls you toward bestselling diet gurus, celebrity CEOs, and superstar athletes. You look to the successful for clues about the hidden, about how to better live your life, about how you too can survive similar forces against which you too struggle. Colleges and conferences prefer speakers who shine as examples of making it through adversity, of struggling against the odds and winning.  

The problem here is that you rarely take away from these inspirational figures advice on what not to do, on what you should avoid, and that’s because they don’t know. Information like that is lost along with the people who don’t make it out of bad situations or who don’t make it on the cover of business magazines – people who don’t get invited to speak at graduations and commencements and inaugurations. 

The actors who traveled from Louisiana to Los Angeles only to return to Louisiana after a few years don’t get to sit next to James Lipton and watch clips of their Oscar-winning performances as students eagerly gobble up their crumbs of wisdom. In short, the advice business is a monopoly run by survivors. As the psychologist Daniel Kahneman writes in his book Thinking Fast and Slow, “A stupid decision that works out well becomes a brilliant decision in hindsight.”

Before you emulate the history of a famous company, Kahneman says, you should imagine going back in time when that company was just getting by and ask yourself if the outcome of its decisions were in any way predictable. If not, you are probably seeing patterns in hindsight where there was only chaos in the moment. He sums it up like so, “If you group successes together and look for what makes them similar, the only real answer will be luck.” 

Entrepreneur Jason Cohen, in writing about survivorship bias, points out that since we can’t go back in time and start 20 identical Starbucks across the planet, we can never know if that business model is the source of the chain’s immense popularity or if something completely random and out of the control of the decision makers led to a Starbucks on just about every street corner in North America. That means you should be skeptical of any book promising you the secrets of winning at the game of life through following any particular example.

David McRaney Read more here