top of page

The Base Rate Fallacy: How Cognitive Biases Can Make or Break Your Investment Success

Human psychology often plays a big part in investment choices. While traditional

financial theory assumes rational decision-making, behavioural finance highlights the significance of cognitive biases in investment choices. Why does a person ignore seemingly obvious probabilities, or why does one choose selling instead of holding?


base rate fallacy
Base Rate Fallacy

Cognitive biases are ways our brains can trick us into thinking and making decisions in certain ways, often based on emotions or past experiences rather than facts or logic. They can lead us to make mistakes or see things inaccurately without realising it. This article of our behavioural finance series deals with the cognitive bias of base rate fallacy. This bias can massively distort our perception of risk and returns in the market.


What is the Base Rate Fallacy?


The base rate fallacy refers to the tendency of individuals to prioritise specific, vivid, or recent information over broader, statistical data when making decisions. This can lead investors to overlook crucial information, resulting in skewed risk assessments and detrimental investment strategies.


For instance, an investor might focus solely on the recent success of a particular stock without considering the broader historical performance of the industry or the market as a whole.


To illustrate, consider an investor who decides to pour all their resources into a promising tech startup solely based on the recent surge in the tech sector. Ignoring the historical volatility and the fundamental health of the company, they fall prey to this common cognitive bias failing to acknowledge the potential risks associated with the investment.


In "Thinking, Fast and Slow," Nobel prize-winning psychologist Daniel Kahneman explores how our minds simplify complex data and often ignore important statistics. He highlights how our judgments are vulnerable to biases, stressing the need to incorporate statistical information into investment decisions.


Fascinating Experiments on Base Rate Fallacy


In one of the very first experiments on this bias, Kahneman and Amos Tversky crafted a detailed profile of a fictional grad student, Tom W. The participants were tasked with ranking nine fields of study by their perceived likelihood for Tom. Despite more students pursuing education and humanities, a staggering 95% believed Tom was studying computer science, completely disregarding the actual enrollment statistics.


Base rate fallacy daniel kahneman experiment
Daniel Kahneman Experiment

How Base Rate Pervades Our Everyday Lives


In a well-known experiment from Bar-Hillel's research, participants were given base rate data about two cab companies in a city, one with 85% blue cabs and the other with 15% green cabs. When told about a witness who identified a green cab in a hit-and-run, participants guessed the probability of the witness being right at 80%. However, the actual probability, considering the low percentage of green cabs, was 41%.


base rate fallacy cab problem
Cab Problem

How People Overestimate Their Generosity: A Base Rate View


In another study by Epley and Dunning, university students were asked how much money they would donate and how much the average person would donate from a given sum. Their predictions about their own generosity stayed high despite gaining information about others' donations, while their predictions about others aligned with the average donation over time. This indicates that when specific information is lacking, people rely on base rate information, but when they have personal details, they tend to favour those instead of broader data.


Insights from Leading Financial Minds


Notable financial experts have underlined how this cognitive bias can affect investment decisions. Nassim Nicholas Taleb, in "The Black Swan" emphasises the need to understand the bigger statistical picture to assess risks accurately. Taleb warns that focusing solely on recent trends without considering historical data could lead to unforeseen market shocks. It's also worth noting that Taleb in his book "Skin in the Game" highlights how having risk exposure to one's work increases the quality of output and leads to a highly ethical constitution. Thus, having skin in the game is a critical way for investors to better eliminate cognitive biases.


In another book on human behaviour, "Nudge" Richard H. Thaler and Cass R. Sunstein advocate for designing investment environments that encourage investors to consider broader statistical data, thus reducing the impact of cognitive biases. They emphasise the importance of strategies that incorporate a comprehensive understanding of base rates to foster more informed decision-making in financial markets.


Application in Investing: Mitigating Risks and Making Informed Choices


Understanding the base rate fallacy is crucial for investors looking to mitigate risks and make informed choices. To counter this bias, investors can conduct thorough market research, analyse historical data, and incorporate statistical information into their decision-making. Diversifying portfolios across various industries and asset classes can reduce vulnerability, ensuring a more balanced and risk-averse approach.


Implementing systematic investment strategies that consider long-term trends over short-term fluctuations can also help investors navigate the complexities of the market while minimising the impact of cognitive biases.


To take a recent example, the Israel-Hamas conflict might send some investors into a frenzy looking at the fluctuating crude oil prices, and the impacted diamond trade. However, on conducting in-depth research on the Base Rates, one realises that the supply chains and the markets have remained largely resilient to such conflicts in the Middle East thus relieving investors of their anxiety and making their convictions stronger. In this way, the Base Rate errors are eliminated with the help of thorough market research leading to robust decision-making.


The Gist


Understanding of cognitive biases is imperative for investors given the number of factors, and details they have to take into account before making a decision. These wide considerations open up the scope for creeping biases in decision making. The base rate is one of such biases that investors experience due to vivid apparent information, their own prejudices and prevalent opinions. Experts like Kahneman and Taleb underline the importance of extensive market research and reliance on detailed statistics to overcome it. Hence investors must go for diversified portfolios and long-term strategies with detailed base rate information to make sure they take the right decisions. To know more about cognitive biases and their role in our daily life and investing, make sure to stay up to date with our series of articles on behavioural finance like this one.


Comments


bottom of page