Home » Bayes’ Theorem Can Calculate Probable Truth
Bayes’ Theorem Can Calculate Probable Truth
Researched by Thomas DeMichelePublished - January 5, 2016 Last Updated - August 2, 2017
What is Bayes’ Theorem?
Bayes’ theorem is a probabilitytheory used to calculate the likelihood of an event being true or not true based on conditions related to the event. (i.e. an equation used for calculating conditional probabilities).
In other words, Bayes’ theory is a logical statistics-based theory that expresses the concept that we can compare conditional probabilities to find likely truths with a mathematic equation.
In non-math terms Bayes’ theory says, “the more variables considered, and the more certain we are of those variables, then the more certain we can be about our conclusion.”
Or, “the more data pointing to a true outcome, the higher the odds that the outcome is true.” Likewise, “the more data pointing at a false outcome, it’s less likely it is the outcome is false.”
Although we can never know for sure using the inductive method of reasoning Bayes’ theory uses, we can use the formula to increase certainty as we factor in more data and repeat tests.
The concept sounds a lot more difficult than it is, but in simple terms, Bayes’ theory is just “an equation for comparing probabilities to find the likelihood of truths and faleshoods based on statistical data (including usefully, the repetition of tests!)”
The following is a variation of the widely used “Bayes’ Theorem Cancer Example”:
If we know nothing about a person, but want to know if they have cancer, we have no gauge to judge this by; we have no frame of reference, no conditions, no data, and thus there is nothing to know.
If, however, we know some factors such as the person is older, lives near Chernobyl, and “smokes a pack a day” we can combine those risks factors to find the likelihood that that person has cancer.
If we add in a 4th condition, like them being poor and seldom seeking medical attention, it might increase the probability of us knowing, if we add in enough conditions and find positive or negative correlations, then at some point we can be very close to certain.
TIP: We always translate a risk factor to a real number (as we need numbers to do the math). So smoking a pack a day gets translated into a number based on risk factor analysis. This page focuses on concepts; you can see the links below to learn more about the actual math behind Bayesian equations. The gist is that we would assign values to the above variables and then use the Bayesian equation to calculate probability.
Another simple example would be that, if we want to find out if someone has cancer, we can run a test that will detect cancer correctly nine times out of ten, which we can simplify as a test with 90% accuracy. If we repeat this test, do other tests, or apply other data this will increase our effective detection rate beyond 90%. In other words, one way to increase certainty is to run more tests. Each test increases the probability that our conclusion is correct.
Why is this important?: It means that every piece of new evidence we have can improve our understanding of previously held beliefs. In practice, this allows industries like science, technology, computing, statistics, and more to better work with data. For just one example: Google’s self-driving car is literally running a Bayesian algorithm to determine the next best moves.
Explain Bayes’ Theorem – Explained as though teaching a child about probability theory.
Bayes’ Theorem: A Probability Theory
As we said above, Bayes’ Theorem is probability theory. That is, it’s a calculation of the likelihood. To clarify the terms:
Probability works like this: It’s a number value assigned to the likelihood of something happening.
Theories work like this: Facts point toward theory, the more facts that point to it, and the more it works as the fact itself, the more likely it is to be true. Most theories follow a similar line of reasoning to Bayesian thinking.
Bayes’ Theorem: What are the Odds? We can answer that.
Real World Applications of Bayesian Principles
Imagine I have a self-driving car and need to calculate the best next move, the car’s sensor gleans data from the environment and compares probabilities and outcomes until it knows with near certainty how to make the next safest move.
We can use Bayesian principles in insurance adjustment to calculate risks by knowing factors like age, or for healthcare by repeating tests for increased accuracy.
Bayes’ theorem also applies to computer security. Bitcoin uses Bayesian principles for security, by having many independent people confirm a transaction to the blockchain or public ledger, it increases the likelihood that the most common answer is true.
Bayesian principles have far-reaching practical applications, including helping us refine machine learning, cognitive computing, and the way we interact with the IOT. Some even theorize that the human cognition mimics Bayesian algorithms.
Can Bayes’ Theorem Calculate Absolute Truth?
Depending upon the natureof the problem, we can theoretically decrease the margin of error to almost nothing by calculating enough variables.
Using many variables works best when we have a large number of them to compare. The fewer variables, the less certain we can be.
Even with a near 0% margin of error, all probability is a thing of chance by its nature.
We can find an absolute truth using Bayesian principles, but we can’t prove it’s absolute truth using Bayesian principles.
Being 99.9% certain the woman has cancer is not a statement on whether or not the woman has cancer, but it is very useful data!
When a lot of people think something is true, only it isn’t, things start getting sticky. If we analyzed the internet we would think that the maxim “feed a cold, starve a fever” was an “old wives tale” a “myth”. Actually, it seems to have some truth to it. Check out the evidence here.
Now what if this was something more important? It might be tempting to want to replace human logic with statistics-based algorithms, but a strong argument can be made that human cognition trumps computer cognition and mathematic equations in some ways. Under this argument it’s always best to have human input, even when statistics seem to be able to do our job for us. The world is math based, but humans possess some difficult to quantify perks, including the ability to take a critical look at conclusions and fact-check current beliefs.
I strongly suggest checking on the Scientific American articles below, this one was particularly insightful: Bayes’s Theorem: What’s the Big Deal?. Do you have a better way to explain this or want to add something? Comment below.
Bayes’ theorem and related concepts can be used to analyze truth by looking at probability and conditions. It doesn’t denote truth, just probability of truth. This is to say, when we compare conditional probabilities we can increase the “strength” of a belief. The more truths pointing at a belief (the more conditional probabilities point toward truth), the more confident we can be about that truth.
Thomas DeMichele is the content creator behind ObamaCareFacts.com, FactMyth.com, CryptocurrencyFacts.com, and other DogMediaSolutions.com and Massive Dog properties. He also contributes to MakerDAO and other cryptocurrency-based projects. Tom's focus in all...