Bayes' theorem
Fact

Bayes' Theory can be used to calculate the probability something is true or un-true.

What is Bayes’ Theorem?

Bayes’ theorem is a probability theory used to calculate the likely-hood of an event being true or un-true based on conditions related to the event. (i.e. an equation used for calculating conditional probabilities).[4]
It can answer questions like this: “Approximately 1% of women aged 40-50 have breast cancer. A woman with breast cancer has a 90% chance of a positive test from a mammogram, while a woman without has a 10% chance of a false positive result. What is the probability a woman has breast cancer given that she just had a positive test?” – See Cornell’s Bayes’ Formula page for details, or see An Intuitive (and Short) Explanation of Bayes’ Theorem from betterexplained.com for another conceptual take on Bayes without the math.

In other words, Bayes’ theory is a statistics-based theory that expresses the concept that we can compare conditional probabilities to find deeper truth with a mathematic equation. In non-math terms Bayes’ theory says, “the more variables an idea is compared to, and the more certain we are of those variables, then the more certain we can be about that idea”. Or, “the more truths pointing to a truth, the higher the odds that truth is true”. Likewise, if there is a lack of truths pointing at a belief, it’s less likely to be true. We can compare odds for and odds against with the Bayes’ equation.

The concept sounds a lot harder than it is, in simple terms, Bayes’ theory is just “an equation for comparing probabilities to find truth and un-truths”.

There is only one last thing to know; probabilities can never be certainties. Correlation doesn’t necessarily imply causation, although it often is a strong hint.

Bayes’ Theorem for Everyone 01 – Introduction.

FACT: The method is named after an 18th-century Presbyterian minister Thomas Bayes. Bayes published the theory in 1812.

Bayes’ Theorem Examples (Without Math)

The following is a variation of the widely used “Bayes’ Theorem Cancer Example”:

If we know nothing about a person, but want to know if they have cancer, we have no gauge to judge this by; we have no frame of reference, no conditions, no data, and thus there is nothing to know. If, however, we know some factors such as the person is older, lives near Chernobyl, and smokes a pack a day we can combine those risks factors to find the likely-hood that that person has cancer. If we add in a 4th condition, like them being poor and seldom seeking medical attention, it might increase probability, if we add in enough conditions and find positive or negative correlations, then at some point we can be very close to certain.

TIP: We always translate a risk factor to a real number (as we need numbers to do the math). So smoking a pack a day gets translated into a number based on risk factor analysis. This page focuses on concepts; you can see the links below to learn more about the actual math behind Bayesian equations.

A simple example with numbers would be that, if we want to find out if someone has cancer, we can run a test that will detect cancer correctly nine times out of ten, which we can simplify as a test with 90% accuracy. If we repeat this test, do other tests, or apply other data this will increase our effective detection rate beyond 90%.

Why is this important?: It means that every piece of new evidence we have can improve our understanding of previously held beliefs. In practice, this allows industries like science, technology, computing, statistics, and more to better work with data. For just one example: Google’s self-driving car is literally running a Bayesian algorithm to determine the next best moves.

Explain Bayes’ Theorem – Explained as though teaching a child about probability theory.

Bayes’ Theorem: A Probability Theory

As we said above, Bayes’ Theorem is probability theory. That is, it’s a calculation of the likely-hood. To clarify the terms:

  • Probability works like this: It’s a number value assigned to the likely-hood of something happening.
  • Theories work like this: Facts point toward theory, the more facts that point to it, and the more it works as the fact itself, the more likely it is to be true. Most theories follow a similar line of reasoning to Bayesian thinking.

Bayes’ Theorem: What are the Odds? We can answer that.

Real World Applications of Bayesian Principles

Imagine I have a self-driving car and need to calculate the best next move, the car’s sensor gleans data from the environment and compares probabilities and outcomes until it knows with near certainty how to make the next safest move.

We can use Bayesian principles in insurance adjustment to calculate risks by knowing factors like age, or for healthcare by repeating tests for increased accuracy.

Bayes’ theorem also applies to computer security. Bitcoin uses Bayesian principles for security, by having many independent people confirm a transaction to the blockchain or public ledger, it increases the likelihood that the most common answer is true.

Bayesian principles have far-reaching practical applications, including helping us refine machine learning, cognitive computing, and the way we interact with the IOT. Some even theorize that the human cognition mimics Bayesian algorithms.[5]

A “funny” (as in as funny as we can get on a page about probability theory) example: One could use Bayes’ theorem to calculate the probability that Bae has been cheating on us (bae is a 2015 internet slang term for ‘baby’ and is a term of endearment). If we assign probability values to the actions of Bae, like Bae changing their Facebook status to “single” and us finding someone else’s clothes in Bae’s bedroom, we can calculate Bae’s fidelity with some degree of certainty. The more evidence we have, the more certain we can be about Bae’s lack of loyalty. However, this is probability, so we can never know for sure without hard evidence.

Can Bayes’ Theorem Calculate Absolute Truth?

Depending upon the nature of the problem, we can theoretically decrease the margin of error to almost nothing by calculating enough variables. Using many variables works best when we have a large number of them to compare. The fewer variables, the less certain we can be. Even with a near 0% margin of error, all probability is a chance by nature. We can find an absolute truth using Bayesian principles, but we can’t prove it’s absolute truth using Bayesian principles. In other words, truths existence does not depend on our ability to calculate it with certainty.

The Actual Bayes’ Theorem Equation

Bayes’ theorem is stated mathematically as the following equation:

P(A|B) = \frac{P(A)\, P(B | A)}{P(B)},

Where A and B are events.

  • P(A) and P(B) are the probabilities of A and B without regard to each other.
  • P(A | B), conditional probability, is the probability of observing event A given that B is true.
  • P(B | A) is the probability of observing event B given that A is true.

TIP: If you want to dive into the math of Bayes’ Formula you’ll want to check out Cornell’s page on Bayesian math.



Notes

The Danger of Bayesian Thinking

When a lot of people think something is true, only it isn’t, things start getting sticky. If we analyzed the internet we would think that the maxim “feed a cold, starve a fever” was an “old wives tale” a “myth”. Actually, it seems to have some truth to it. Check out the evidence here.

Now what if this was something more important? It might be tempting to want to replace human logic with statistics-based algorithms, but a strong argument can be made that human cognition trumps computer cognition and mathematic equations in some ways. Under this argument it’s always best to have human input, even when statistics seem to be able to do our job for us. The world is math based, but humans possess some difficult to quantify perks, including the ability to take a critical look at conclusions and fact-check current beliefs.

I strongly suggest checking on the Scientific American articles below, this one was particularly insightful: Bayes’s Theorem: What’s the Big Deal?. Do you have a better way to explain this or want to add something? Comment below.


Conclusion

Bayes’ theorem and related concepts can be used to analyze truth by looking at probability and conditions. It doesn’t denote truth, just probability of truth. This is to say, when we compare conditional probabilities we can increase the “strength” of a belief. The more truths pointing at a belief (the more conditional probabilities point toward truth), the more confident we can be about that truth.


References

  1. What is Bayes’s theorem, and how can it be used to assign probabilities to questions such as the existence of God? What scientific value does it have?” Scientificamerican.com
  2. Bayes’s Theorem: What’s the Big Deal?” blog.Scientificamerican.com
  3. Why Bayes Rules: The History of a Formula That Drives Modern Life” Scientificamerican.com
  4. Bayes’ theorem” Wikipedia.org
  5. Are Brains Bayesian?” blog.Scientificamerican.com
  6. Bayes’ Theorem” plato.Stanford.edu
  7. Bayes’ Formula” math.Cornell.edu


"Bayes’ Theorem Can Calculate Probable Truth" is tagged with: Cognitive Computing, Epistemology, Probability and Odds, Theories, Truth


Vote Fact or Myth: "Bayes’ Theorem Can Calculate Probable Truth"

Your Vote: {{ voteModel || 'no vote' | uppercase }}