Is the Law of Total Probability a Theorem or an Axiom?

In summary, the law of total probability is a theorem that states that the probability of an event can be calculated by summing the probabilities of its disjoint subsets. This is based on the axiom that the probabilities of disjoint events can be summed. Additionally, if the probability of a specific event is known, the probability of a subset of that event can be calculated using the formula P(B|A_n) = P(B∩A_n)/P(A_n).
  • #1
TSC
39
1
Is the law of total probability a theorem or an axiom?
 
Physics news on Phys.org
  • #2
Theorem.
 
  • #3
It is an axiom that the probabilities of disjoint events can be summed: if ##A_1, \ldots A_N## are disjoint and ##\bigcup_{n=1}^{N}A_n = A##, then ##P(A) = \sum_{n=1}^{N} P(A_n)##.

If ##B \subset A##, then we may write ##B## as the disjoint union ##B = \bigcup_{n=1}^{N} (B \cap A_n)##, so the axiom gives us ##P(B) = \sum_{n=1}^{N}P(B \cap A_n)##.

Finally, if ##P(A_n) > 0## we define ##P(B | A_n) = P(B \cap A_n) / P(A_n)##, so ##P(B \cap A_n) = P(B|A_n) P(A_n)##. Substituting into the result in the previous paragraph, we obtain
$$P(B) = \sum_{n=1}^{N} P(B|A_n) P(A_n)$$

So, it's a theorem, but quite a simple one: we simply substitute a definition into an axiom.
 
  • #4
wow!
That is really very clear. :) Thanks.
 
  • #5


The Law of Total Probability is a theorem, not an axiom. Axioms are basic assumptions or principles that are accepted without proof, while theorems are statements that can be proven based on axioms and other previously proven theorems. The Law of Total Probability can be proven using basic axioms of probability and other theorems, such as the rules of conditional probability and the multiplication rule. Therefore, it is considered a theorem rather than an axiom.
 

1. What is the Law of Total Probability?

The Law of Total Probability, also known as the Law of Total Expectation, is a fundamental concept in probability theory that states that the probability of an event is equal to the sum of the probabilities of all possible outcomes.

2. How is the Law of Total Probability used?

The Law of Total Probability is used to calculate the probability of an event when there are multiple possible outcomes with different probabilities. It allows us to consider all possible outcomes and their probabilities to determine the overall probability of an event.

3. What is the formula for the Law of Total Probability?

The formula for the Law of Total Probability is P(A) = ∑ P(A|B) * P(B), where P(A) is the probability of event A, P(A|B) is the conditional probability of event A given event B, and P(B) is the probability of event B.

4. What is the difference between the Law of Total Probability and the Bayes' Theorem?

The Law of Total Probability and Bayes' Theorem are both used to calculate probabilities of events. However, the Law of Total Probability is used to calculate the probability of an event when there are multiple possible outcomes, while Bayes' Theorem is used to update the probability of an event based on new information.

5. Can the Law of Total Probability be applied to continuous random variables?

Yes, the Law of Total Probability can be applied to both discrete and continuous random variables. However, in the case of continuous random variables, the summation in the formula is replaced with an integral to account for the infinite number of possible outcomes.

Similar threads

  • Set Theory, Logic, Probability, Statistics
Replies
11
Views
502
  • Set Theory, Logic, Probability, Statistics
Replies
4
Views
557
  • Set Theory, Logic, Probability, Statistics
Replies
9
Views
415
  • Set Theory, Logic, Probability, Statistics
Replies
10
Views
1K
Replies
2
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
1K
  • Set Theory, Logic, Probability, Statistics
2
Replies
40
Views
3K
  • Set Theory, Logic, Probability, Statistics
Replies
6
Views
3K
  • Set Theory, Logic, Probability, Statistics
Replies
5
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
1K
Back
Top