What is the addition law for probability with multiple elements?

Click For Summary
SUMMARY

The addition law for probability with multiple elements is defined through the principle of inclusion-exclusion. For two events, it is expressed as $$P(A\cup B)=P(A)+P(B)-P(A\cap B)$$, and for three events, it extends to $$P(A\cup B\cup C)=P(A)+P(B)+P(C)-P(A\cap B)-P(B\cap C)-P(A\cap C)+P(A\cap B\cap C)$$. The general form for n elements can be derived using the complement of the intersection of complements, leading to the formula $$P\Big( A_1 \bigcup A_2 \bigcup ... \bigcup A_n\Big) = 1 - P\Big( A_1^C \bigcap A_2^C \bigcap ... \bigcap A_n^C\Big)$$. This derivation utilizes indicator random variables and the linearity of the expectations operator to recover the inclusion-exclusion principle.

PREREQUISITES
  • Understanding of basic probability concepts, including events and their unions.
  • Familiarity with set theory, particularly unions and intersections of sets.
  • Knowledge of indicator random variables and their properties.
  • Basic understanding of expectations in probability theory.
NEXT STEPS
  • Study the principle of inclusion-exclusion in detail, focusing on its applications in probability.
  • Learn about indicator random variables and how they are used in probability calculations.
  • Explore advanced probability topics, such as combinatorial probability and its relation to inclusion-exclusion.
  • Review examples of applying the addition law for probability in real-world scenarios.
USEFUL FOR

Students of probability theory, mathematicians, statisticians, and anyone interested in advanced probability concepts and their applications.

christang_1023
Messages
27
Reaction score
3
The additional law with two elements can be expressed $$P(A\cup B)=P(A)+P(B)-P(A\cap B)$$, while the law with three elements can be $$P(A\cup B\cup C)=P(A)+P(B)+P(C)-P(A\cap B)-P(B\cap C)-P(A\cap C)+P(A\cap B\cap C)$$
Now I wonder if there is the more general form of addition law, which applies to any n elements.
 
Physics news on Phys.org
christang_1023 said:
Now I wonder if there is the more general form of addition law, which applies to any n elements.
Yes, there is. It is knows as the principle of inclusion-exclusion, usually discussed in probability books and also in various places online.
 
unless you really like combinatorial manipulations, the easiest derivation that I'm aware of is

i) ##P\Big( A_1 \bigcup A_2 \bigcup A_3 \bigcup... \bigcup A_n\Big) = 1- P\Big( A_1^C \bigcap A_2^C \bigcap A_3^C \bigcap ... \bigcap A_n^C\Big)##
i.e. recall that the union of events is equivalent to the complement of the intersection of complements

ii) then use indicator random variables to model the RHS, which gives
##P\Big( A_1 \bigcup A_2 \bigcup A_3 \bigcup ... \bigcup A_n\Big) = 1 - E\Big[\big(1-\mathbb I_{A_1}\big)\big(1-\mathbb I_{A_2}\big)\big(1-\mathbb I_{A_3}\big)...\big(1-\mathbb I_{A_n}\big)\Big]##

if you expand the polynomial (i.e. apply elementary symmetric functions of the indicators and pay attention to the sign), and then use linearity of the expectations operator, you recover Inclusion-Exclusion for probability.
 

Similar threads

  • · Replies 5 ·
Replies
5
Views
1K
  • · Replies 6 ·
Replies
6
Views
1K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 7 ·
Replies
7
Views
1K
  • · Replies 36 ·
2
Replies
36
Views
5K
Replies
10
Views
1K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K