What Is the Success Probability of Merged Bernoulli Processes X1 and X2?

  • Context: MHB 
  • Thread starter Thread starter marcadams267
  • Start date Start date
  • Tags Tags
    Bernoulli Process
Click For Summary

Discussion Overview

The discussion revolves around the success probability of a merged Bernoulli process Y formed from two independent Bernoulli processes X1 and X2, with specific probabilities assigned to each. Participants explore various scenarios regarding the correlation between the processes and how it affects the success probability of Y. The scope includes theoretical reasoning and mathematical exploration.

Discussion Character

  • Technical explanation
  • Mathematical reasoning
  • Debate/contested

Main Points Raised

  • One participant proposes that the success probability of Y can be calculated as the product of the probabilities of X1 and X2 being 1, specifically 0.5 * 0.7 = 0.35, under the assumption of independence.
  • Another participant challenges this view by noting that correlation between X1 and X2 must be considered, suggesting that the initial understanding of independence may be incorrect.
  • Participants discuss the implications of correlation on the success probability, questioning how to incorporate the given correlation into the calculations.
  • One participant visualizes the problem using sets to illustrate the minimum and maximum success probabilities, suggesting a minimum of 0.2 and a maximum of 0.5 based on their reasoning.
  • Another participant elaborates on the maximum success probability, indicating that it cannot exceed the individual probabilities of X1 and X2, thus confirming 0.5 as the maximum when conditioned appropriately.
  • Further discussion includes the application of inclusion-exclusion principles to derive bounds on the success probability, leading to a minimum probability of 0.2.

Areas of Agreement / Disagreement

Participants express differing views on the impact of correlation on the success probability, with some asserting that independence simplifies the calculation, while others emphasize the necessity of considering correlation. The discussion remains unresolved regarding the exact calculations for scenarios (c) and (d).

Contextual Notes

Participants note that the problem's complexity arises from the correlation between the Bernoulli processes, which introduces uncertainty in the calculations. The assumptions regarding independence and correlation are critical to the discussion but remain unresolved.

marcadams267
Messages
19
Reaction score
1
Consider two Bernoulli processes X1 and X2 such that
X1[k] is a Bernoulli random variable with P=0.5 and
X2[k] is a Bernoulli random variable with P=0.7 for all k>=0
Let Y be a random process formed by merging X1 and X2, i.e. Y[k] =1 if and only if X1[k] = X2[k] = 1 and Y[k] = 0 otherwise.

a.) Solve for the success probability of Y if X1 and X2 are uncorrelated.
b.) Solve for the success probability of Y if E[X1[k]X2[k]] = 0.3.
c.) If E[X1[k]X2[k]] is constant for all k, find the minimum possible success probability of Y.
d.) If E[X1[k]X2[k]] is constant for all k, find the maximum possible success probability of Y.

My initial thought was that the success probability of Y was just the intersection of x1 and x2 (when both are equal to 1) or 0.7*0.5 = 0.35.
However, the way to problem is written suggests that correlation affects the probability. Can someone explain how this is so?

Edit: I've realized that the 2 bernoulli processes may not be independent, therefore, my initial understanding of the problem is wrong.
However, how do I use the information given (the correlation) to solve for the probability? What equation relates the two together, or what assumptions can I make about the problem given the correlation?
 
Last edited:
Physics news on Phys.org
marcadams267 said:
Consider two Bernoulli processes X1 and X2 such that
X1[k] is a Bernoulli random variable with P=0.5 and
X2[k] is a Bernoulli random variable with P=0.7 for all k>=0
Let Y be a random process formed by merging X1 and X2, i.e. Y[k] =1 if and only if X1[k] = X2[k] = 1 and Y[k] = 0 otherwise.

a.) Solve for the success probability of Y if X1 and X2 are uncorrelated.
b.) Solve for the success probability of Y if E[X1[k]X2[k]] = 0.3.
This is pretty hard to read with all the multiple indices and no LaTeX to be honest. The standard form I've heard for 'merging' bernouli (or poisson) processes is additive, though this problem clearly is using products here, i.e. you have

$Y_k = X_k^{(1)}\cdot X_k^{(2)}$

so $Y_k$ takes on values 0 and 1 and is Bernouli

if $X_k^{(1)}$ and $ X_k^{(2)}$ are uncorrelated, direct application of the definition tells you that

$E\big[X_k^{(1)}\cdot X_k^{(2)} \big] - E\big[X_k^{(1)} \big] \cdot \big[X_k^{(2)} \big] = 0$ i.e.
$E\big[X_k^{(1)}\cdot X_k^{(2)} \big] = E\big[X_k^{(1)} \big] \cdot \big[X_k^{(2)} \big] $

so your answer to (a) is

$p = E\big[Y_k\big] = E\big[X_k^{(1)}\cdot X_k^{(2)} \big] = E\big[X_k^{(1)} \big] \cdot \big[X_k^{(2)} \big] =0.5 \cdot 0.7$
because the probability of success is equal to the expected values of a bernouli

(b)'s answer seems to be given.

I'd like to see some work on your end for (c) and (d)
 
for c and d,

I'm visualizing it to be two sets of 10 spaces each. One has 5 items within it, and the other has 7.
_ _ _ _ _ x x x x x
x x x x x x x _ _ _

and

x x x x x _ _ _ _ _
x x x x x x x _ _ _

It counts as a logic 1 or success if both corresponding spaces are filled.
The minimum would then be 0.7 - 0.5 = 0.2
and the maximum would be 0.5
 
marcadams267 said:
for c and d,

I'm visualizing it to be two sets of 10 spaces each. One has 5 items within it, and the other has 7.
_ _ _ _ _ x x x x x
x x x x x x x _ _ _

and

x x x x x _ _ _ _ _
x x x x x x x _ _ _

It counts as a logic 1 or success if both corresponding spaces are filled.
The minimum would then be 0.7 - 0.5 = 0.2
and the maximum would be 0.5

I think a visualization like this is very good here and you have the right answer. For a different look at this problem, consider

re: maximization
The thing to keep in mind is probabilities are in [0,1], so they are at most one. For the max we have
$p = E\Big[Y_k\Big] = E\Big[X_k^{(1)}\cdot X_k^{(2)} \Big] = Pr\big(X_k^{(1)} = 1, X_k^{(2)} = 1\big) = Pr\big(X_k^{(1)} = 1\big) \cdot Pr\big( X_k^{(2)} = 1 \big \vert X_k^{(1)} = 1 \big)$
$ \leq Pr\big(X_k^{(1)} = 1\big) \cdot 1 = 0.5 $
which is what we get when we condition on the first random variable. Now conditioning on the second bernouli gives

$p = Pr\big(X_k^{(1)} = 1, X_k^{(2)} = 1\big) =Pr\big(X_k^{(2)} = 1, X_k^{(1)} = 1\big) = Pr\big(X_k^{(2)} = 1\big) \cdot Pr\big( X_k^{(1)} = 1 \big \vert X_k^{(2)} = 1 \big) $
$\leq Pr\big(X_k^{(2)} = 1\big) \cdot 1 = 0.7 $

so putting these inequalities together we have
$p\leq 0.5 \leq 0.7$
and 0.5 is the answer as you've stated.

re: minimization
letting $A_k$ be the event that the first bernouli is 1 and $B_k$ be the event the second bernouli is one, we have

(this is the most basic form of inclusion-exclusion)
$P\Big(A_k \bigcup B_k\Big) = P\Big(A_k\Big) + P\Big(B_k\Big) - P\Big(A_k \bigcap B_k \Big) $
note this tells us

$P\Big(A_k \bigcup B_k\Big) \leq P\Big(A_k\Big) + P\Big(B_k\Big) $
(This is called the union bound)
because $0 \leq P\Big(A_k \bigcap B_k \Big) \leq 1$

and furthermore, since all probabilities are at most 1 we have

$P\Big(A_k \bigcup B_k\Big) \leq \min\Big(1, P\big(A_k\big) + P\big(B_k\big)\Big) = \min\Big(1, 1.2\Big) = 1 $

so we revisit
$P\Big(A_k \bigcup B_k\Big) = P\Big(A_k\Big) + P\Big(B_k\Big) - P\Big(A_k \bigcap B_k \Big) $

now rearrange terms
$P\Big(A_k \bigcap B_k \Big) = P\Big(A_k\Big) + P\Big(B_k\Big) - P\Big(A_k \bigcup B_k\Big) = 0.7 + 0.5 - P\Big(A_k \bigcup B_k\Big) = 1.2 - P\Big(A_k \bigcup B_k\Big) \geq 1.2 - 1 = 0.2$
as you've stated
 

Similar threads

Replies
2
Views
2K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 14 ·
Replies
14
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 5 ·
Replies
5
Views
5K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
1K