Joint Probability From Correlation Function

Click For Summary
SUMMARY

The discussion centers on determining joint probabilities from the correlation function of a set of correlated binary variables {Xi}. The user presents a method for calculating joint probabilities for pairs of variables using the correlation coefficient cij, derived from the expected values of the binary variables. However, it is concluded that for joint probabilities involving more than two variables, higher moments are necessary, as pairwise correlations alone are insufficient. The recommended resource for further understanding is Teugels (1990) ‘Some Representations of the Multivariate Bernoulli and Binomial Distributions’.

PREREQUISITES
  • Understanding of binary variables and their probabilities
  • Familiarity with correlation coefficients and their calculations
  • Knowledge of expected values in probability theory
  • Basic concepts of multivariate distributions
NEXT STEPS
  • Study Teugels (1990) ‘Some Representations of the Multivariate Bernoulli and Binomial Distributions’
  • Learn about higher moments in probability theory
  • Explore multivariate Bernoulli distributions and their properties
  • Investigate methods for calculating joint probabilities in multivariate contexts
USEFUL FOR

Researchers, statisticians, and data scientists working with correlated binary variables, particularly those interested in joint probability calculations and multivariate distributions.

Torkel
Messages
1
Reaction score
0
Dear all

I have the following problem. Given a set of correlated binary variables, can I determine the joint probability from the correlation function?

{Xi} is a set of binary variables
Pr(Xi=1) = p and Pr(Xi=0) = q for all i
Corr(Xi Xj) = cij

cij is symmetric

Now how can I determine the joint probability Pr({Xi, Xj, Xk ...})
For the joint probability of two variables I think I have the answer.
Noting that cij= (E(Xi Xj) - p2) / pq, and using the notation {Xi=xi,Xj=xi} -> {xi,xj}

I have
Pr( {1,1} )= E(Xi Xj) = p*q*cij + p2

and by symmetry
Pr( {0,0} ) = p*q*cij + q2

and Pr( {0,1} ) = Pr( {1,0} ) = ( 1-Pr({1,1})-Pr({0,0}) ) / 2 = p*q*(1- cij )
using that p+q = 1

How can I proceed to get Pr( {Xi,Xj, Xk} ), and generally Pr( {Xi,Xj, Xk, ….} )? I'm I missing something obvious? Any help or input is highly appreciated.

best
t
 
Last edited:
Physics news on Phys.org
You will need higher moments - the pairwise correlations are not enough for n>2. Look into Teugels (1990) ‘Some Representations of the Multivariate Bernoulli and Binomial Distributions’, where he provides a formulation for a general multivariate Bernoulli with dependencies, for n dimensions.

Omri.
 

Similar threads

  • · Replies 43 ·
2
Replies
43
Views
6K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 16 ·
Replies
16
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 4 ·
Replies
4
Views
3K
  • Poll Poll
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 15 ·
Replies
15
Views
4K
  • · Replies 4 ·
Replies
4
Views
6K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 16 ·
Replies
16
Views
2K