Joint Probability From Correlation Function

AI Thread Summary
To determine the joint probability of correlated binary variables, pairwise correlations alone are insufficient for more than two variables. The discussion highlights that while the joint probabilities for two variables can be calculated using their correlation, extending this to three or more variables requires higher moments. A reference to Teugels (1990) is suggested, which offers a formulation for multivariate Bernoulli distributions with dependencies. The need for additional statistical methods or formulations is emphasized to accurately compute joint probabilities in larger sets of variables. Understanding these higher moments is crucial for progressing beyond pairwise correlations.
Torkel
Messages
1
Reaction score
0
Dear all

I have the following problem. Given a set of correlated binary variables, can I determine the joint probability from the correlation function?

{Xi} is a set of binary variables
Pr(Xi=1) = p and Pr(Xi=0) = q for all i
Corr(Xi Xj) = cij

cij is symmetric

Now how can I determine the joint probability Pr({Xi, Xj, Xk ...})
For the joint probability of two variables I think I have the answer.
Noting that cij= (E(Xi Xj) - p2) / pq, and using the notation {Xi=xi,Xj=xi} -> {xi,xj}

I have
Pr( {1,1} )= E(Xi Xj) = p*q*cij + p2

and by symmetry
Pr( {0,0} ) = p*q*cij + q2

and Pr( {0,1} ) = Pr( {1,0} ) = ( 1-Pr({1,1})-Pr({0,0}) ) / 2 = p*q*(1- cij )
using that p+q = 1

How can I proceed to get Pr( {Xi,Xj, Xk} ), and generally Pr( {Xi,Xj, Xk, ….} )? I'm I missing something obvious? Any help or input is highly appreciated.

best
t
 
Last edited:
Physics news on Phys.org
You will need higher moments - the pairwise correlations are not enough for n>2. Look into Teugels (1990) ‘Some Representations of the Multivariate Bernoulli and Binomial Distributions’, where he provides a formulation for a general multivariate Bernoulli with dependencies, for n dimensions.

Omri.
 
I was reading documentation about the soundness and completeness of logic formal systems. Consider the following $$\vdash_S \phi$$ where ##S## is the proof-system making part the formal system and ##\phi## is a wff (well formed formula) of the formal language. Note the blank on left of the turnstile symbol ##\vdash_S##, as far as I can tell it actually represents the empty set. So what does it mean ? I guess it actually means ##\phi## is a theorem of the formal system, i.e. there is a...

Similar threads

Replies
43
Views
5K
Replies
6
Views
2K
Replies
16
Views
3K
Replies
4
Views
2K
Replies
4
Views
3K
Replies
15
Views
4K
Replies
5
Views
1K
Replies
16
Views
2K
Replies
4
Views
1K
Back
Top