Matrix notation - Two jointly Gaussian vectors pdf

Click For Summary

Discussion Overview

The discussion revolves around deriving the conditional probability density function (pdf) of two jointly Gaussian vectors using block matrix notation. Participants explore the mathematical manipulations involved, including matrix inversions and properties of covariance matrices.

Discussion Character

  • Technical explanation
  • Mathematical reasoning
  • Debate/contested

Main Points Raised

  • One participant expresses uncertainty about the validity of taking the inverse of a resultant matrix and the order of multiplication in their derivation.
  • Another participant points out an error in the inverse of a specific block matrix and suggests that the product should yield a symmetric result in x and y.
  • A participant mentions having an extra term in their solution and questions whether a specific term could be zero or if their calculation is incorrect.
  • One participant acknowledges that their original comments were incorrect and confirms the correctness of the initial version of the problem.
  • Another participant seeks clarification on the commutativity of the product of different covariance matrices during their expansion.
  • There is a request for a clearer explanation of a substitution logic presented in an attachment.

Areas of Agreement / Disagreement

Participants do not reach a consensus, as there are multiple competing views regarding the validity of certain assumptions and the correctness of specific steps in the derivation.

Contextual Notes

Participants express uncertainty about the invertibility of matrices involved and the assumptions regarding the commutativity of covariance matrices, which remain unresolved.

EmmaSaunders1
Messages
45
Reaction score
0
Hello

I am having trouble deriving using block matrix notation the conditional pdf of two joint Gaussian vectors:

I assume that it just involves some re-arranging of eq 1 (attatched) but am unsure if taking the inverse of the resultant matrix in eq 1 is valid and if the order of multiplication holds.

Thoughts appreciated
 

Attachments

  • gauss1.JPG
    gauss1.JPG
    51.4 KB · Views: 576
Physics news on Phys.org
There's an error, inv([I,0;A,I])=[I,0;-A,I], otherwise looks on the right track. If you expand the product it should get an answer that is symmetric in x and y as the factorization shouldn't matter. The Woodbury matrix identity may or may not be useful here.

And yes the matrix isn't guaranteed to be invertible (e.g. if X=Y)
 
Hello

Thanks very much for your help. I have multiplied out the problem and looked for symmetry as you suggested. I do however have an extra term in comparison to the final solution;

Would you possibly be-able to take a look at the attatched - perhaps I am missing something - is there any kind of concept or theorem I am missing which suggests the extra term is zero or is fundamentally the calculation wrong. I notice in the original attachment there is a "X" sign I assumed this to be matrix multiplication rather than cross product - is this correct??

Thanks again for your help
 

Attachments

Sorry the original version looks correct, ignore my previous comments - in effect you're showing that [I,-Sxx*inv(Syy);0,I]*[x;y] given y is gaussian. Notice that the exponent reduces to -(1/2)*[x'-xbar',y'-ybar']*(inv(S)-[0,0;0,inv(Syy)])*[x-xbar;y-ybar] and use [0,0;0,inv(Syy)] = [I,0;-inv(Syy)*Syx,I]*[0,0;0,inv(Syy)]*[I,-Sxx*inv(Syy);0,I].
 
Hi Thanks for your help:

I have managed to obtain the desired result - it was simply grouping the matrix multiplication into two parts separated by the X sign in the first attachment to make the multiplication easier. Would you however please be able to clarify - during the expansion I assumed that the product of two different covariance matrices are commutive - is this assumption okay.

I would also like to understand the simpler way you have tried to explain but am unable to follow the logic of the substitution as shown on the attached?

Your helps appreciated

Thanks
 

Attachments

Similar threads

  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
4K
  • · Replies 5 ·
Replies
5
Views
4K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 7 ·
Replies
7
Views
3K
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K