Mutual Information from this Gaussian Distribution

Click For Summary
To calculate Mutual Information from a given Gaussian distribution, the relevant equations involve the joint distribution and the marginal distributions of the variables. The user references two sources that provide insights into the necessary equations. The primary challenge is connecting these equations to derive Mutual Information specifically for the Gaussian distribution presented. Understanding the relationship between the covariance matrix and the joint entropy is crucial for this calculation. Clarifying these connections will enable the accurate computation of Mutual Information.
Arman777
Insights Author
Gold Member
Messages
2,163
Reaction score
191
Homework Statement
Calculating Mutual Information from Gaussian
Relevant Equations
Statistics Equations
Let us suppose we are given a Gaussian Distribution in the form of

$$p(x,y) \propto exp(-\frac{1}{2}x^2 - \frac{1}{2}by^2 - cxy)$$ What are the equations that I need to use to obtain Mutual Information ?
 
Physics news on Phys.org

Thread 'Distance between a Clock's hands when the distance is increasing most rapidly'

Question: A clock's minute hand has length 4 and its hour hand has length 3. What is the distance between the tips at the moment when it is increasing most rapidly?(Putnam Exam Question) Answer: Making assumption that both the hands moves at constant angular velocities, the answer is ## \sqrt{7} .## But don't you think this assumption is somewhat doubtful and wrong?
View full post »

Similar threads

Understanding the meaning of "expected fraction" (Statistics)
  • · Replies 4 ·
Replies
4
Views
2K
Total movement of bacteria assuming a random distribution
  • · Replies 5 ·
Replies
5
Views
2K
Determine marginal densities and distributions from joint density
  • · Replies 7 ·
Replies
7
Views
1K
Problems with Gaussian distribution
  • · Replies 2 ·
Replies
2
Views
2K
Consider the Gaussian Distribution....?
  • · Replies 4 ·
Replies
4
Views
2K
Linear combination of random variables
  • · Replies 18 ·
Replies
18
Views
2K
Understanding Conditional Expectation, Variance, and Precision Matrices
  • · Replies 0 ·
Replies
0
Views
841
Calculating a moment of a distribution
  • · Replies 11 ·
Replies
11
Views
2K
Integrating Gaussian Distribution (QM)
  • · Replies 10 ·
Replies
10
Views
2K
Showing a Distribution is Gaussian
  • · Replies 2 ·
Replies
2
Views
2K