Wiener Filter, Correlation Matrices

Click For Summary
SUMMARY

The discussion focuses on the Wiener Filter and its relationship with correlation matrices, specifically addressing the concept of auto-correlation for a single vector. The correlation matrix R_yy is defined as R_yy = E[y(k) * y^T(k)], where y(k) is a vector and y^T(k) is its transpose. The first column of R_yy is the auto-correlation vector r_yy, while subsequent columns represent shifted versions of this vector, forming a symmetric Toeplitz matrix. The Wiener filter vector h_w is derived by minimizing the mean squared error (MSE) criterion, expressed as h_w = h_1 - inv(R_yy) * r_vv.

PREREQUISITES
  • Understanding of Wiener Filter formulation and its applications
  • Knowledge of correlation matrices and auto-correlation concepts
  • Familiarity with matrix operations, including inversion
  • Basic principles of signal processing and mean squared error (MSE) minimization
NEXT STEPS
  • Study the properties of symmetric Toeplitz matrices in signal processing
  • Learn about the derivation and applications of the Wiener Filter in noise reduction
  • Explore the concept of auto-correlation and its significance in time series analysis
  • Investigate the implications of mean squared error (MSE) in optimization problems
USEFUL FOR

This discussion is beneficial for signal processing engineers, data scientists, and researchers interested in noise reduction techniques and the mathematical foundations of the Wiener Filter.

the_dialogue
Messages
77
Reaction score
0
I'm trying to understand the Wiener Filter, and I have a few questions.

1. How can there be such a thing as a correlation matrix of 1 vector. I read here:

R_yy = E[ y(k) * y^T(k) ]

where y(k) is a vector, and y_T(x) is the same vector transposed. I thought correlation represents the degree of correspondence between 2 variables, so how can we say there is a correlation between 2 equivalent vectors?

2. They present a matrix R_yy as the correlation matrix (mentioned above). Then they say vector "r_yy" is the first column of R_yy. If that is so, what are the other columns of R_yy?

3. The book first presents the Wiener filter formulation by saying that in minimizing the MSE criterion, we can find "h_w" (the wiener filter vector). They go on to another form of the Wiener filter by saying:

h_w = h_1 - inv(R_yy)*r_vv

where h_1 was defined as [1 0 0 0 ...]^T and r_vv, I suppose is the correlation (once again I don't know how one can have correlation between 2 equivalent vectors).



Thank you for any help.
 
Physics news on Phys.org
Any ideas?
 
the_dialogue said:
I'm trying to understand the Wiener Filter, and I have a few questions.

1. How can there be such a thing as a correlation matrix of 1 vector. I read here:

R_yy = E[ y(k) * y^T(k) ]

where y(k) is a vector, and y_T(x) is the same vector transposed. I thought correlation represents the degree of correspondence between 2 variables, so how can we say there is a correlation between 2 equivalent vectors?

ryy is the auto-correlation, witch you can think of as the correlation between the signal and shifted versions of itself. The relationship posted by you is actually ryy(0).
ryy(n)= E{y(k)*yT(k-n)}
the_dialogue said:
2. They present a matrix R_yy as the correlation matrix (mentioned above). Then they say vector "r_yy" is the first column of R_yy. If that is so, what are the other columns of R_yy?

That matrix is a symmetric toeplitz matrix. Indeed the first column is ryy, the second is [ryy(1) ryy(0) ryy(1) ryy(2) ... ryy(N-1)]T and so on the last one is ryy reversed.
the_dialogue said:
3. The book first presents the Wiener filter formulation by saying that in minimizing the MSE criterion, we can find "h_w" (the wiener filter vector). They go on to another form of the Wiener filter by saying:

h_w = h_1 - inv(R_yy)*r_vv

where h_1 was defined as [1 0 0 0 ...]^T and r_vv, I suppose is the correlation (once again I don't know how one can have correlation between 2 equivalent vectors).

I don't quite understand what you mean by your notation here.
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 15 ·
Replies
15
Views
3K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 27 ·
Replies
27
Views
4K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
Replies
5
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
1K