Autocorrelation Function of a Signal

[GreenPrint]

Homework Statement

I'm posting this question here at this point. I am having difficulty understanding autocorrelation in terms of solving the problem below. I don't seem to understand the math behind this.

A white noise process W(t) with unity (N_0/2 = 1) power spectral density is input to a linear system. The output of the linear system is X(t), where

X(t) = W(t) - W(t - 1)

Determine the autocorrelation of X(t) and sketch it.

Homework Equations

We can define the autocorrelation function of a stochastic process X(t) as the expectation of the product of two random variables X(t_1) and X(t_2), obtained by sampling the process X(t) at times t_1 and t_2 respectively. So we can write

f_(X(t_1),X(t_2))(x_1,x_2) is the join probability density function of the process X_(t) sampled at times t_1 and t_2

M_(XX)(t_1,t_2) is used to emphasize the fact that this is a second order moment. For M_(XX)(t_1,t_2) to dependent on the time difference t_2 - t_1, we have R_(XX)(t_2 - t_1)

Two different symbols for the autocorrelation function M_(XX)(t_1,t_2) and R_(XX)(t_2 - t_1) to denote that R_(XX)(t_2 - t_1) is the autocorrelation function specifically for a weak stationary process.

Let τ denote a time shift; that is, t = t_2 and τ = t_1 - t_2

The Attempt at a Solution

I understand that the first term on the last line is indeed equal to

. I'm however unsure what to do with the other three terms. The solution sets the other three terms to different autocorrelation functions and I'm not sure how these other three terms are autocorrelation functions as well based off of the definition.

Here's what the solution is. I don't understand how it went from the second line to the third line.

Any help would be greatly appreciated. I also don't understand how how the solution goes from the third line to the fourth line. It seems to just simply replacing the autocorrelation functions with dirac delta functions. I'm not sure how these are equal in any way.

 

[MathematicalPhysicist]

Homework Statement

I'm posting this question here at this point. I am having difficulty understanding autocorrelation in terms of solving the problem below. I don't seem to understand the math behind this.

A white noise process W(t) with unity (N_0/2 = 1) power spectral density is input to a linear system. The output of the linear system is X(t), where

X(t) = W(t) - W(t - 1)

Determine the autocorrelation of X(t) and sketch it.

Homework Equations

We can define the autocorrelation function of a stochastic process X(t) as the expectation of the product of two random variables X(t_1) and X(t_2), obtained by sampling the process X(t) at times t_1 and t_2 respectively. So we can write

f_(X(t_1),X(t_2))(x_1,x_2) is the join probability density function of the process X_(t) sampled at times t_1 and t_2

M_(XX)(t_1,t_2) is used to emphasize the fact that this is a second order moment. For M_(XX)(t_1,t_2) to dependent on the time difference t_2 - t_1, we have R_(XX)(t_2 - t_1)

Two different symbols for the autocorrelation function M_(XX)(t_1,t_2) and R_(XX)(t_2 - t_1) to denote that R_(XX)(t_2 - t_1) is the autocorrelation function specifically for a weak stationary process.

Let τ denote a time shift; that is, t = t_2 and τ = t_1 - t_2

The Attempt at a Solution

I understand that the first term on the last line is indeed equal to

. I'm however unsure what to do with the other three terms. The solution sets the other three terms to different autocorrelation functions and I'm not sure how these other three terms are autocorrelation functions as well based off of the definition.

Here's what the solution is. I don't understand how it went from the second line to the third line.

Any help would be greatly appreciated. I also don't understand how how the solution goes from the third line to the fourth line. It seems to just simply replacing the autocorrelation functions with dirac delta functions. I'm not sure how these are equal in any way.

From the second line to the third is a simple matter of subtracting the arguments, i.e:

E(W(t)W(t+\tau-1) = R_{ww}(t+\tau-1-t) = R_{ww}(\tau-1)
The rest are done in the same way.

As for the deltas, look at the definition of white noise and its autocorrelation function.

 

[GreenPrint]

Hey MathematicalPhysicist,

Thanks for the reply. I didn't realize this was so simple. My new attempt at a solution

I know that

. But I don't understand how this equation is true

. It reminds of the simple fact that if

LHS = RHS
LHS + 1 = RHS +1

But that doesn't seem to be the case here. Adding one to both functions inside the expectation operator doesn't change the value of the expectation?

E[W(t - 1)W(t + tau)] = E[W(t - 1 + 1)W(t + tau + 1)] = E[W(t)W(t + tau + 1)] = R_(WW)(tau + 1)?

I don't understand this. Is it some property of the expectation operator:

E[F(t)(F(t)] = E[F(t + 1)F(t + 1)]?

 

[MathematicalPhysicist]

For E(W(t-1)W(t+\tau))=R_{ww}(t+\tau-(t-1))=R_{ww}(\tau+1)

Remember you always take the aboslute value of the difference of times.

 

[GreenPrint]

For E(W(t-1)W(t+\tau))=R_{ww}(t+\tau-(t-1))=R_{ww}(\tau+1)

Remember you always take the aboslute value of the difference of times.

I actually didn't know this

E[F(f(t))F(g(t))] = E[F(t)F(g(t) -f(t))] = R_{FF}(g(t) - f(t))?

If I were to try and find the power spectral density of X(t) I would make use of S_{XX}(f) = F[R_{XX}(\tau)]. Were F[] is the Fourier Transform. S_{XX}(f) = F[2*delta(\tau) - delta(\tau - 1) - delta(\tau + 1)] I know that F[delta(t)] = 1. So the Fourier Transform of the first term is simply just two. I however am having difficulty understanding how F[- delta(\tau - 1) - delta(\tau + 1)] = cos(2\pi*f_{0})

F[delta(\tau - 1) - delta(\tau - 1)]
F[-e^{i} - e^{-i}]

I'm not sure what variable is included in the exponential. But I do know that

-e^{ix} - e^{-ix} = -(e^{ix} + e^{-ix}) = -\frac{2}{2}(e^{ix} + e^{-ix}) = -2cos(x)

Thanks for all of your help.

 

[MathematicalPhysicist]

I actually didn't know this

E[F(f(t))F(g(t))] = E[F(t)F(g(t) -f(t))] = R_{FF}(g(t) - f(t))?

If I were to try and find the power spectral density of X(t) I would make use of S_{XX}(f) = F[R_{XX}(\tau)]. Were F[] is the Fourier Transform. S_{XX}(f) = F[2*delta(\tau) - delta(\tau - 1) - delta(\tau + 1)] I know that F[delta(t)] = 1. So the Fourier Transform of the first term is simply just two. I however am having difficulty understanding how F[- delta(\tau - 1) - delta(\tau + 1)] = cos(2\pi*f_{0})

F[delta(\tau - 1) - delta(\tau - 1)]
F[-e^{i} - e^{-i}]

I'm not sure what variable is included in the exponential. But I do know that

-e^{ix} - e^{-ix} = -(e^{ix} + e^{-ix}) = -\frac{2}{2}(e^{ix} + e^{-ix}) = -2cos(x)

Thanks for all of your help.

You can do what I wrote provided W is WSS (wide sense stationary).

Read about it here:
http://en.wikipedia.org/wiki/Stationary_process#Weak_or_wide-sense_stationarity