Please help me understand a definition of a covariance function

Click For Summary
The covariance function B(s,t) is defined as E[X_sX_t] - E[X_s]E[X_t], indicating its dependence on the joint behavior of the stochastic process. For strongly stationary processes, B(s,t) is invariant under time shifts, expressed as B(s,t) = f(s-t), which shows that the covariance depends solely on the difference between s and t. The notation change from f(s-t) to C(s-t) reflects a broader definition of covariance functions for weakly stationary processes, where C(s-t) encompasses a wider class of stochastic behaviors. The relationship between C(t) and C(s-t) lies in their definitions, with C(t) representing the covariance for a specific time shift. Overall, the distinctions in notation and definitions clarify the properties of covariance functions in different contexts of stochastic processes.
docnet
Messages
796
Reaction score
488
Homework Statement
Covariance function of a weakly stationary process.
Relevant Equations
.
On page 3 of the lecture notes for Stochastic Analysis, it says '##B(s,t)## is the covariance function ##\mathbb{E}[X_sX_t]-\mathbb{E}[X_s]\mathbb{E}[X_t]##. Then On page 5, it says the notes also say that 'the covariance function ##B(s,t)## of a strongly stationary stochastic process is invariant under time shifts so ##B(s,t)=f(s-t)## for some ##f##'. I'm wondering where did ##s-t## come from?? And I'm wondering how does it convey the information that the covariance function is invariant under time shifts, i.e., ##B(s,t)=B(s+h,t+h)##? This seemed to me like a non-sequitur, am I misunderstanding something obvious?

To top off my confusion, the next line says 'A stochastic process is weakly stationary, second-order stationary, or wide-sense stationary if ##B(s,t)=C(s-t)##' I'm wondering why call it ##C(s-t)## when it's already been called ##f(s-t)##? what information do the letters ##C## and ##f## imply here?? And then, it says ' ##C(t)=\mathbb{E}[X_{s+t}X_s]## for all ##s## is called the covariance function.' I'm wondering how ##C(t)## is related to ##C(s-t)##, and why the covariance function here has a different definition than the one provided earlier on page 3, although weakly stationary doesn't imply zero mean.

Thanks always for your help.
 
Last edited:
Physics news on Phys.org
docnet said:
Homework Statement: Covariance function of a weakly stationary process.
Relevant Equations: .

On page 3 of the lecture notes for Stochastic Analysis, it says '##B(s,t)## is the covariance function ##\mathbb{E}[X_sX_t]-\mathbb{E}[X_s]\mathbb{E}[X_t]##. Then On page 5, it says the notes also say that 'the covariance function ##B(s,t)## of a strongly stationary stochastic process is invariant under time shifts so ##B(s,t)=f(s-t)## for some ##f##'. I'm wondering where did ##s-t## come from?? And I'm wondering how does it convey the information that the covariance function is invariant under time shifts, i.e., ##B(s,t)=B(s+h,t+h)##?
Saying that ##B(s,t)## only depends on ##s-t## means that ##B(s,t) = B(s+h, t+h)## because ##(s+h)-(t+h) =s-t##.
docnet said:
This seemed to me like a non-sequitur, am I misunderstanding something obvious?

To top off my confusion, the next line says 'A stochastic process is weakly stationary, second-order stationary, or wide-sense stationary if ##B(s,t)=C(s-t)##' I'm wondering why call it ##C(s-t)## when it's already been called ##f(s-t)##?
It's just a question of how broadly they want to make the definition of "covariance function". The function ##f(s-t)## was just introduced to say that a strongly stationary ##B(s,t)## only depends on ##s-t##. ##f(s-t)## has not been defined as the covariance function for the strongly stationary process yet because they want to define the covariance function, ##C(s-t)##, in the broader context of weakly stationary processes. Once "weakly stationary" and "covariance function" are defined, it is clear that "strongly stationary" implies "weakly stationary" and that ##f(s-t)## is the covariance function ##C(s-t)##.
 
docnet said:
Homework Statement: Covariance function of a weakly stationary process.
Relevant Equations: .

On page 3 of the lecture notes for Stochastic Analysis, it says '##B(s,t)## is the covariance function ##\mathbb{E}[X_sX_t]-\mathbb{E}[X_s]\mathbb{E}[X_t]##. Then On page 5, it says the notes also say that 'the covariance function ##B(s,t)## of a strongly stationary stochastic process is invariant under time shifts so ##B(s,t)=f(s-t)## for some ##f##'. I'm wondering where did ##s-t## come from?? And I'm wondering how does it convey the information that the covariance function is invariant under time shifts, i.e., ##B(s,t)=B(s+h,t+h)##? This seemed to me like a non-sequitur, am I misunderstanding something obvious?

To top off my confusion, the next line says 'A stochastic process is weakly stationary, second-order stationary, or wide-sense stationary if ##B(s,t)=C(s-t)##' I'm wondering why call it ##C(s-t)## when it's already been called ##f(s-t)##? what information do the letters ##C## and ##f## imply here?? And then, it says ' ##C(t)=\mathbb{E}[X_{s+t}X_s]## for all ##s## is called the covariance function.' I'm wondering how ##C(t)## is related to ##C(s-t)##, and why the covariance function here has a different definition than the one provided earlier on page 3, although weakly stationary doesn't imply zero mean.

Thanks always for your help.
Isn't that a property of/definition of Brownian motion? Isn't that a property of the objects you're working with?
 
First, I tried to show that ##f_n## converges uniformly on ##[0,2\pi]##, which is true since ##f_n \rightarrow 0## for ##n \rightarrow \infty## and ##\sigma_n=\mathrm{sup}\left| \frac{\sin\left(\frac{n^2}{n+\frac 15}x\right)}{n^{x^2-3x+3}} \right| \leq \frac{1}{|n^{x^2-3x+3}|} \leq \frac{1}{n^{\frac 34}}\rightarrow 0##. I can't use neither Leibnitz's test nor Abel's test. For Dirichlet's test I would need to show, that ##\sin\left(\frac{n^2}{n+\frac 15}x \right)## has partialy bounded sums...