Correlation Function of the Ornstein-Uhlenbeck Process

Click For Summary

Discussion Overview

The discussion centers on the Ornstein-Uhlenbeck (OU) process, particularly its correlation functions and properties such as Gaussianity, stationarity, and Markovian behavior. Participants explore methods for confirming these properties through numerical simulations and empirical data analysis.

Discussion Character

  • Exploratory
  • Technical explanation
  • Mathematical reasoning

Main Points Raised

  • Some participants propose that the OU process is characterized by being Gaussian, stationary, and Markovian, and seek methods to confirm these properties from numerical data.
  • One participant suggests generating multiple processes and using histogram analysis to check for Gaussianity, along with statistical tests like Kolmogorov-Smirnov to quantify the fit.
  • Another participant mentions determining the power spectral density to confirm stationarity and Markovian properties, noting that the spectral density should exhibit specific forms for first and second order Markov processes.
  • A participant shares their success in applying the Wiener–Khinchin theorem to find an exponentially decaying power spectral density and an auto-correlation function indicating memory-loss, supporting the Markovian property.
  • For Gaussianity, one participant describes comparing the empirical distribution function to an ideal Gaussian CDF, noting a strong overlap.
  • There is a request for advice on estimating uncertainty in statistical conclusions, with a mention of statistical hypothesis testing as a potential method.

Areas of Agreement / Disagreement

Participants generally agree on the properties that characterize the OU process and the methods to confirm them, but there is no consensus on the best approach for estimating uncertainty in statistical properties.

Contextual Notes

Some limitations include the dependence on the number of processes generated and the choice of time series length for analysis, which may affect the robustness of the conclusions drawn about the properties of the OU process.

Who May Find This Useful

Researchers and students interested in stochastic processes, numerical simulations, and statistical analysis in the context of physics and engineering may find this discussion relevant.

mhsd91
Messages
22
Reaction score
4
Basically, The Ornstein-Uhlenbeck (OU) process (and its time-integral) decribes the velocity of a brownian particle. The OU process is Stationary (in time), Stochastic AND Markovian.

Now, I've done an exact, one dimensional, numerical simulation of the OU process similar to D. T. Gillespie in his article: Phys. Rev. E 54, 2084 (Aug. 1996) titled: Exact numerical simulation of the Ornstein-Uhlenbeck process and its integral

The thing is, I was reading the "Correlation Function"-article on Wikipedia which stated, and I quote:

"(...), the study of correlation functions is similar to the study of probability distributions. Many stochastic processes can be completely characterized by their correlation functions; the most notable example is the class of Gaussian processes."

I wonder if the OU process is completely characterized by it's correlation functions, and if so, how do we derive them AND show this; assuming we have Empirical/Numerical data of the process?

Any help, tips or constructive advice is most appriciated.
 
Physics news on Phys.org
Having giving the problem another look, I'm now able to specify the problem a little:

A OU process is characterized by beein the only non-trivial process having all of the three properties,
  • Gaussian
  • Stationary (in time)
  • Markovian

Then showing and confirming these for my numerical data should prove the simulation to be an OU process. Now, I'd like any help anyone may offer on how to deduce these properties from numerical/experimental data.

Thanks!
 
I am not sure I can give you a completely satisfactory answer to your question. If you have can generate several (hopefully hundreds or thousands or more) processes and want to examine if the processes are Gaussian, generate a large number of processes, select a value for the time (number n for the time series of the process, n should not be too small (first or second number but maybe 50)), histogram the value at that number for each process. Does the result look Gaussian. For a quantitative examination, refer to algorithms such as Kolmogorov, Smirnov, or other methods to come up with a metric as to whether density, or distribution functions agree.

As far as stationary and Markovian. Determine the power spectral density for your process. (MATLAB, (xcov) or Fortran). For a first order Markov process, the power spectral density should be an exponential function. For a 2nd order Markov process, it should be a damped sine function (or so.). I have done this many times and I can try to provide further help if needed. These are just ideas. (I am somewhat familiar with Gillespie's article), but I have my own methods for generating these processes.
 
  • Like
Likes   Reactions: 1 person
Hi and thanks for the replay! I forgot to update this as I figured it out. I hope that it may be of help to anyone who's also struggling with this.

I did just as you say to prove the Markovian and stationary property. Concerning stationarity, I applied the Wiener–Khinchin theorem, found the power spectral density which decayed exponentially and flattened out. I also calculated the auto-correlation function which suggested memory-loss (hence, the data being Markovian).

For the Gaussian property, I calculated the empirical distribution function (EDF) and plotted against an ideal Gaussian's cumulative distribution function (CDF) with same mean and variance as the data had. They overlapped impressively well!

Now, I'm really grateful of the answer as it kind of confirms I did something right. To end this, do you have any short comments on how to estimate the uncertainty in concluding statistical properties of empirical data (in general)? I mean, is it most common to conduct a "Statistical hypothesis test", or is it some other more powerful method?

Again, thank you so much!:)
 
Excellent! Although I was late in replying, I am relieved to see I was on the right track.
 
I do not have any quick answers to your last question. For example, I do not see many papers that outline how they determine error bars on their power spectral densities. I know some of my colleagues have taken time series analysis courses.
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 31 ·
2
Replies
31
Views
4K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 4 ·
Replies
4
Views
5K
  • · Replies 75 ·
3
Replies
75
Views
12K
  • · Replies 13 ·
Replies
13
Views
4K
  • · Replies 1 ·
Replies
1
Views
3K
Replies
29
Views
5K