How to measure the time dependent correlation of two signals

Click For Summary

Discussion Overview

The discussion revolves around measuring the time-dependent correlation between two signals represented as time series. Participants explore methods to quantify how the correlation between the signals changes over time, particularly in relation to specific peaks in the data.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested

Main Points Raised

  • One participant notes that while the two signals appear correlated, correlation does not imply identical behavior, suggesting a model with constant correlation and noise could suffice.
  • Another participant proposes using a system of stochastic differential equations (DEs) to model the time-varying correlation, specifically mentioning an Ornstein-Uhlenbeck process, but acknowledges the complexity and potential instability of such a model.
  • A participant expresses concern that the proposed approach may involve changing the model entirely rather than simply addressing time-varying correlation, questioning the validity of conclusions drawn from such a method.
  • One participant suggests using a peak-finding algorithm to identify peaks in the blue curve and then correlating those with corresponding intervals in the red curve to assess the relationship between peaks.

Areas of Agreement / Disagreement

Participants do not reach a consensus on the best method to measure time-dependent correlation, with multiple competing approaches and models being proposed. There is also disagreement on the implications of changing models over time.

Contextual Notes

Participants express uncertainty regarding the calibration and stability of proposed models, as well as the assumptions underlying the correlation measurements. The discussion highlights the complexity of accurately capturing time-varying relationships between the signals.

vibe3
Messages
39
Reaction score
1
I have two signals (time series) shown in the plot below. Just by looking at the figure, we can see that the two main peaks of both signals are very closely aligned (correlated), however the red signal has additional features elsewhere which don't match the blue curve.

I am looking for some function which can tell me how correlated these two signals are at a given time. IE: at t = -18 and t = +10 where the peaks are located, the correlation should be very close to -1, while at t = -40, the correlation is probably close to 0.

Specifically, I want a robust way to tell that if I see a peak in the blue curve, then there is a corresponding (negative) peak in the red curve.

I've looked into cross correlation (https://en.wikipedia.org/wiki/Cross-correlation), however this seems suitable for time series which simply have a constant time lag with respect to each other. In my problem the correlation between my two signals is changing with time. I've thought about dividing up the signal into small bins and computing the correlation of each bin, but I was hoping there is a better way.

gMCDu.png
 
Physics news on Phys.org
They look pretty correlated to me. Note that correlation does not mean identical. From the graphs it appears that you could model the relationship perfectly well with a constant correlation and a noise term.

If you want a model with a time-varying correlation you could use a system of three stochastic DEs, one for the first time series, one for the second, which contains a correlation term to the first, and one for the randomly time-varying correlation which could for instance be an Ito process with mean-reversion to an equilibrium of zero (Ornstein-Uhlenbeck process). But it would be complicated to calibrate, and not necessarily stable.
 
andrewkirk said:
They look pretty correlated to me. Note that correlation does not mean identical. From the graphs it appears that you could model the relationship perfectly well with a constant correlation and a noise term.

If you want a model with a time-varying correlation you could use a system of three stochastic DEs, one for the first time series, one for the second, which contains a correlation term to the first, and one for the randomly time-varying correlation which could for instance be an Ito process with mean-reversion to an equilibrium of zero (Ornstein-Uhlenbeck process). But it would be complicated to calibrate, and not necessarily stable.

Yes that is a nice example which has a good correlation. However, I have lots of examples where there is no corresponding peak in the red curve. Or sometimes there is 2 peaks in the blue curve but only 1 peak in the red curve. This is why I need a time-varying correlation.

My current thinking is to use a peak-finding algorithm to find the 2 peaks in the blue curve. Then isolate the same time intervals in the red curve and use a normal correlation on just the region near the peak. This way I can detect if both peaks are correlated, or just 1 peak, or 0 peaks
 
It sounds like you are trying to change the model completely from on time to another, not just get a "time changing correlation". That is fine if you have a logical reason to propose different models at different times. Otherwise, you may not have a valid basis for your conclusions.
 

Similar threads

  • · Replies 10 ·
Replies
10
Views
4K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 4 ·
Replies
4
Views
6K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 10 ·
Replies
10
Views
4K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K