Correlation, linear or curvilinear

Click For Summary
SUMMARY

The discussion focuses on the differences between linear and curvilinear correlations, specifically addressing the Pearson and Spearman correlation coefficients. The Pearson coefficient is effective for linear relationships, while the Spearman coefficient is distribution-free and suitable for non-linear relationships. The conversation also highlights the autocorrelation function in time series analysis, which measures the correlation between a variable and its past values, specifically through the product of f(t) and f(t+tau). The necessity of using only two time instants in this context is questioned, with implications regarding Gaussianity assumptions in time series data.

PREREQUISITES
  • Understanding of Pearson correlation coefficient
  • Familiarity with Spearman's rank correlation coefficient
  • Knowledge of autocorrelation functions in time series analysis
  • Basic concepts of Gaussian distribution in statistics
NEXT STEPS
  • Research the mathematical formulation of the autocorrelation function in time series analysis
  • Learn about the implications of Gaussianity in time series data
  • Explore advanced correlation techniques for non-linear relationships
  • Study the differences between lagged variables and their impact on correlation analysis
USEFUL FOR

Statisticians, data analysts, and researchers involved in time series analysis and correlation studies will benefit from this discussion.

fisico30
Messages
362
Reaction score
0
correlation, linear or curvilinear...

Hello Forum,

usually the Pearson coefficient is meaninful to find the linear relationship between two variables. What if the relationship is not linear? How about quadratic? I heard of the Spearman’s rank correlation coefficient, which does not depend upon the assumptions of various underlying distributions. This means that Spearman’s rank correlation coefficient is distribution free. This method seems so first need the data to be ordered from small to large.

However, I am dealing with time series. Data, I guess cannot really be ordered, since we want to compare values a specific instants of time.
In textbooks, I usually find autocorrelation function as a function of lag tau. It is computed as the integral of the product of f(t) and f(t+tau), all divide by T->very large, where T is the interval of observation.
What type of correlation does this method give? Does it measure a linear correlation or any type of correlation?
Why does it take only the product between f(t) and f(t) at another time instant, instead of f(t1), f(t2) and f(t3), i.e. at three instant of time? Or at four instants...?
I think there is some Gaussianity assumption on the time series going on here...but I still can't understand the reason for just two time instants...
I am dealing with time series. In textbooks, I usually find the autocorrelation as a function of lag tau. It is computed as the integral of the product of f(t) and f(t+tau), all divide by T->very large, where T is the interval of observation.
What type of correlation does this method give? Does it measure a linear correlation or any type of correlation?
Why does it take only the product between f(t) and f(t) at another time instant, instead of f(t1), f(t2) and f(t3), i.e. at three instant of time? Or at four instants...?
I think there is some Gaussianity assumption on the time series going on here...but I still can't understand the reason for just two time instants...

thanks
fisico30
 
Physics news on Phys.org


fisico30 said:
Hello Forum,

usually the Pearson coefficient is meaninful to find the linear relationship between two variables. What if the relationship is not linear? How about quadratic? I heard of the Spearman’s rank correlation coefficient, which does not depend upon the assumptions of various underlying distributions. This means that Spearman’s rank correlation coefficient is distribution free. This method seems so first need the data to be ordered from small to large.

However, I am dealing with time series. Data, I guess cannot really be ordered, since we want to compare values a specific instants of time.
In textbooks, I usually find autocorrelation function as a function of lag tau. It is computed as the integral of the product of f(t) and f(t+tau), all divide by T->very large, where T is the interval of observation.
What type of correlation does this method give? Does it measure a linear correlation or any type of correlation?
Why does it take only the product between f(t) and f(t) at another time instant, instead of f(t1), f(t2) and f(t3), i.e. at three instant of time? Or at four instants...?
I think there is some Gaussianity assumption on the time series going on here...but I still can't understand the reason for just two time instants...
I am dealing with time series. In textbooks, I usually find the autocorrelation as a function of lag tau. It is computed as the integral of the product of f(t) and f(t+tau), all divide by T->very large, where T is the interval of observation.
What type of correlation does this method give? Does it measure a linear correlation or any type of correlation?
Why does it take only the product between f(t) and f(t) at another time instant, instead of f(t1), f(t2) and f(t3), i.e. at three instant of time? Or at four instants...?
I think there is some Gaussianity assumption on the time series going on here...but I still can't understand the reason for just two time instants...

thanks
fisico30

Your questions are a little vague but as far as time series analysis goes one tries to estimate the influence of past variables on current variables. If the sampling distributions are normally distributed then the auto-correlation function measures the influence of the past variables on the present. However a single lag will not give you a clear answer. You must simultaneously measure all of the lags to get independent estimates of their individual influence.
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 30 ·
2
Replies
30
Views
5K
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 21 ·
Replies
21
Views
4K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 5 ·
Replies
5
Views
5K
  • · Replies 1 ·
Replies
1
Views
1K
Replies
1
Views
2K