What is Correlation: Definition and 367 Discussions

In statistics, correlation or dependence is any statistical relationship, whether causal or not, between two random variables or bivariate data. In the broadest sense correlation is any statistical association, though it commonly refers to the degree to which a pair of variables are linearly related.
Familiar examples of dependent phenomena include the correlation between the height of parents and their offspring, and the correlation between the price of a good and the quantity the consumers are willing to purchase, as it is depicted in the so-called demand curve.
Correlations are useful because they can indicate a predictive relationship that can be exploited in practice. For example, an electrical utility may produce less power on a mild day based on the correlation between electricity demand and weather. In this example, there is a causal relationship, because extreme weather causes people to use more electricity for heating or cooling. However, in general, the presence of a correlation is not sufficient to infer the presence of a causal relationship (i.e., correlation does not imply causation).
Formally, random variables are dependent if they do not satisfy a mathematical property of probabilistic independence. In informal parlance, correlation is synonymous with dependence. However, when used in a technical sense, correlation refers to any of several specific types of mathematical operations between the tested variables and their respective expected values. Essentially, correlation is the measure of how two or more variables are related to one another. There are several correlation coefficients, often denoted



ρ


{\displaystyle \rho }
or



r


{\displaystyle r}
, measuring the degree of correlation. The most common of these is the Pearson correlation coefficient, which is sensitive only to a linear relationship between two variables (which may be present even when one variable is a nonlinear function of the other). Other correlation coefficients – such as Spearman's rank correlation – have been developed to be more robust than Pearson's, that is, more sensitive to nonlinear relationships. Mutual information can also be applied to measure dependence between two variables.

View More On Wikipedia.org
  1. P

    Calculate cross correlation manually

    I want to know how one might calculate the cross correlation of two signals by hand. I know that there are a myriad of software applications that will do this for me but I want to understand how it is done by hand. I'm using the expression: ccxy[k] = ∑ x[n]. y[n+k] I'm just not too sure what the...
  2. X

    Correlation between problem solving skills and being able to derive theories.

    From my understanding the job of a theoretical physicist is to derive theories to explain phenomena in nature. But let's say you aren't the best problem solver in the world. You are good enough in your physics class to get the 3.5 GPA but you are never able to solve those extra credit problems...
  3. W

    Variance-covariance matrix and correlation matrix for estimated parameters

    Hi all, I would like some help understand the covariance and correlation matrix as it pertains to estimated parameters. I am performing logistic regression with just one independent variable and a constant term. I am wondering if someone can help me understand the information these...
  4. P

    Correlation and convolution (function or number)

    Hy. I have a problem about correlation depending whether it it observed as a measurement of linear fit of statistical data, and when observed as a relationship between two continuous functions. Is a result of correlation a coefficient (Pearson's product-moment coefficient) or a function...
  5. W

    What implies correlation?

    If I have three scalar random variables: a, b and c, which are each zero-mean and have some nonzero variances, and I know: 1) The correlation between a and b is nonzero. 2) The correlation between b and c is nonzero. Does this imply that the correlation between a and c is nonzero? I...
  6. S

    Calculating the Correlation Between Bert and Ernie's Wave Ride Times

    The Correlation.. !?? Homework Statement Bert and Ernie are trying to impress Lady Moneypenny with their surfing skills. Bert’s wave ride times are normally distributed with a mean of 15 seconds and a standard deviation of three seconds. Ernie spends more time drinking rather than...
  7. R

    Multiple variable correlation - drowning in stats formulas,

    Hello everyone, My boss has asked me to find if there is any correlation between various sample parameters in a water quality study. We took around 150 samples, and for each one measured around 50 parameters e.g. iron content, free residual chlorine, level of coliforms, pH, etc etc. I...
  8. M

    Two point correlation function

    Hi I have two images and I want to compare the "structures" of them at different scales. I remember from cosmology that the two point correlation function was used to extract similar structural information from the CMB, generating a graph of structure Vs scale. Then at certain length scales you...
  9. V

    Determinant of auto correlation matrix

    Hello everyone, I have a question.. if I have a data stream X=some thousand random numbers with mean close to 0 and standard deviation close to 1 and then I construct my autocorrelation matrix from these numbers Q=|R_xx{0} R_xx{1}...R_xx{L}| | R_xx{1} R_xx{0} ...R_xx{L-1}|...
  10. Loren Booda

    Can Predicting News a Week in Advance Change Journalism?

    Try predicting the news a week ahead of time! Just cite a source for the current state of the news and make a significant prophecy about it -- physical, informational, sporting, political, academic, etc. Just place this "gentleman's bet" here, a week before the augured event. It's you...
  11. L

    Does Bell's theorem imply stronger or weaker correlation?

    After reading so many threads here about it, I thought I would take a closer look at Bell's theorem. Consider the simple proof presented http://quantumtantra.com/bell2.html" , which I'll summarize below: A light source produces twin state photons, and each photon of the pair goes through a...
  12. S

    Optimal Filter Coefficients: Correlation versus Least Squares

    I found a claim in a paper (BSSA, Vol 81, No. 6: "A Waveform Correlation Method for Identifying Quarry Explosions", By D.B. Harris) concerning finding filter coefficients. The statement is given without proof. I cannot locate a reference or theorem for the following, and have not been able thus...
  13. N

    Why correlation function decay as power law at critical temperature point?

    Please teach me this: In QTF theory of Schroeder,chapter 13.1 saying: Just at t=0(t=\frac{T-T_{c}}{T_{c}}),the correlation should decay as power law. Define the exponent \eta by the formula: G(x)=\frac{1}{x^{d-2+\eta}} where d is Euclidien space dimension. I do not understand why at...
  14. E

    Correlation of Complex Random Variables

    Hi, Why there is a half factor in the definition of the correlation of complex random variables, like: \phi_{zz}(\tau)=\frac{1}{2}\mathbf{E}\left[z^*(t+\tau)z(t)\right]? Thanks in advance
  15. C

    Cross Correlation Functions: Advanced Applications & Conclusions

    Hi. Can somebody recommend a good book (advanced level) dealing with applications of cross correlation functions? I mean what kind of conclusions can be drawn etc?
  16. C

    Statistics, multiple choice, correlation coefficient

    Homework Statement The correlation coefficient for each of two data sets is calculated. Set A has r = -0.75 while Set B has r = +0.55. Which set (A or B) has the stronger strength of relationship? Homework Equations I think -0.75? The Attempt at a Solution I think Set A r =...
  17. Demystifier

    Nonlocality: correlation vs causation

    It is often said that QM is not truly nonlocal, because the "only" thing which is nonlocal are the correlations; there is no true nonlocal causation involved. At the same time, the Bohmian interpretation is accused for being "too" nonlocal, by involving a true nonlocal causation. But what...
  18. IllyaKuryakin

    Instant Correlation vs. Instant Communication: Exploring the Difference

    I’ve seen much confusion here concerning the difference between instant correlation at a distance and instant “communication”, or transfer of information at a distance, and a simple thought experiment can clarify the difference. In Experiment A, we stick two coins together, one heads up and...
  19. N

    Why connected correlation function depends on (x-y) only when <Phi(x)> equal constant

    Please teach me this: Why the connected correlation functions depend on the x-y(the difference of two space-time coordinates of two points) only in case the expectation of field(<phi(x)>) is constant(the translation invariance of vacuum state). Thank you very much in advanced.
  20. S

    Find Correlation Length of Auto-Correlation

    How can I find the correlation length of an auto-correlation? Is it the distance to the first zero of the auto-correlation? Is it the distance to the first min. of the auto-correlation? Is it the distance to the first max. of the auto-correlation? or should I integrate? Thank you
  21. S

    Do we need a coincidence counter (for correlation) in delayed erasure?

    Do we need a coincidence counter (for correlation) in delayed erasure?...in case of repeating the same experiment many times (with one photon at a time) the same way In the DCQE experiment such as the one listed below http://grad.physics.sunysb.edu/~amarch/ Notice the polarizer...
  22. L

    Proving Lorentz Invariance of Correlation Functions

    So we have the definition of the correlation (or Green's) function as G^{(n)}(x_1, \dots , x_n) = \langle \Omega | \phi(x_1) \dots \phi(x_n) | \Omega \rangle Now I need to show that they are Lorentz invariant i.e. that G^{(n)}(x_1',\dots,x_n')=G^{(n)}(x_1, \dots , x_n) However, we know...
  23. M

    Learn Exponentially Correlated Random Functions

    hi, i want to learn about exponentially correlated random functions. can some one help me with some ideas or links or books. thanks in advance.
  24. B

    Understanding 2nd Order Correlation in Fock States and Density Functions

    Hi all, I read on some paper that for a system of Fock state |...nk...>, and with the field operator expanded as \Psi(r)=\sumak \phik(r), the second order density correlation function can be expressed as G(2)=<\Psi+(r)\Psi+(r')\Psi(r')\Psi(r)>=<n(r)><n(r')>+|<\Psi(r)+\Psi(r')>|2-\sum^{N}_{k}...
  25. N

    Why 2-point correlation function diagram have only two external legs?

    Please teach me this: Why 2-point correlation function diagrams have only two external lines.Because of Wick theorem they would have many external legs. Another thing is whether are there odd number point correlation functions(meaning they are different from 0). Thank you very much in advanced.
  26. T

    Fourier transform of the auto correlation function to get energy

    Homework Statement The Fourier transform of the auto correlation function is the energy spectral density (ESD) of a signal. Here is the "apparent" proof: \int e^{-jwT} [ \int g(t)g(t+T)dt] dT => \int g(t)[ \int g(T+t)e^{-jwT}dT] dt What happened here? Why did the second integral change from...
  27. R

    Interpreting Correlation Functions: (1) vs (2)

    Should one view correlation functions as: (1) \; \langle T{\phi(x)\phi(y)}\rangle or (2) \; \langle T{\phi(x)\phi(y)}\rangle - \langle \phi(x)\rangle \langle\phi(y)}\rangle with the second term being zero? (2) makes more sense as it really measures whether the two fields are...
  28. S

    Coupled differential equations with convolution and correlation

    Homework Statement I have two equations: \frac{\partial}{\partial z}E_{L}\left(z,\omega \right) = i \frac{2 \mu d_{eff}(\omega+\omega_{0})^{2}}{k(\omega+\omega_{0})}\int E_{L}(z,\omega-\omega_{T})E_{T}(z,\omega_{T})d\omega_{T} \frac{\partial}{\partial z}E_{T}\left(z,\omega_{T} \right) = i...
  29. M

    Correlation Function for a 2-D field

    I have a 2-dimensional field of values (they are actually heights of a surface) and I want to compute a correlation function or some sort of correlation parameter. I have seen something similar done with galaxies and you end up with something like the probability of finding a galaxy at a...
  30. W

    Measuring Effect Size in Regression: Partial R2, Partial Correlation

    Hi all, I have run a few linear regression models predicting water quality for watersheds using explanatory variables such as mean impervious surface within watersheds and others suggested by theory and the research of others. I would like to be able to compare explanatory variables measured...
  31. 1

    Realspace and redshift space correlation function questions

    why is the redshift space correlation function smaller than the realspace correlation function at small scales and the opposite on large scales?
  32. C

    [Matlab] Correlation function for henon map

    Hi! I need to write MATLAB script, which will be plotting corretation function for two-dimmensial system. Henon map is not my system, but is very popular, so solusion for henon map can be very helpful for me. Have anybody know code for have plot like this...
  33. P

    Correlation between a car's horsepower and maximum strength of Cable

    Science quiz question: How to determine the correlation between a car’s horsepower / torque and the maximum break strength of a cable that will hold the motor stationery. Assuming that the wheels of a car do not spin, how can I determine what the required cable’s break strength needs to be...
  34. T

    Correlation between electronic band structure of an atomic species

    Hii, I was wondering whether there is any correlation between the energy eigenvalues of a single atom (say He) with the electronic band structure of a collection of He atoms. for example, for He atoms the lowest energy would be the ground state, with 2 electrons. So will the lowest band for a...
  35. R

    Correlation test for model outputs

    Hello all, I am currently building a model in Excel for predicting domestic water demand on a daily basis. The daily model will be compared to a more accurate model which runs on timesteps of 5 minutes (the latter is data intensive however which is why we are building a daily model as it...
  36. B

    Using Correlation :Random Variables as a Normed Space (Banach, Hilbert maybe.?)

    Hi, everyone: I have been curious for a while about the similarity between the correlation function and an inner-product: Both take a pair of objects and spit out a number between -1 and 1, so it seems we could define a notion of orthogonality in a space of random variables, so...
  37. A

    How to Calculate Second Order Correlation from Master Equation?

    Hi, I have a problem in calculating the second order correlation (coherence) from the master equation for the operators \sigma and a a[+][/SUP] , because I don't know if <aa^{+}a^{+}a> can be factorized to<a><n><a>. I want to do this calculation directly from the density matrix solution. thanks
  38. S

    Sample Correlation Coefficient Proof Help

    I'm trying to prove that abs(r) <= 1. (Ill apologize up front that I am not sure on how to write all equations properly in this forum, but Ill try to make it clear) Note that this is all sample statistics, not population, which is why I'm using r and not rho. I know that I have to use...
  39. K

    Electron Correlation in Molecular Systems: Meaning & Types

    I wonder, what the physical meaning to electron correlation in molecular systems? and. Is there many types of it? Thanks for interest colleagues
  40. T

    Velocity correlation functions

    Hi, I am going through Non Equilibrium Statistical Mechanics by Zwanzig and I can't follow, the step below: I have the equation: <x^{2}> = \int^{t}_{0}ds_{1}\int^{t}_{0}ds_{2}<v(s_{1})v(s_{2})> I can't show that: \frac{\partial <x^{2}>}{\partial t} = 2 \int^{t}_{0}ds<v(s)v(t)>...
  41. P

    Q correlation coefficient (diagrams from textbook provided)

    The thing I don't understand is how does finding out the median help you drawing in the horizontal and vertical lines. How do you know if it's going to pass through a few of the data points? Like in the example on that website it has a moderate negative correlation and the median is the 8'th...
  42. B

    When is it inappropriate to report Pearson correlation coefficients?

    I am writing a paper publishing scientific data. My background is chemistry but I have taken a couple of stat classes. In my opinion, one of the biggest deficiencies in modern research publications is the improper use of statistics. I hope to avoid making this mistake, but I need your help...
  43. F

    What is the correlation between IQ and success?

    So there was a thread: https://www.physicsforums.com/showthread.php?p=2847138#post2847138 about IQ and being successful that I think is an interesting topic and is worthy of discussion so I thought I'd start a new thread here. The reason for doing so is that I was recently reading Malcolm...
  44. P

    Cross correlation in two data sets of the same sample population

    I have the following problem: Suppose there is a survey of persons with two properties each (a and b). a can take a relatively small number of values (say the political inclination: Conservative, Liberal, Socialist, or Other) the other one b can take a large number of values (say: the country...
  45. D

    Higher Point CFT Correlation Functions

    Hi, Does anyone know if there's a closed formula for the n-point function in a CFT? Up to anharmonic ratios, of course. Most books just have it up until n=4. Thanks, Matt
  46. B

    Linear regression and high correlation problems

    Hi guys, I have data of 20 peoples height, weight, calorie intake and skinfold thickness. I have carried out a regression of calorie on height, on weight and on height and weight. I have done the same thing for skinfold thickness. I then used R to work out the summary of results. each...
  47. T

    Correlation between School Reputation and Age

    I've been looking at some of the more prestigious graduate programs in physics and I've noticed in photographs that all of the grad students look very young. On the Princeton website, I couldn't spot one that looked over 25. Is it fair to say that more prestigious institutions tend to avoid...
  48. Z

    P-Value for Correlation Comparison: Using SAS/SPSS

    Say I have 2 separate predictor variables x and y. And the response variable is z. The correlation between x and z is a; the correlation between y and z is b. How to get the p-value for a = b? By using SAS or SPSS. I believe we should use t-test. Because the correlation analysis for...
  49. P

    Computing Correlation Dimension of Attractor | Hi, Explain?

    Hi, I read that the dimension of an attractor is not necessarily an integer. I then tried to compute the dimension of the attractor defined by the system I’m studying but I found two definitions for the dimension: -The capacity dimension; -The...
  50. W

    Correlation functions vs. Scattering Amplitude

    Hi there, I am learning the basics of QFT at the moment. Could someone explain to me, in the case for any number of scalar fields, the difference between correlation functions and scattering amplitudes please? Correlation functions <0|T(\phi_{1}...\phi{n})|0> Does one always write the...
Back
Top