What is Correlation: Definition and 367 Discussions

In statistics, correlation or dependence is any statistical relationship, whether causal or not, between two random variables or bivariate data. In the broadest sense correlation is any statistical association, though it commonly refers to the degree to which a pair of variables are linearly related.
Familiar examples of dependent phenomena include the correlation between the height of parents and their offspring, and the correlation between the price of a good and the quantity the consumers are willing to purchase, as it is depicted in the so-called demand curve.
Correlations are useful because they can indicate a predictive relationship that can be exploited in practice. For example, an electrical utility may produce less power on a mild day based on the correlation between electricity demand and weather. In this example, there is a causal relationship, because extreme weather causes people to use more electricity for heating or cooling. However, in general, the presence of a correlation is not sufficient to infer the presence of a causal relationship (i.e., correlation does not imply causation).
Formally, random variables are dependent if they do not satisfy a mathematical property of probabilistic independence. In informal parlance, correlation is synonymous with dependence. However, when used in a technical sense, correlation refers to any of several specific types of mathematical operations between the tested variables and their respective expected values. Essentially, correlation is the measure of how two or more variables are related to one another. There are several correlation coefficients, often denoted



ρ


{\displaystyle \rho }
or



r


{\displaystyle r}
, measuring the degree of correlation. The most common of these is the Pearson correlation coefficient, which is sensitive only to a linear relationship between two variables (which may be present even when one variable is a nonlinear function of the other). Other correlation coefficients – such as Spearman's rank correlation – have been developed to be more robust than Pearson's, that is, more sensitive to nonlinear relationships. Mutual information can also be applied to measure dependence between two variables.

View More On Wikipedia.org
  1. F

    I Correlation functions and correlation length

    I thought I understood the concept of a correlation function, but I having some doubts. What exactly does a correlation function quantify and furthermore, what is a correlation length. As far as I understand, a correlation between two variables ##X## and ##Y## quantifies how much the two...
  2. S

    A Why can the ##1##-point correlation function be made to vanish?

    The ##1##-point correlation function in any theory, free or interacting, can be made to vanish by a suitable rescaling of the field ##\phi##. I would like to understand this statement. With the above goal in mind, consider the following theory: $$\mathcal{L} =...
  3. S

    A Correlation functions in an interacting theory

    Given the theory $$\mathcal{L}=\frac{1}{2}(\partial_{\mu}\phi)^{2}-\frac{1}{2}m_{\phi}^{2}\phi^{2}+\partial_{\mu}\chi^{*}\partial^{\mu}\chi-m_{\chi}^{2}\chi^{*}\chi+\mathcal{L}_{\text{int}},\qquad \mathcal{L}_{\text{int}}=-g\phi\chi^{*}\chi,$$ the time-correlation function ##\langle \Omega |...
  4. Mentz114

    I Correlation Limits without Probability

    I'm reposting this piece of logic because my earlier attempts to get it across failed - nobody got what I was saying. This is about binary sequences like ##010110100111001001...##. All we need to know about a particular sequence is its length, ##N## and the number of 1's it contains. The logic...
  5. S

    A Correlation functions in position and momentum space

    What is the relation between the correlators ##\langle 0 | T\phi(x_{1})\phi(x_{2}) | 0 \rangle## and ##\langle 0 | T\phi(p)\phi(x=0) | 0 \rangle##? I can derive the momentum space Feynman rules for ##\langle 0 | T\phi(x_{1})\phi(x_{2}) | 0 \rangle##. Are the momentum space Feynman rules for...
  6. entropy1

    I The mechanism of entangled particles

    First let me ask this: Consider a pair of entangled photons fired at a respective detector after passing respective polarisation filters. If a photon passes a polarisation filter, is it in a superposition of having passed and not having passed? Is the measuring device (that detects the...
  7. F

    A Physical interpretation of correlator

    Consider the 2-point correlator of a real scalar field ##\hat{\phi}(t,\mathbf{x})##, $$\langle\hat{\phi}(t,\mathbf{x})\hat{\phi}(t,\mathbf{y})\rangle$$ How does one interpret this quantity physically? Is it quantifying the probability amplitude for a particle to be created at space-time point...
  8. entropy1

    B Pseudorandomness of correlation

    Suppose we have a source of polarization-entangled photons, that fires pairs of photons in opposite directions at two detectors with orientation-adjustable polarizationfilters in front of them. Obviously, there is a correlation between the orientation of the respective filters and the joint...
  9. T

    A Qn on photon statistics (second order correlation function)

    I am trying to better understand the concept of second order coherence G2(τ) (in particular G2(0)) and a few questions have arisen. Note that I am trying to get a physical idea of what is happening so I would appreciate it if your responses can keep the math to the minimum possible. :) How do...
  10. entropy1

    B Counterfactual definiteness and correlation

    If we assume there is no counterfactual definiteness, would that mean that measurements on entangled particles needn't be correlated, for if you don't compare the results, you just don't know if they do?
  11. V

    A Integrate data plot, combine errors including correlation

    Hello I have a set of data points, with errors (X1 , Y1 +- deltaY1) , (X2 , Y2 +-deltaY2) etc I have the covariance matrix for these bins I want to integrate this set of data points: SUM_i ( Y_i * X_binWidth_i ) How do I combine the errors, taking into consideretation the...
  12. entropy1

    I Macro state of a measurement device and correlation

    I have a question that seems to reflect my main concern with QM. Here it is: Consider a series of polarisation-entangled photon pairs that are sent in opposite direction to two measuring devices (e.g. at opposite ends of the universe). The measurement consists of detection of a photon after...
  13. entropy1

    I Is there a 'memory-effect' of measuring devices?

    If I'm correct, a series of with respect to some property entangled particles exhibits a correlation between several measurements of that property by means of two measuring devices. My question is: is it possible that between measurements the physical constitutions of the measuring devices...
  14. entropy1

    B Equivalence of entanglement and decoherence?

    Just taking an advance in what I want to learn someday: I understand that decoherence and entanglement are more or less equivalent. So, I take it decoherence is in principle a process of entanglement. Consider two particles A and B who are entangled. if A decoheres by interacting with particle...
  15. entropy1

    B Entanglement, correlation and randomness

    I was wondering. In this example I use polarized photons, but maybe it is applicable to electrons and spin also. We can prepare two completely unentangled polarized photons, and send them in opposite directions to two detectors preceded by a filter at particular angles. Both of them will show a...
  16. A

    MHB Correlation and Regression

    I just need a little assistance on the last two questions. I place per capita and death in L1 and L2 but I am lost. Country Per Capita Cigarette Consumption 3900...
  17. H

    Correlation between macronutirients and radionuclides

    do the presence of macronutrients (N,P,K) increase the amount of radionuclides (U,Th,K) in the sediments. how are they related?
  18. K

    A Time correlation of an observable in the Schrödinger picture

    This has come up in a number of threads, so I made this thread to talk about it. I think that an interpretation of this in the Schrödinger picture should be possible at least in the style of Feynman. This would go something like this. ##\begin{eqnarray*} \langle A(s)A(t)\rangle_\psi &=&...
  19. Mentz114

    Correlation limits for binary variates

    I've been looking at detector coincidences and tried to find what general limits apply to coincidences. I was surprised how simply the calculation works out. My question is whether it is correct and where can I find similar stuff ? Consider two binary sequences produced by random processes...
  20. schrodingerscat11

    Why is there a need for correlation hole?

    I have been reading about the physical meaning of exchange-correlation hole and this is what I have found so far: Exchange hole - attributed to the spin of the electrons. Electrons of same spin will not occupy the same orbital because of Pauli Exclusion Principle. This leads to the lowering of...
  21. D

    MHB Funding a correlation for F(x,y,z)=v

    Hello guys, I am investing the effect of three parameters on a process and I need to come up with a correlation connecting these three correlations together. I have the experimental results for f(x,0,0), f(x,y,0) and f(x,y,z). I tried to do 3d interpolation with Matlab but since the change is...
  22. S

    Time varying correlation: suggestion

    Hi, I made some measurements in a vehicle and I have one output signal (i.e. force in a vehicle component) and many input signals which few are digital (discrete only 2 values are possible) and others are anolog (continuous variables).Here you can see the output signal and two of the many...
  23. Tone L

    MATLAB Calculate Correlation Coefficient of X & Y - MATLAB

    Hello I have to variables X and Y, 50,000 in each row (a time series of 2 years). I am curious how to calculate a linear correlation between the two, for example if X decreases does Y increase or decrease. Looking for formula or a MATLAB function :)
  24. S

    Pairwise correlation of signals

    Hi all, On a vehicle I recorded an output signal that is positive and it's variability is lead to the 30 input signals, but not all together at the same insant. Just by checking the pairwise correlation between signals in a time periond, I'm able to detect which input signals lead to the...
  25. edguy99

    Long-distance correlation, information, and faster-than-light interaction

    [Mentor's note: Split off from https://www.physicsforums.com/threads/an-abstract-long-distance-correlation-experiment.852684/page-6 because this subthread was discussing possible mechanisms behind the phenomenon] My take on these: 1) - not weird at all - you send a photon in one direction...
  26. A. Neumaier

    An abstract long-distance correlation experiment

    Inspired by stevendaryl's description of an EPR-like setting that doesn't refer to a particle concept, I want to discuss in this thread a generalized form of his setting that features a class of long-distance correlation experiments but abstracts from all distracting elements of reality and from...
  27. askhetan

    Many body wavefunction and exchange correlation

    Everywhere I ready about HF or DFT the term exchange correlation functional comes up. I have a couple of fundamental questions about these: 1) Books say that the correlation energy is the difference between the exact energy (lets say we've found that somehow) and the hartree-fock energy and...
  28. AwesomeTrains

    Mean, variance and correlation - Multinomial distribution

    Hello everyone, I'm stuck at a elementary stochastic problem. I have to calculate means, variance and co-variance for two random variables. Homework Statement Let r,g,b∈ℕ. r red, g green and b black balls are placed in an urn. The balls are then drawn one at a time with replacement, until a...
  29. C

    Correlation between orbit eccentricity and mechanical energy

    Homework Statement I have been tasked with showing "how the mechanical energy of a planet determines the shape of its orbit", and I cannot for the life of me make sense of it. I've run into a formula, see below, but I'm not sure how to interpret it nor if it even applies in my case at all (as E...
  30. 24forChromium

    How to interpret the Pearson Correlation Index?

    Not sure if that's the technical name, but I refer the the number Excel give you between 0 and 1 when you use the "correl" command on two sets of numbers.
  31. C

    Density matrices & spin correlation

    Homework Statement So I have two 1/2 spin systems A and B in a singlet state |\psi > = \frac{1}{\sqrt{2}} ( |+-> - |-+> ) . The question is: If I measured B and got S_{Bz} = 1/2 . What will I measure on state A on z axis? Homework EquationsThe Attempt at a Solution The answer I think is...
  32. S

    There is a very low correlation between salary and ....

    I am early in my career and trying to pursue a career in software engineering (I use that term broadly). Like any normal person, I eventually want to make good money, hopefully around 6 figures. I assumed that there would be a direct correlation between how sophisticated a software job is and...
  33. H

    Difference between 2-point and 4-point function in QFT

    As I understand it, the 2-point fnuction is for 1 particle incoming, 1 particle outgoing. The 4-point function is for 2 particles incoming, 2 particles outgoing. Is this correct? So an N-point function describes N/2 incoming particles and N/2 outgoing particles? Thanks!
  34. mhsd91

    Negative Critical Correlation Length Exponent (Nu)

    Hi everyone, I've encountered a curious problem I just can't figure out, and any input would be much appriciated!This is a personal project I'm working on, and as far as I know, there is no one else working on exactly the same. However, the computational study of critical phenomena is quite...
  35. marif

    Correlation length from intensity profile

    I want to calculate the correlation length of a rough surface from the intensity profile of diffuse and specular reflectance from that rough surface. By fitting with the Gaussian curve, I calculated FWHM of the intensity profile.Generally it is considered thatcorrelation length = 2/FWHMI also...
  36. P

    Second order correlation function for non ideal laser

    Hi, it is known that second order correlation function (g2) is a constant( =1) for ideal laser or single frequency light sources. So, what is the second order correlation function for non ideal laser? Is it still a constant or something related to the coherence time of the laser?
  37. J

    Covariance and correlation coefficient

    How do you prove that the maximum value of 2*cov(x,y) can be is equal to var(x) + var(y). Moreover, how do you prove that the correlation coefficient, cov(x,y)/(sigma(x)*sigma(y), can only be between -1 and 1.
  38. A

    Is there a way to verify that Bivariate Normal correlation?

    My main difficulty is finding E(XY), where if we find it by integrating, we get ∫xy f(x,y) dy dx where f(x,y) is the bivariate normal density function. This integral is a nightmare... are there any tricks to evaluating this integral, or finding E(XY) for that matter?
  39. L

    MATLAB Calculating Triple Correlation in MATLAB for Three Signals

    Hello, How can I calculate a triple correlation between 3 signals A,B,C (each has 2 million samples)? I know xcorr do it for 2 signals by FFT each signal, multiplication and iFFT back. Since xcorr cannot do it for three signals, I try to do it "manually" by the above algorithm. So, the "regular"...
  40. J

    Correlation funciton of a system with translational symmetry

    Hi guys, i have been confused by one statement on the spatial correlation funciton in the statistical physics textbook. They say for a spatial correlation function f(x1,x2), where x1 and x2 are the coordinate of particle 1 and 2, if the system has translational symmetry, then f depends only...
  41. K

    Scatter plot correlation coefficient

    how can I interpret the condition "if sum of (xi-x_bar)^2(yj-y_bar)^2=0 when i=/=j?" why does this make the line linear?
  42. V

    How to measure the time dependent correlation of two signals

    I have two signals (time series) shown in the plot below. Just by looking at the figure, we can see that the two main peaks of both signals are very closely aligned (correlated), however the red signal has additional features elsewhere which don't match the blue curve. I am looking for some...
  43. F

    Cross correlation for two m-sequences

    Calculate the discrete period cross correlation function for the pair of m-sequences given by - G1(D) = 1 + D2 + D5 and G2(D) = 1 + D2 + D3 - D4+ D5 I started by drawing the shift register diagrams and calculating each state, but that is a long process and I don't know how would i show the...
  44. jk22

    Where to find experimental correlation curves?

    I'm looking for experimental correlation curves in Violation of Bell inequalities. I found only one in http://arxiv.org/abs/quant-ph/9806043 Do you think as an amateur we could ask per mail this data to professionals having done this experiment ?
  45. enrikofermi

    How can I solve the problem with Fourier transforms in critical phenomena?

    Hi all. I'm learning something about critical phenomena and I have one problem. I'm bad with Fourier transforms so I don't know how from 7.37 we have 7.38. I have tryed everything I knew, but fruitless. I have attached picture of my problem. Does anybody has any idea how I can solve this?
  46. D

    MHB Getting variance from known correlation

    Suppose X and Y have the same distribution, and Corr(X,Y) = -0.5. Find V[X+Y]. I know that Corr(X,Y)*SD[X]SD[Y] = Cov(X,Y) and also V[X+Y] = V[X] + V[Y] + 2Cov(X,Y) So there must be a missing link, maybe an identity, that I'm not realizing. I think the fact that the 2 variables have the same...
  47. R

    What Fourier transform be called? Correlation or convolution?

    We know that in the Fourier transform formula ,there are mainly two terms function f(t) and complex exponential term ( function). But I am confused that what should i call Fourier transform formula as a correlation or convolution formula? So can anybody help regarding it?
  48. S

    Frequency correlation between two non stationary signals

    Hi all, I have measured the torque and the speed of a shaft when running at a variable speed. From the measurements, torque fluctuations are in the torque signals and I have the feeling that the fluctuations frequency is the shaft speed. I need to verify this with some signal statistics...
  49. nikosbak

    Compute 3-Point Function QFT Homework with Fermions

    Homework Statement I'm working on path integrals for fermions and I came across an exercise that ask to compute the three point functions , one of that is the: $$<0|J^{\mu}(x_1)J^{\nu}(x_2)J^{\rho}(x_3)|0> $$ where $$J^{\mu}$$ is the current $$J^{\mu}=\bar{\psi}\gamma^{\mu}\psi$$. ***Can you...
  50. D

    Correlation, simple formula, meaning

    Homework Statement Hello! Here is the quote of mathisfun explanation of correlation formula and after ## my understanding or questions: Let us call the two sets of data "x" and "y" (in our case Temperature is x and Ice Cream Sales is y): Step 1: Find the mean of x, and the mean of y Step 2...
Back
Top