What is Correlation: Definition and 367 Discussions

In statistics, correlation or dependence is any statistical relationship, whether causal or not, between two random variables or bivariate data. In the broadest sense correlation is any statistical association, though it commonly refers to the degree to which a pair of variables are linearly related.
Familiar examples of dependent phenomena include the correlation between the height of parents and their offspring, and the correlation between the price of a good and the quantity the consumers are willing to purchase, as it is depicted in the so-called demand curve.
Correlations are useful because they can indicate a predictive relationship that can be exploited in practice. For example, an electrical utility may produce less power on a mild day based on the correlation between electricity demand and weather. In this example, there is a causal relationship, because extreme weather causes people to use more electricity for heating or cooling. However, in general, the presence of a correlation is not sufficient to infer the presence of a causal relationship (i.e., correlation does not imply causation).
Formally, random variables are dependent if they do not satisfy a mathematical property of probabilistic independence. In informal parlance, correlation is synonymous with dependence. However, when used in a technical sense, correlation refers to any of several specific types of mathematical operations between the tested variables and their respective expected values. Essentially, correlation is the measure of how two or more variables are related to one another. There are several correlation coefficients, often denoted



ρ


{\displaystyle \rho }
or



r


{\displaystyle r}
, measuring the degree of correlation. The most common of these is the Pearson correlation coefficient, which is sensitive only to a linear relationship between two variables (which may be present even when one variable is a nonlinear function of the other). Other correlation coefficients – such as Spearman's rank correlation – have been developed to be more robust than Pearson's, that is, more sensitive to nonlinear relationships. Mutual information can also be applied to measure dependence between two variables.

View More On Wikipedia.org
  1. V

    Least squares parameter correlation

    I am trying to solve a large least squares inversion (inverting data for the modeled sources), and find that my parameters describing 1 source are highly correlated with the parameters describing the second source. Can anyone recommend a technique or reference which discusses how to reduce the...
  2. sheila92lala

    Correlation between a continous and nominal data in SPSS

    How do i check for correlation or test for association between a continuous data and nominal data in SPSS? My nominal data is the "type of GPS receiver" and the continuous data is "latency" in seconds.
  3. D

    Compute 1D Ising Correlation w/ Periodic, Anti-Periodic BDs

    Homework Statement Compute correlation functions ##<\sigma_r \sigma_{r+l}>## for the 1D Ising model of length L with the follow BD conditions (i) Periodic (ii) Anti-Periodic (iii) ##\sigma_1 = \sigma_{L+1}=1## (iv) ##\sigma_1= -\sigma_{L+1}=1## Homework Equations ##<\sigma_r \sigma_{r+l}> =...
  4. fluidistic

    0.7 correlation but almost 0 p-value, how to interpret?

    Hi guys, I've compared 2 samples of data from which I expected some correlation. The result is that the correlation is about 0.7 while the p-value (calculated by a software) is about ##10^{-92}##. I don't really know how to interpret this low p-value. Does that mean that I can fully trust that...
  5. Th3HoopMan

    Correlation between Iterative Methods and Convolution Codes

    Hey guys so I have this Calc 3 project and the end is throwing me for a loop. I've done the encoding part, and I've coded the standard iterative methods, but I don't see how the two correlate so I can use the iterative methods to decode a "y stream" with the inputs specified...
  6. R

    Fun maths question, correlation?

    Say i m in the cinema and there are 4 seats. say the closest seat is the best view which is 4 meters away. say the further the distance away the worse the viewing quality. eg [5,6,4,9] are the distances of seats away from screen. Now let's say people sitting in front of you also effects viewing...
  7. S

    Help to 2-point correlation function in $ \phi^{4} $-theory

    Hi everyone! After a few slow days in the office I thought I would like to derive the 2-point correlation function within statistical(Euclidian) ## \phi^{4} ##-theory but I ran into some problems. For the sake of clarity I will show you from where I startet and ask questions when I need help...
  8. fluidistic

    1-D Ising's model without B field, stat. mech., correlation

    Homework Statement Hi guys, I'm going nuts on a problem. Out of memory the problem was a system of N pairs of atoms that interact between each others so that the Hamiltonian of the whole systeme is ##H=-J \sum _{n=1}^N \sigma _i \tau _i## where the only possible values of the ##\tau _i##'s and...
  9. T

    MHB Covariance and Correlation matrix

    I would love to learn more about those two matrices. What do they tell us,how to calculate them? Maybe in R Studio? I was searching for some good explanations on google,but i didnt find them. And another question,i apologize if is not in right forum... How do i know how much dispersion can i...
  10. T

    Pearson Correlation in Sleep Studies

    Hi guys, so I've been researching sleep studies and I've been looking at comparison on devices used, and most of them seem to obtain a magnitude value based on the acceleration seen on the device by the user. What I'm wondering about though is that the comparison between devices seem to be...
  11. D

    Correlation between Test Scores and Academic Success

    I recall reading that, while it is not true for all fields, there is a correlation between standardized test scores and academic performance in math and science. I did a quick search, but couldn't find much information that was specific to math and science. I teach AP Calculus and this subject...
  12. D

    Simplifying correlation coefficient

    Homework Statement The linear prediction of one random variable based on the outcome of another becomes more difficult if noise is present. We model noise as the addition of an uncorrelated random variable. Specifically, assume that we wish to predict ##X## based on observing ##X + N##, where...
  13. J

    Differentiating semi-classical Kubo trans. correlation functions wrt t

    I do not fully understand how non local correlation functions are derived from the differentiation of local ones. Specifically how in the following paper equation 23 is derived from 21 since the paper implies H and dpdq are invariant under time...
  14. B

    Two-point correlation function in path integral formulation

    Suppose that I have already calculated the two-point correlation function for a Lagrangian with no interations using the path integral formulation. \langle \Omega | T[\phi(x)\phi(y)] | \Omega \rangle = \frac{ \int \mathcal{D}\phi \phi(x)\phi(y) \exp[iS_0] }{ \int \mathcal{D}\phi \exp[iS_0] }...
  15. D

    How to Analyze Correlation Between Variables

    Homework Statement I'm doing a research project in which there's a survey given to respondents from 3 different groups of education(high school vs university etc) related to STD contraction rates. On the survey there's a question asking how many STD's they have contracted over their lifetime...
  16. C

    Correlation functions and Ward identities

    The definition I have for a 2-point correlator is $$\langle \phi_1(x_1)\phi_2(x_2)\rangle = \frac{1}{Z} \int \mathcal D \phi \,\,\phi_1(x_1)\phi_2(x_2) \exp-S[\phi],$$ where ##Z = \int \mathcal D \phi \,\,\exp-S[\phi]##. I am trying to understand the overall physical meaning of such a quantity...
  17. H

    Correlation operation as measure of similarity between two functions

    Hello, I recently started going through some lecture notes on linear systems and Fourier optics. (By the way, I just started with these, but so far the lecture notes are excellent. If anyone is looking to learn the subject but doesn't want to spend money on a textbook, the lecture notes, and...
  18. WannabeNewton

    2-point correlation functions for curvature perturbations

    Does anyone have a good reference or references that go into detail on rigorous/formal developments of 2-point correlation functions for curvature perturbations (and related perturbations) in the cosmological context? I'm using the TASI lectures in inflation, Mukhanov, and Dodelson but none of...
  19. F

    Correlation function poles in Peskin's derivation of LSZ formula

    Hi folks, Been trying to fill some of the more formal gaps in my knowledge by tackling the more technical stuff in P&S Chapter 7. Their derivation of the LSZ formula is quite different to those of books like, say, Srednicki, as they basically Fourier transform the whole argument as I...
  20. M

    Serial correlation coefficient (random data)

    I have a byte array of length 16384 bytes obtained from random.org/bytes. There is a random number sequence test program available from http://www.fourmilab.ch/random/ that, when run on my byte array, returns the following: Entropy = 7.989469 bits per byte. Optimum compression would reduce...
  21. P

    Correlation between degree of two vertices in a n-vertices graph

    Hi! I'm a bit stumped on this computer-science-related statistics (I think that's what it would fall under) problem. It's over here: http://math.stackexchange.com/questions/796517/correlation-between-the-degree-of-two-vertices-in-an-undirected-graph/796526?noredirect=1#796526 It would be...
  22. J

    Probability, Correlation, Variance Statistics Homework Help.

    Homework Statement 1. Assume each birth in a hospital on a given day is independent of one another, and each birth, P(boy)=0.48. What is the probability that the 8th baby born is the 5th girl. 2. Two random variables X and Y have joint distribution given by. What is their correlation. 3. Z...
  23. ╔(σ_σ)╝

    Using correlation coefficients as x in a regression?

    Using correlation coefficients as x in a regression?? I was reading an article in the Wall street journal and the author was using a rolling correlation coefficient, on a set of variables, as his predictor variable in a linear regression. Basically it was a uni-variate linear regression , y=...
  24. A

    MHB Determining Positive Correlation from Table

    i was given a table for calculating joint and marginal distribution. then i was asked if the variables are positively correlated or not. i know what positive correlation is, but how do i determine that from a table?
  25. S

    Why is correlation coefficient -1 to +1

    Homework Statement Why is the correlation coefficient between -1 and +1? Homework Equations we know correlation coefficient \rho = \frac{E[xy]-E[x]E[y]}{\sqrt{\sigma_{x} \sigma_{y}}} OR r = \frac{\sum ^n _{i=1}(X_i - \bar{X})(Y_i - \bar{Y})}{\sqrt{\sum ^n _{i=1}(X_i -...
  26. mhsd91

    Correlation Function of the Ornstein-Uhlenbeck Process

    Basically, The Ornstein-Uhlenbeck (OU) process (and its time-integral) decribes the velocity of a brownian particle. The OU process is Stationary (in time), Stochastic AND Markovian. Now, I've done an exact, one dimensional, numerical simulation of the OU process similar to D. T. Gillespie in...
  27. C

    Correlation confused on integration

    x(n)=exp(i(x*n+theta1)) +exp(i(y*n+theta2)) x and y are constants , theta1, theta2 are uniform random on [0,2*pi] R(f) =E[{ exp(i(x*n+theta1)) +exp(i(y*n+theta2)) }exp(-i(x*(n-f)+theta1)) +exp(-i(y*(n-f)+theta2)) }] = 4 products 2 of which will be similar but with the opposite constants...
  28. C

    Where did the correlation formula come from?

    So I am still studying for CFA level one, and it has been years since I took a statistics course. Anyway, the formula is Correlation=Covariance(x,y)/(standard deviation of x times the standard deviation of y) It is easy enough to calculate...but where did the formula come from? As in...
  29. S

    Intraclass Correlation Coefficient (ICC) the appropriate method?

    Homework Statement I wish to determine whether a SINGLE instrument provides reliable measures (test-retest reliability). This single instrument is not random (it's the only one available), and I will take 10 measurements for each individual that is part of a control group (and then again for...
  30. gfd43tg

    Lee/Kesler Correlation: Accuracy & Complexity

    Hello, I have been doing Lee/Kesler correlations ad nauseum to compare with calculated values for residual enthalpy and entropy with the Redlich/Kwong equation. My enthalpy values have varied as much as 400 J/mol with the correlation compared to the equation (enthalpy's in the 2500 J/mol...
  31. Telemachus

    Brownian motion, correlation functions

    Hi. I have a doubt on the derivation of the correlation function for the velocity and position in Brownian motion from the Langevin equation. I have that for a brownian particle: ##\displaystyle v(t)=v_0e^{-\frac{\gamma}{m}t}+\frac{1}{m}\int_0^{t}dse^{-\frac{\gamma}{m}(t-s)}\xi(s)## (1)...
  32. A

    What is Correlation Length and How is it Related to Surface Roughness?

    What is "Correlation length"? Hi everyone, I want to know meaning of "correlation length". Correlation function is usually used in statistics, so I think correlation length also similar meaning. But some paper used correlation length to explain roughness factor. Plz, anyone reply...
  33. N

    How to prove zero correlation between residuals and predictors?

    Hi, I'm trying to figure out something I'm pretty sure is true, but don't know how to prove it. I couldn't find the answer with a google search, but hopefully someone here knows the answer! So I have a linear least squares multiple regression model: Y=a+bX1+cX2+e where a is the intercept, X1...
  34. Safinaz

    Spin Correlation: Exploring its Relation to Narrow Width Approximation

    Hi all, Do anyone know what is the spin correlation and what its relation to theNarrow Width Approximation. Regards, Safinaz
  35. C

    Calculating errors and trendline - different correlation coefficients?

    Background: My lab group has taken a number of measurements of gas levels over 15 minute period every 15 seconds. We actually used a gas sensor and computer interface to do it so it pretty much did all the work. In calculating the errors for the data, using the uncertainties given in the user...
  36. C

    Understanding N-point Correlation Functions in Particle Scattering Processes

    For a two-point correlation function, it's my understanding we can interpret this as the amplitude for a particle to propagate from one point to another. Is there a similar interpretation for 3- or higher-point correlation functions? When are these used? Thanks!
  37. dlgoff

    Decoherence: What is a Robust Correlation

    While reading Zurek paper Decoherence and the transition from quantum to classical -- REVISITED, he makes the statement: What exactly is a "robust enough" correlation (from a interaction with the environment)?
  38. S

    How to evaluate quality of correlation?

    Hi, I would like to know, how do I evaluate the quality of correlation? Specifically, I have a set of N datapoints, each represented by k features. I want to know how the k features correlate with each other, and therefore, I created a k by k correlation matrix. I am using R-value, so the...
  39. C

    Correlation of U=Z+X and V=Z+Y

    Homework Statement ##X##, ##Y## and ##Z## are uncorrelated random variables with variances \sigma^{2}_{X}, \sigma^{2}_{Y} and \sigma^{2}_{Z}, respectively. ##U=Z+X## and ##V=Z+Y##. Find \rho_{UV}. Homework Equations \rho_{UV}=\frac{Cov(U,V)}{\sqrt{Var(U)Var(V)}} The Attempt at a Solution...
  40. J

    Scattering matrix and correlation functions

    I've been reading Coleman's notes and the book on QFT by Ticciati. There they both place a lot of emphasis on computing the scattering matrix S. I can follow their computations (using Wick's theorem etc.) but I don't really have a good understanding of what S actually tells you. Ticciati even...
  41. K

    Correlation and condjtional probabilty

    Hello, I have just started learning these things, would really appreciate any help on this. There are 4 nodes in a network (say A,B,C,D)and each node has certain failure probabilities( P(af),P(bf),P(cf),P(df) ). Then,I have this 4x4 correlation Matrix which contains the correlation...
  42. R

    Correlation function of damped harmonic oscillator

    The model of damped harmonic oscillator is given by the composite system with the hamiltonians ##H_S\equiv\hbar \omega_0 a^\dagger a##, ##H_R\equiv\sum_j\hbar\omega_jr_j^\dagger r_j##, and ##H_{SR}\equiv\sum_j\hbar(\kappa_j^*ar_j^\dagger+\kappa_ja^\dagger...
  43. S

    Entanglement swapping - any correlation between previous partners?

    Entanglement swapping - any correlation between previous partners? Is there any correlation between previous partners/group in entanglement swapping? The question is illustrated with an example below: Alice has A & B entangled Bob has C & D entangled Charlie entangles B & C, which...
  44. E

    Correlation between two particles problem

    Homework Statement Consider a physical system made of 2 particles , particle (1) and particle (2)of the same mass m, which don’t interact with each other and which are both placed in an infinite potential well of width a. Denote H(1) and H(2) the Hamiltonians of each particles by |ψ1> and...
  45. S

    Product Moment Correlation coefficient

    Homework Statement Homework Equations r=\frac{S_{xy}}{S_{x} S_{y}} S_{x}=\sqrt{\Sigma(x-\bar{x})^2} The Attempt at a Solution I have calculated the value of Sx several times and I got 43.3 but the answer key said that Sx = 11.2 1. Is my formula correct? 2. If yes, is my...
  46. D

    How to count Spearman Rank order correlation

    Homework Statement calculate the rank order correlation between the following data: 6, 5, 4, 2, 3, 3, 8, 3, 7, 6, 7, 5, 5, 4, 2, 7, 6, 2, 4, 6 4, 3, 6, 7, 6, 7, 1, 9, 1, 2, 3, 4, 5, 5, 7, 1, 2, 9, 5, 4 Homework Equations Following the output from...
  47. Barioth

    Correlation and mathematical expectation question

    Hi, I have these 2 problem, that I'm not so sure how to handle. 1-Let X_1,X_2,...,X_n independant Random variable that all follow a continuous uniform distribution in (0,1) a) Find E[Max(X_1,X_2,...,X_n)] b) Find E[Min(X_1,X_2,...,X_n)] where E is for the mathematical...
  48. E

    Correlation between random variables

    Homework Statement Find correlation between random variables x and y in the following: $$P_{x,y}(x,y)=A \ xy \ e^{-(x^2)}e^{-\frac{y^2}{2}}u(x)u(y)$$ Homework Equations The co-variance ##\sigma_{xy}=\overline{(x-\bar{x})(y-\bar{y})}## or ##\sigma_{xy}=\overline{xy}-\bar{x}\bar{y}##...
  49. S

    Can we calculate three-point correlation in lattice qcd

    Is it feasible to calculate a three-point correlation on the lattice? Say, I have two quark fields separated at z_1+z_2 and 0, and a gluon field inserted at z_2. Also I need two gauge links to make this expression gauge invariant: \bar{\psi}(z_1+z_2) \Gamma(z_1+z_2; z_2) F^{\mu\nu}(z_2)...
  50. I

    The correlation between AI and C.V. to these automation systems

    I want to know how the artificial intelligent become integrated or can improve more automation systems and machine that build in automatic way Display screen, solar cells, lithium ion batteries, printed circuit boards and 3D printers. I know that these automation systems and machine are...
Back
Top