What is Correlation: Definition and 367 Discussions

In statistics, correlation or dependence is any statistical relationship, whether causal or not, between two random variables or bivariate data. In the broadest sense correlation is any statistical association, though it commonly refers to the degree to which a pair of variables are linearly related.
Familiar examples of dependent phenomena include the correlation between the height of parents and their offspring, and the correlation between the price of a good and the quantity the consumers are willing to purchase, as it is depicted in the so-called demand curve.
Correlations are useful because they can indicate a predictive relationship that can be exploited in practice. For example, an electrical utility may produce less power on a mild day based on the correlation between electricity demand and weather. In this example, there is a causal relationship, because extreme weather causes people to use more electricity for heating or cooling. However, in general, the presence of a correlation is not sufficient to infer the presence of a causal relationship (i.e., correlation does not imply causation).
Formally, random variables are dependent if they do not satisfy a mathematical property of probabilistic independence. In informal parlance, correlation is synonymous with dependence. However, when used in a technical sense, correlation refers to any of several specific types of mathematical operations between the tested variables and their respective expected values. Essentially, correlation is the measure of how two or more variables are related to one another. There are several correlation coefficients, often denoted



ρ


{\displaystyle \rho }
or



r


{\displaystyle r}
, measuring the degree of correlation. The most common of these is the Pearson correlation coefficient, which is sensitive only to a linear relationship between two variables (which may be present even when one variable is a nonlinear function of the other). Other correlation coefficients – such as Spearman's rank correlation – have been developed to be more robust than Pearson's, that is, more sensitive to nonlinear relationships. Mutual information can also be applied to measure dependence between two variables.

View More On Wikipedia.org
  1. F

    I Infer the distance of a closest neighbor galaxy from correlation

    I am trying to estimate the distance of closest galaxy neighbor knowing the expression of number of neighbors into a volume ##\text{d}V##, the mean density ##n_\text{gal}## and the correlation function, i.e with this expression : ##\text{d}N=n_{\text{gal}}\,\text{d}V\,(1+\xi(r))## with...
  2. R

    MHB Find Linear Correlation Coefficient & P-Value for Internet Users & Award Winners

    Wooo! I am almost done with my stats class. I am having a reoccurring issue with finding the test statistic using a scatter plot and linear correlation coefficient. Internet Users (Per 100) Award Winners (Per 10 Million) 78.2 5.5 79.5...
  3. F

    Homework - A galaxy in the local universe

    Homework Statement I have the following questions as homeworks and I would like to get help. Here's some informations given to help us to answer : Photometry : U=11.60 B=11.16 V=10.20 Redshift : z= 0.00780 Central velocity dispersion : ##\sigma_{v}## = 210 km/s Introduction : The...
  4. F

    Homework - Interparticle distance between galaxies

    Homework Statement [/B] I have the following questions as homeworks and I would like to get help. Question 1) Give the formal expression of the total number density of galaxies. Why is this expressoin problematic in practice? Question 2) In practice one uses a numerical value for the number...
  5. J

    Density-density correlation function for spinless Fermions

    Homework Statement Consider the groundstate of a one-dimensional, non-interacting system of spinless fermions. Let ##a^†(x)## and ##a(x)## be the creation and annihilation operators for a fermion at the point ##x##, so that the density operator is ##n(x) = a^†(x)a(x)##. Show that the...
  6. F

    I Correlation between a Star's Luminosity and Distance?

    I made three charts from several different sources plotting the luminosity and distance from Earth of 26 to 300 Stars. In each chart, there appears to be a correlation between a star's luminosity (in solar units) and its distance from Earth (or solar system, whichever you prefer) in light years...
  7. Persson

    Exploring the Relationship between Impulse and Work in Rocket Dynamics

    Homework Statement I have a hipotetic rocket that have a power of 3000 watt, however its position don't change because the effect of a gravity of 10m/s^2 do the rocket remains like it would be resting. I need to determine the mass of the rocket. In a similar problem I have a rocket also in an...
  8. entropy1

    I Is a measurement a correlation?

    If we make a measurement, does that mean that the outcome of the measurement gets correlated with the measured value?
  9. E

    B The correlation between a dimensionless point and a line

    I see no correlation between a dimensionless point and a line although it appears that math has made one. I'm just a philosopher so it's quite possible that I've got it all wrong. It seems as though any location along a line is always the same location. If a location has no size then it can't...
  10. SchroedingersLion

    A Correlation functions - radial distribution function

    Greetings, I am about to start my master thesis in computational physics and I need to make myself familiar with correlation functions, in particular with the radial distribution function of a system of N identical particles. At Wiki, there is a short explanation of the definition of the...
  11. C

    I Question about the Na-O anti correlation

    I'm trying to write a research paper in astronomy, and while I was brainstorming ideas, I came across supermassive stars and the abundance anomalies of proton-capture elements in globular clusters, such as the C-N, Na-O, Mg-Al and Na-F anticorrelations. I tried searching everywhere for an...
  12. entropy1

    I Correlation setup between past and present

    Suppose A is an ensemble of measurement events in the past. Suppose B is an ensemble of measurement events in the present. Suppose there is a correlation between A and B that stays the same over time. Suppose we can manipulate the outcomes of B (for example by choosing the orientation of the...
  13. B

    I How does one actually compute a correlation function?

    I have been reading about weak gravitational lensing and I am trying to calculate the dispersion ##\langle M_{ap}^2\rangle## of the aperture mass for a singular isothermal sphere acting as a lens for distant objects. I need some guidance on how to actually carry out the calculation of the power...
  14. Cheesycheese213

    Correlation between the cost to produce electricity and the cost to consumers?

    Sorry if this is a bad question, but would lower costs to produce electricity (e.g. hydroelectricity instead of solar) bring down the overall costs for us consumers? Also, if there is any reading material or website on this topic, that would be really great too! Thanks!
  15. T

    Simplifying the Natural Convection Heat Transfer Correlation

    Homework Statement An appropriate correlation for heat transfer by natural convection from a horizontal pipe to the atmosphere is Nu=0.53Gr^0.25 Pr^0.25 Where, Gr= (αp^2 d^3 (T_1-T_f )g)/μ^2 And Pr⁡〖= (C_p μ)/k〗 Show the above correlation can be simplified to h...
  16. ezfzx

    A Interpreting Chi Squared .... backward

    OK, so, I've forgotten more statistics than my students will ever know, and I'm not too proud to ask for help, because I'm just blanking out on this. I would appreciate it if someone could patiently follow along and let me know what I've got right or wrong please. My understanding of the...
  17. E

    I The webpage title could be: Is Occam's Razor Applicable to Modeling Data?

    Hello, I have two predictor variables: gender and class, and one response variable: survived. After converting the categorical variables into numeric variables using dummy variables, I found the correlation between gender_male and survived to be -0.54, and between class_1 and survived to be...
  18. EnglandSP

    B Black Holes as Gateways to Parallel Universes?

    I'd like to know people's views on the possibility of Black Holes being 'Gateways' or 'Portals' to parallel universes.
  19. rocdoc

    About the first-order electric field correlation function.

    For a fixed point in space, the first-order electric field correlation function may be given as (Possibly incorrectly, see my "second" post to this thread)! $$\langle\vec E^*(t)\vec E(t+\tau)\rangle = {\frac {1} {T}} \int_T\vec E^*(t)\vec E(t+\tau)dt~~~~~(1)$$ Where T is a very large time and *...
  20. G

    I Correlation coeff in conditional distribution

    Can someone derive: ##\frac{Cov(Z+\Theta),\Theta)}{\sqrt{Var(Z+\Theta)Var(\Theta)}}=\frac{\sigma ^2}{\sqrt{1+\sigma ^2}}## My attempt: Numerator: ##Cov(X,Y)=E[(X-E(X))(Y-E(Y))]=E[(Z+\Theta-\theta)(\Theta-\mu)]## The denumerator is pretty simple: ##\sqrt{(1+\sigma ^2)\sigma ^2}##
  21. W

    Correlation between potential energy and torque

    In class while learning about electromagnetism, I was given the following two equations: U=-μ⋅B τ=μ×B where μ=IA First of all, what does μ stand for? How should I interpret the relationship between potential energy (U) and torque? Can someone explain this in terms of μ and B?
  22. qspeechc

    I Is an R-Value of 0.93 Considered Strong in Social Sciences?

    Hello everyone. I stumbled across an article in the social sciences that had a correlation coefficient of r=0.93. Being from a maths background and knowing nothing about things like social sciences, psychology, etc., is this r-value in these types of fields considered fairly strong, strong...
  23. C

    A Calculating asymptotic behavior of a correlation function

    I was hoping to get some assistance in reproducing a calculation from https://arxiv.org/abs/0803.1292 (https://journals.aps.org/pra/abstract/10.1103/PhysRevA.78.012304 for the published version). A certain four-spin correlation function for Kitaev's spin-1/2 model on the honeycomb lattice is...
  24. F

    I Is all correlation related to quantum entanglement?

    In other words, it seems that if you have entanglement, then you have correlation (of measured properties). But is it true that if you have correlation, then you have quantum entanglement? Classically, correlation is between macro-events. But macro-events are made of micro-events. So is...
  25. B

    B What is the physical interpretation of n-particle correlation function in QFT?

    Hi I would be happy if anyone helped me understand what the physical meaning of n-particle correlation function in QFT is ?
  26. K

    A Correlation properties of quasi-thermal light

    Hello! I'm measuring the second order correlation function g(2) of quasi-thermal light, generated by focusing a 633 nm laser onto a rotating sandpaper-like surface at 45 deg. Part of the dispersed light is collected into a fiber and split with a fiber beam splitter. A simple HBT setup. g(2) is...
  27. S

    I Two point correlation function in Peskin book

    Hello! I am reading Peskin's book on QFT and I reached a part (in chapter 4) where he is analyzing the two-point correlation function for ##\phi^4## theory. At a point he wants to find the evolution in time of ##\phi##, under this Hamiltonian (which is basically the Klein-Gordon - ##H_0## - one...
  28. A

    Normalized error with two signals?

    Hi, I'm a new member in this forum. my question : How calculated the normalized error with two signals?
  29. G

    B Correlation vs Causation: What Can Be Inferred?

    If variable X is positively correlated with variable Y, under what circumstances am I allowed to infer that X does not causally prevent Y with reasonable probability? I don't know much about statistics and I'm trying to motivate myself to learn by doing. For example...
  30. F

    Transforming Correlated Standard Normals with Cholesky Decomposition

    Homework Statement Given correlation matrix $$M = \begin{bmatrix} 1 & .3 & .5 \\ .3 & 1 & .2 \\ .5 & .2 & 1 \\ \end{bmatrix}$$ And 3 independent standard normals $$N_1, N_2, N_3$$ using cholesky decomposition A) get the correlated standard normals B) and if...
  31. N

    What is preventing me from achieving better accuracy for this delay?

    I have 2 PERFECT data of the transmitter and receiver. From 2 data, I can calculate the delay estimation: Fs = 8e6; % sample rate ... for i = 1:2 [cc_correlation,lag] = xcorr(signal2(i), signal1); [cc_maximum, cc_time] = max(abs(cc_correlation)); cc_estimation...
  32. M

    I Significant correlation, not significant coefficient

    A couple of questions today. First. I am running a panel data regression test. First I check the correlations between the independent variables and the dependent variable. these are the results. The D/(D+Em) is the dependent variable, and the independent are the 4 variables most adjacent...
  33. T

    I Correlation Coefficient Clarification

    Let's say that the correlation coefficient between X and Y were swapped so that the correlation coefficient between Y and X. If we were to compared the correlation coefficient between X and Y and Y and X. Based on my understanding of correlation coefficient, it doesn't matter if f X and Y were...
  34. entropy1

    I Are entanglement correlations truly random?

    Suppose we have two truly random sources A and B that generate bits ('0' or '1') synchronously. If we measure the correlation between the respective bits generated, we find a random, ie no, correlation. Now suppose A and B are two detectors that register polarization-entangled photons passing...
  35. S

    A Gauge-invariant operators in correlation functions

    Gauge symmetry is not a symmetry. It is a fake, a redundancy introduced by hand to help us keep track of massless particles in quantum field theory. All physical predictions must be gauge-independent...
  36. N

    How to calculate Time Delay Estimation?

    I have 2 data files, which links are attached below: Transmitted data https://www.dropbox.com/s/0nmhw6mpgh7upmv/TX.dat?dl=0 Received data https://www.dropbox.com/s/xgyo6le3bcmd25r/RX.dat?dl=0 Those binary data are read by this MATLAB code: %% initial values: nsamps = inf; nstart = 0; %% input...
  37. J

    Flux-flux correlation function under Feynman's path integral

    This is a chemically inspired problem, but the path is fully quantum mechanics and a bunch of integrals. How does one calculate fully quantum mechanical rate ($\kappa$) in the golden-rule approximation for two linear potential energy surfaces? Attempt: Miller (83) proposes...
  38. D

    MHB Visual illustration of Pearson correlation coefficient r

    From what I have understood about Pearson correlation coefficient I have created a visual illustration, I would like to know if this understanding looks correct. Say I have a sample with 5 data points:- x y 8 6 16 8 20 16 28 12 32 20 My goal is to...
  39. A

    I Understanding autocorrelations in 2D Ising model

    I wasn't sure where to post this, I hope this was the right section. I've been struggling quite a bit with implementing an autocorrelation code into my current project. The autocorrelation as it is now, is increasing exponentially from 1 at the start of my MC run, and hitting 2 halfway through...
  40. J

    A How Do Time Correlation Functions Reveal Particle Dynamics in Quantum Mechanics?

    What exactly does class of time correlation functions measure of particle in quantum mechanics? In particular, I would love to know the answer in the context of Kubo-transform time correlation function.
  41. ChrisVer

    A QFT phi3 Feynman diagrams and correlation function

    I have some difficulty understanding how to go about with this problem: I came up with several graphs, you can see them in the attached picture (they are up to ~g^4 order). I am not sure about the self-interaction diagrams, but I think they are considered in the connected graphs (they are not...
  42. S

    A Correlation coefficient among trends

    Hi all, in several vehicles, I measured the engine torque and speed and the engaged gear while it was driven for around 100km/h. I computed the average engine speed and torque of all the times the vehicle was run with each gear and also I computed the relative frequency of the gear used. So for...
  43. Hallucinogen

    B Does a correlation coefficient represent probability?

    Sorry if this is trivial - I'm arguing with someone on Facebook :sorry: who is claiming that r-squared values, or correlation coefficients represents "chance" or "probability". I've never heard of this. I just need a simple yes or no answer along with a short explanation why it is or isn't...
  44. L

    I Correlation vs causation in biology/biochemistry

    Hello everyone, we were discussing a project at work just yesterday (I work as a researcher in a medium-size biotech), and at some point the (in)famous 'correlation doesn't imply causation' sentence came up. I would like to know what you think, please. I apologise in advance, long post: the...
  45. C

    Nusselt Number Correlation

    I am looking for a Nusselt number correlation that will work for a shell & tube heat exchanger in the Re < 3000 region, i.e. extremely laminar flow (for a lab experiment). I've been searching for a while now, but can only find empirical correlations for Re > 3000, and was thus hoping that...
  46. V

    A Proof of quantum correlation functions

    Reading through David Tong lecture notes on QFT.On pages 76, he gives a proof on correlation functions . See below link: [QFT notes by Tong][1] [1]: http://www.damtp.cam.ac.uk/user/tong/qft/qft.pdfI am following the proof steps to obtain equation (3.95). But several intermediate steps of the...
  47. D

    Lower Bound on Weighted Sum of Auto Correlation

    Homework Statement Given ##v = {\left\{ {v}_{i} \right\}}_{i = 1}^{\infty}## and defining ## {v}_{n}^{\left( k \right)} = {v}_{n - k} ## (Shifting Operator). Prove that there exist ## \alpha > 0 ## such that $$ \sum_{k = - \infty}^{\infty} {2}^{- \left| k \right|} \left \langle {v}^{\left (...
  48. ShayanJ

    A Green functions and n-point correlation functions

    Green functions are defined in mathematics as solutions of inhomogeneous differential equations with a dirac delta as the right hand side and are used for solving such equations with a generic right hand side. But in QFT, n-point correlation functions are also called Green functions. Why is...
  49. S

    A Free theory time-ordered correlation function with two internal fields

    Wick's theorem allows one to write a free theory time-ordered ##n##-point correlation function as a product of free theory time-ordered ##2##-point correlation function. The procedure involves the pairwise Wick contraction of fields such that external fields are not paired up each...
  50. S

    A Free theory time-ordered correlation functions with derivatives of fields

    Consider the following time-ordered correlation function: $$\langle 0 | T \{ \phi(x_{1}) \phi(x_{2}) \phi(x) \partial^{\mu}\phi(x) \partial_{\mu}\phi(x) \phi(y) \partial^{\nu}\phi(y) \partial_{\nu}\phi(y) \} | 0 \rangle.$$ The derivatives can be taken out the correlation function to give...
Back
Top