Does the mean of the Cauchy distribution actually exist?

  • Context: Undergrad 
  • Thread starter Thread starter Thejas15101998
  • Start date Start date
  • Tags Tags
    Existence Variance
Join the discussion
Ask a follow-up here, or get your own question answered by working scientists, mathematicians and engineers — people, not an autocomplete.
Real named experts · corrections over time · the nuance an AI answer skips
19 replies · 5K views
Thejas15101998
Messages
43
Reaction score
1
I did not understand of the non-existence of variance.
What does it mean?
 
Physics news on Phys.org
Dale said:
I have never heard of that. Do you have a reference?
yes.
Refer to Philip Bevington's book on error analysis , pg 11 last paragraph.
 
upload_2017-1-8_8-16-11.png
 
So the above is the reference from the book
 
It ("no variance") means "cannot be defined" or "is infinite". There can be several reasons for it as mentioned in previous posts. The author talks about distributions that don't behave mathematically nice. In this context, every distribution is possible and therefore also those, for which the variance cannot be defined (or is infinite). Since it is a very general statement, it cannot be said, what exactly is meant. And it isn't important here anyway.
 
Stephen Tashi said:
The Cauchy distribution has no mean and hence (since the definition of the variance of a probability distribution requires that the mean exists) it has no variance.
well yes it is the consequence of its slowly decreasing behavior for large deviations.
 
I am new to these forums, but I'll guess that you're looking for a simple non-trivial example that could fit in with the blurb from your text.

Cauchy is bundling a few different things, so I don’t think it’s what you’re looking for (i.e. infinite second moment and no well defined first moment.)

Note that if something is infinite it is said to be in the extended real number system but not part of the real number system. So with respect to (non-extended) real numbers, infinite variance is sometimes referred to as variance not existing. (I think mathman was getting at this.)

For a simple example, take a look at Pareto distribution, with
$$1 < \alpha \leq 2$$.
https://en.wikipedia.org/wiki/Pareto_distribution

In that interval you do have a finite mean, and infinite variance.

Also note that average deviation can be interpreted as a length 1 norm for distance from the mean, whereas variance (or really standard deviation) can be interpreted as a length 2 norm for distance from the mean.

Note that if you are collecting a finite amount of data, your estimates of mean and variance can always be computed and will be finite. But if you are using something like a Pareto distribution with $$\alpha = 1.5$$

what will happen is your mean estimate will approximate the true mean, while your variance estimate will be all over the place. Playing around with simulations may help with intuition here.
 
  • Like
Likes   Reactions: Dale
This is a snapshot from the page that follows, from the same book.
 
If I'm looking to learn something new, I always ask what the simplest non-trivial example is. I strongly encourage you to take a look at the Pareto distribution I linked to above. If you understand how this Pareto works, *then* I would look at your most recent blurb.

The reason is that your picture is Cauchy again. If you scroll down to "Explanation of undefined moments" in its wikipedia entry, here:

https://en.wikipedia.org/wiki/Cauchy_distribution#Explanation_of_undefined_moments

you can get a flavor what is going on. The issue is mathematically speaking, your text is wrong. It confuses the principal value with the Cauchy expected value, which isn't well defined. (Why? As shown in wikipedia, start with the two different finite integral (or even approximate riemann sums) bounds of [-a,a] and [-2a, a] and take a limit as a -> infinity. The result has the same bounds yet different values. This is a subtle mathematical point tied in with one to one mapping, and something that your text does not seem to understand. Put differently, your author is positing [-a,a] without realizing it.)

One solution to this, would come from Jaynes. He would recommend you basically always start with a finite case, state exactly what you mean, and take limits -- people make egregious errors when they start in infinity.

What your book is trying to say is that the second moment $$E[X^2] = \infty$$ $$variance = E[X^2] - E[X]^2 = \infty - ?$$ which is not in the real number system. I'd get a different book, though.
 
Last edited:
  • Like
Likes   Reactions: Thejas15101998