Infinite Variance VS Zero Variance

Click For Summary
The discussion centers on the concepts of zero variance and infinite variance distributions in Information Theory. The Dirac delta function represents a zero variance process, while the opposite concept, a distribution with infinite variance, is explored. It is noted that a distribution can have a mean and still possess infinite variance, as exemplified by Brownian motion, which is unpredictable yet has a defined mean. The conversation also touches on the complexities of defining a "most probable" value in distributions where all values are equally probable. Ultimately, the nuances of variance and mean in statistical distributions are highlighted, emphasizing the interplay between chaos and order in these mathematical concepts.
cacosomoza
Messages
11
Reaction score
0
Hi there, this is caco, I´m a new user from planet Earth.

I´m studying Information Theory and lately It seems that I live in a fractal ocean of gaussian distributions...

I do know that zero variance processes relate to Dirac´s delta distribution, my favourite mathematical artifact ever. And then I considered the opposite case, a distribution in which its mean is all possible values at the same time. It would be somewhat like that its mean is its own domain (despite we are not talking of a function in the strict sense).

Anyway, I don´t want to become too philosophical but I always loved the opposition between chaos and order and i think the presence of a mean is the presence of some intrinsic order within that process. We know the universe tends to set energy equiprobably around physical space, which would mean that the universe tends to an infinite variance distribution.

My question is, does it have any name such process, a totally chaotic and unpredictible process? Which is the opposite of the dirac delta function?

Thanks for your words
 
Mathematics news on Phys.org
cacosomoza said:
Hi there, this is caco, I´m a new user from planet Earth.

I´m studying Information Theory and lately It seems that I live in a fractal ocean of gaussian distributions...

I do know that zero variance processes relate to Dirac´s delta distribution, my favourite mathematical artifact ever. And then I considered the opposite case, a distribution in which its mean is all possible values at the same time. It would be somewhat like that its mean is its own domain (despite we are not talking of a function in the strict sense).

Anyway, I don´t want to become too philosophical but I always loved the opposition between chaos and order and i think the presence of a mean is the presence of some intrinsic order within that process. We know the universe tends to set energy equiprobably around physical space, which would mean that the universe tends to an infinite variance distribution.

My question is, does it have any name such process, a totally chaotic and unpredictible process? Which is the opposite of the dirac delta function?

Thanks for your words

If what you mean by opposite is Fourier transform then the Dirac delta transforms to the uniform distribution.

The universe will not tend to an infinite variance distribution because its volume is finite. Also it is not clear that it will ever reach a uniform energy distribution. It that were inevitable then how did it get wound up in the first place?

A distribution can have a mean and still have infinite variance.

A distribution without a mean is usually not studied and does not really relate to any theory I know except in degenerate cases such as particles of definite momentum or position in Quantum Mechanics.

A Brownian motion is totally unpredictable even though it has a definite mean.

The only continuous stochastic process with independent increments is a Brownian motion.
 
Last edited:
wofsy said:
A distribution can have a mean and still have infinite variance.

Thanks for your answer. How is it possible that if all values are equally probable one may be selected as representing the most probable? Can somebody explain me this?

Thanks
 
cacosomoza said:
wofsy said:
A distribution can have a mean and still have infinite variance.

Thanks for your answer. How is it possible that if all values are equally probable one may be selected as representing the most probable? Can somebody explain me this?

Thanks

? What do you mean - if all values have equal probability - how can one be most probable?
 
The mean doesn't have to be the most probable value.

I'm not quite getting what you mean by infinite variance: usually if a distribution has a moment that is not finite we say it doesn't exist. As an (artificial) example, consider the random variable who's density is

<br /> f(x) = K \cdot \left(\frac 1 {x^3}\right), \quad x \ge 1<br />

Here K is the constant needed to make

<br /> \int f(x) \, dx = 1<br />

This has a finite mean, since x f(x) is of the order x^{-2}, and so the required integral converges. However, the variance doesn't exist, since x^2 f(x) is of order x^{-1}, and the required integral does not converge.
 
Here is a little puzzle from the book 100 Geometric Games by Pierre Berloquin. The side of a small square is one meter long and the side of a larger square one and a half meters long. One vertex of the large square is at the center of the small square. The side of the large square cuts two sides of the small square into one- third parts and two-thirds parts. What is the area where the squares overlap?

Similar threads

  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 12 ·
Replies
12
Views
2K
  • · Replies 12 ·
Replies
12
Views
5K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 7 ·
Replies
7
Views
27K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 16 ·
Replies
16
Views
3K
  • · Replies 13 ·
Replies
13
Views
3K