Infinite Variance VS Zero Variance

Click For Summary

Discussion Overview

The discussion revolves around the concepts of infinite variance and zero variance in probability distributions, particularly in the context of Information Theory and their philosophical implications. Participants explore the nature of chaotic versus ordered processes, the relationship between variance and mean, and the characteristics of specific distributions.

Discussion Character

  • Exploratory
  • Debate/contested
  • Technical explanation

Main Points Raised

  • Some participants propose that zero variance processes relate to the Dirac delta distribution, while others consider the opposite case of a distribution with infinite variance.
  • One participant suggests that the universe tends toward an infinite variance distribution due to energy being set equiprobably in physical space.
  • Another participant challenges the idea that the universe will tend to an infinite variance distribution, arguing that its volume is finite and questioning the inevitability of a uniform energy distribution.
  • It is noted that a distribution can have a mean while still possessing infinite variance.
  • Participants discuss the concept of a totally chaotic and unpredictable process, with references to Brownian motion as an example that has a definite mean despite being unpredictable.
  • Questions arise regarding the interpretation of a distribution where all values are equally probable and how one can be selected as the most probable value.
  • A participant provides an example of a random variable with a finite mean but infinite variance, illustrating the complexity of these concepts.

Areas of Agreement / Disagreement

Participants express differing views on the relationship between variance and mean, the nature of chaotic processes, and the implications for the universe's energy distribution. The discussion remains unresolved with multiple competing perspectives presented.

Contextual Notes

Some claims depend on specific definitions of distributions, and there are unresolved mathematical steps regarding the existence of variance in certain cases.

cacosomoza
Messages
11
Reaction score
0
Hi there, this is caco, I´m a new user from planet Earth.

I´m studying Information Theory and lately It seems that I live in a fractal ocean of gaussian distributions...

I do know that zero variance processes relate to Dirac´s delta distribution, my favourite mathematical artifact ever. And then I considered the opposite case, a distribution in which its mean is all possible values at the same time. It would be somewhat like that its mean is its own domain (despite we are not talking of a function in the strict sense).

Anyway, I don´t want to become too philosophical but I always loved the opposition between chaos and order and i think the presence of a mean is the presence of some intrinsic order within that process. We know the universe tends to set energy equiprobably around physical space, which would mean that the universe tends to an infinite variance distribution.

My question is, does it have any name such process, a totally chaotic and unpredictible process? Which is the opposite of the dirac delta function?

Thanks for your words
 
Physics news on Phys.org
cacosomoza said:
Hi there, this is caco, I´m a new user from planet Earth.

I´m studying Information Theory and lately It seems that I live in a fractal ocean of gaussian distributions...

I do know that zero variance processes relate to Dirac´s delta distribution, my favourite mathematical artifact ever. And then I considered the opposite case, a distribution in which its mean is all possible values at the same time. It would be somewhat like that its mean is its own domain (despite we are not talking of a function in the strict sense).

Anyway, I don´t want to become too philosophical but I always loved the opposition between chaos and order and i think the presence of a mean is the presence of some intrinsic order within that process. We know the universe tends to set energy equiprobably around physical space, which would mean that the universe tends to an infinite variance distribution.

My question is, does it have any name such process, a totally chaotic and unpredictible process? Which is the opposite of the dirac delta function?

Thanks for your words

If what you mean by opposite is Fourier transform then the Dirac delta transforms to the uniform distribution.

The universe will not tend to an infinite variance distribution because its volume is finite. Also it is not clear that it will ever reach a uniform energy distribution. It that were inevitable then how did it get wound up in the first place?

A distribution can have a mean and still have infinite variance.

A distribution without a mean is usually not studied and does not really relate to any theory I know except in degenerate cases such as particles of definite momentum or position in Quantum Mechanics.

A Brownian motion is totally unpredictable even though it has a definite mean.

The only continuous stochastic process with independent increments is a Brownian motion.
 
Last edited:
wofsy said:
A distribution can have a mean and still have infinite variance.

Thanks for your answer. How is it possible that if all values are equally probable one may be selected as representing the most probable? Can somebody explain me this?

Thanks
 
cacosomoza said:
wofsy said:
A distribution can have a mean and still have infinite variance.

Thanks for your answer. How is it possible that if all values are equally probable one may be selected as representing the most probable? Can somebody explain me this?

Thanks

? What do you mean - if all values have equal probability - how can one be most probable?
 
The mean doesn't have to be the most probable value.

I'm not quite getting what you mean by infinite variance: usually if a distribution has a moment that is not finite we say it doesn't exist. As an (artificial) example, consider the random variable who's density is

[tex] f(x) = K \cdot \left(\frac 1 {x^3}\right), \quad x \ge 1[/tex]

Here K is the constant needed to make

[tex] \int f(x) \, dx = 1[/tex]

This has a finite mean, since [tex]x f(x)[/tex] is of the order [tex]x^{-2}[/tex], and so the required integral converges. However, the variance doesn't exist, since [tex]x^2 f(x)[/tex] is of order [tex]x^{-1}[/tex], and the required integral does not converge.
 

Similar threads

  • · Replies 12 ·
Replies
12
Views
5K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 7 ·
Replies
7
Views
28K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 13 ·
Replies
13
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 12 ·
Replies
12
Views
3K
  • · Replies 5 ·
Replies
5
Views
500
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K