Why is the variance of the Parzen density estimator infinite?

Click For Summary
SUMMARY

The variance of the Parzen density estimator, defined as [tex]p(x) = {\frac{1}{n}}\sum_{i=1}^{n}\delta(x-x_i)[/tex], is infinite due to the properties of the Dirac delta function and the nature of the underlying random variable [tex]X[/tex]. Specifically, this occurs when the variance of [tex]X[/tex] is infinite, which is characteristic of distributions such as the Cauchy or Pareto distributions. The integral involved in the variance calculation does not converge, leading to this infinite variance scenario.

PREREQUISITES
  • Understanding of the Dirac delta function
  • Familiarity with variance and its calculation in probability theory
  • Knowledge of continuous random variables
  • Basic concepts of probability distributions, particularly Cauchy and Pareto distributions
NEXT STEPS
  • Study the properties of the Dirac delta function in probability theory
  • Learn about the Cauchy distribution and its implications for variance
  • Explore the Pareto distribution and its applications in statistics
  • Investigate the concept of infinite variance and its practical implications in statistical modeling
USEFUL FOR

Statisticians, data scientists, and researchers interested in advanced probability theory and those working with distributions that exhibit infinite variance, such as the Cauchy and Pareto distributions.

crbazevedo
Messages
7
Reaction score
0
Hello everyone,

I'm new to this forum and I'm glad to have found such a high quality resource where we can have such valuable guidance and discussions.

I've read somewhere that the variance of p(x) = {\frac{1}{n}}\sum_{i=1}^{n}\delta(x-x_i) \forall x \in \Re[\tex], <br /> <br /> in which D_n = \left\{x_1, \cdots, x_n\right\}[\tex] independent realizations of a continuous random variable X[\tex], and \delta[\tex] is the dirac delta function, is infinite, irrespective to n[\tex] and D_n[\tex]. &amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt; &amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt; My questions are straightforward: &amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt; &amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt; 1) Why is that (my guess that the integral involved in the variance calculation does not converge)?; &amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt; &amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt; 2) What does it mean to have infinite variance in practical terms?; &amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt; &amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt; 3) Any practical examples where a distribution with infinite variance would be useful?; &amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt; &amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt; Please note that I don&amp;amp;amp;amp;amp;#039;t have a strong background in statistics.&amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt; &amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt; Any help will be much appreciated.&amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt; &amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt; Cheers,&amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt; Carlos
 
Last edited:
Physics news on Phys.org
crbazevedo said:
I've read somewhere that the variance of p(x) = {\frac{1}{n}}\sum_{i=1}^{n}\delta(x-x_i) \forall x \in \Re[\tex], <br /> <br /> in which D_n = \left\{x_1, \cdots, x_n\right\}[\tex] independent realizations of a continuous random variable X[\tex], and \delta[\tex] is the dirac delta function, is infinite, irrespective to n[\tex] and D_n[\tex]. &amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt;
&amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt; &amp;amp;amp;amp;lt;br /&amp;amp;amp;amp;gt; Assuming you mean to find the variance of &amp;amp;amp;amp;lt;i&amp;amp;amp;amp;gt;the random variable with density&amp;amp;amp;amp;lt;/i&amp;amp;amp;amp;gt; p(x), this would be infinite only if the variance of X is infinite (for example if X has the Cauchy or Pareto distribution).
 

Similar threads

  • · Replies 12 ·
Replies
12
Views
5K
Replies
1
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 11 ·
Replies
11
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
Replies
0
Views
1K