Weighted Importance in sampled data statistics

  • Context: Graduate 
  • Thread starter Thread starter X89codered89X
  • Start date Start date
  • Tags Tags
    Data Statistics
Click For Summary
SUMMARY

This discussion focuses on the calculation of weighted statistics, specifically the weighted mean and weighted sample variance, using a weight vector to adjust the importance of each sample. The weighted mean is defined as μw = Σxiwi / Σwi, while the weighted sample variance is σ2w = Σwi(xi - μw)2 / Σwi. The discussion emphasizes the need for a reliable weight vector that ranges from 0 to 1 to accurately reflect the reliability of each sample.

PREREQUISITES
  • Understanding of weighted statistics
  • Familiarity with vector notation and operations
  • Knowledge of statistical concepts such as mean and variance
  • Basic proficiency in LaTeX for mathematical representation
NEXT STEPS
  • Research the implementation of weighted statistics in Python using NumPy
  • Explore the implications of using different weight vectors on statistical outcomes
  • Learn about the applications of weighted statistics in data analysis
  • Investigate the differences between weighted and unweighted statistics
USEFUL FOR

Data analysts, statisticians, and researchers who require accurate statistical analysis of sampled data with varying reliability among samples.

X89codered89X
Messages
149
Reaction score
2
I was just wondering how exactly to appropriately modify the 1st and 2nd order stats when you want to weight a given sample more heavily. If \vec{X} is my vector of N samples and I have a weight vector \vec{W} of the same dimension, which ideally is measuring the reliability of each sample from 0 to 1. Could I calculate mean and variance using...

<br /> \vec{Y}_i= \vec{X}_i\vec{W}_i <br /> \\<br /> <br /> \mu_{x-weighted} = E[\vec{Y}]<br /> \\<br /> <br /> \sigma_{x-weighted} = E[(\vec{Y}-E[\vec{Y}])^2]<br /> \\<br /> <br />

Let me know what you think. Thanks.

EDIT: \LaTeX mods...
 
Physics news on Phys.org
The weighted mean is given by...

\mu_w = \frac{\sum x_iw_i}{\sum w_i}

The weighted sample variance is...

\sigma^2_w = \frac{\sum w_i(x_i - \mu_w)^2}{\sum w_i}
 
Hey thanks!
 

Similar threads

  • · Replies 11 ·
Replies
11
Views
3K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
4K
Replies
11
Views
6K
  • · Replies 6 ·
Replies
6
Views
6K
Replies
1
Views
2K