To find mean wedivide the sum of no.s with 'n'for variance why 'n-1'

  • Context: Undergrad 
  • Thread starter Thread starter dexterdev
  • Start date Start date
  • Tags Tags
    Mean Sum Variance
Click For Summary

Discussion Overview

The discussion revolves around the differences in calculating the mean and variance in statistics, specifically why variance is calculated using 'n-1' instead of 'n'. The scope includes theoretical explanations and concepts related to statistical estimators and degrees of freedom.

Discussion Character

  • Technical explanation
  • Conceptual clarification
  • Debate/contested

Main Points Raised

  • Devanand T questions why variance is calculated using 'n-1' instead of 'n', contrasting it with the calculation of the mean.
  • Some participants note that the formula for "sample variance" varies across texts, with many preferring 'n-1' for an unbiased estimator of population variance.
  • Another participant mentions that different degrees of freedom (n-1, n-2, n-4) can appear in statistics, depending on the number of parameters being estimated.
  • A participant attempts to explain that using 'n-1' accounts for the loss of one degree of freedom when estimating the population variance from a sample mean.
  • There is a discussion about the terminology surrounding "sample variance" and its implications for understanding the variance of a sample versus that of a population.

Areas of Agreement / Disagreement

Participants express varying levels of understanding regarding the concepts of unbiased estimators and degrees of freedom, with no consensus reached on the terminology or the implications of using 'n' versus 'n-1' in variance calculations.

Contextual Notes

The discussion highlights the complexity of statistical definitions and the potential for confusion regarding terminology, particularly in relation to unbiased estimators and degrees of freedom.

dexterdev
Messages
194
Reaction score
1
Hi all,
For finding average we take the sum of sequence numbers and divide by the number of elements. Why for variance this changes to number of elements minus 1.

-Devanand T
 
Physics news on Phys.org
The definition of the formula for the "sample variance" varies from book to book. Many books prefer the formula that uses division by n-1 because this is also the formula for the "unbiased estimator" of the population variance. Do you know about the definition of an "unbiased" estimator? - or the definition of an "estimator" for that matter?
 
To add to what Stephen Tashi said, there are general formulas for an arbitrary number of degrees of freedom.

If you do enough statistics you'll see n-1, n-2, n-4 instead of n-1 and the reason is because you are estimating a quantity using p known parameters which is why you divide by n-p to get un-biased estimator.

You'll learn this when you look at degrees of freedom in depth.
 
Thank you guys , I will see what an estimator and degrees of freedom etc...No idea on these.
 
Let me try to show why n-1 is right in certain situations.
Suppose there is a total population N with unknown mean μ and variance σ2. From this, you draw a sample S = {xi} of size n. You can calculate the mean μS = Ʃxi/n and variance σ2S = Ʃ(xiS)2/n of the sample (just treated as a set of numbers).
Consider the function VS(y) = Ʃ(xi-y)2/n.
If somehow you knew the real value of μ you could write down an unbiased estimate for σ2 as VS(μ).
The mean of the sample, μS, is that number y which minimises VS(y). Since the true mean of the population is likely to be a little different, VS(μ) tends to be greater than VSS).
One way to think of this is that taking all the samples relative to μS removes one degree of freedom, leaving only n-1 degrees for how the samples are scattered around it.
Anyway, it's not hard to show that σ2S*n/(n-1) is the least biased estimator for σ2.
Sadly, the terminology is very misleading. "Sample variance" generally refers to the estimated variance of the population given the sample (i.e. the n-1 form), when it sounds like it should be the variance of the sample taken as an abstract set of numbers (the n form).
 
  • Like
Likes   Reactions: 1 person

Similar threads

  • · Replies 1 ·
Replies
1
Views
439
  • · Replies 7 ·
Replies
7
Views
6K
  • · Replies 6 ·
Replies
6
Views
2K
Replies
5
Views
6K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 11 ·
Replies
11
Views
2K
  • · Replies 18 ·
Replies
18
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K