Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Is group mean and overall mean independent?

  1. Jul 17, 2011 #1
    In an ANOVA experiment, you have,
    group mean [itex]\overline{y}[/itex].
    overall mean [itex]\overline{y}[/itex]..

    Are they independent?
    Some samples overlap to calculate these means.

    What is var([itex]\overline{y}[/itex].-[itex]\overline{y}[/itex]..) ?
    Last edited: Jul 17, 2011
  2. jcsd
  3. Jul 17, 2011 #2
    You mean under the null hypothesis, I presume. No, they're not independent, for the reason you give.
  4. Jul 17, 2011 #3
    What is var([itex]\overline{y}[/itex].-[itex]\overline{y}[/itex]..) ?
  5. Jul 17, 2011 #4
    Umm, I'd have to look it up or work it out, and I'm too lazy to do that right now. But you should be able to find it in any stats book.
  6. Jul 18, 2011 #5
    Ok. Is it something like this?
    var([itex]\overline{y}[/itex].) + var([itex]\overline{y}[/itex]..) + something else?
  7. Jul 18, 2011 #6
    Well, in general Var(a-b) = Var(a) + Var(b) - 2Cov(a,b), so you could write it in the form you give. But there's also a more precise formula in this case based on partitioning the sums of squares that contribute to the distinct variances.
  8. Jul 18, 2011 #7
    what is 2Cov(a,b) in this case?
  9. Jul 18, 2011 #8
    Cov(a,b) is the covariance of a and b, [itex]\mathbb{E}\left[\left(a-\mu_a\right)\left(b-\mu_b\right)\right][/itex]. Is that what you're asking, or are you asking me what it actually evaluates to when [itex]a=\overline{y}_{.}[/itex] and [itex]b=\overline{y}_{..}[/itex]?
  10. Jul 18, 2011 #9
  11. Jul 18, 2011 #10
    Write [itex]\overline{y}_{..}[/itex] as a linear combination of the [itex]\overline{y}_{.}[/itex]. Now use Cov(a,b+c) = Cov(a,b) + Cov(a,c) to expand it. The [itex]\overline{y}_{.}[/itex] are all independent (under the null hypothesis), so all the cross covariances vanish. Cov(a, a) = Var(a), and Var(a/n) = Var(a)/n^2.
  12. Jul 18, 2011 #11
    The book gives standard error: s[itex]\sqrt{1/n.-1/N}[/itex], where s = [itex]\sqrt{MSE}[/itex]

    How do I go from standard error to variance?
    Last edited: Jul 18, 2011
  13. Jul 18, 2011 #12
    The square of a standard error is an estimate (usually unbiased) of the variance of whatever it's the standard error of.
  14. Jul 18, 2011 #13
    I didn't get the last part of your sentence, are you saying standard error squared is variance?
  15. Jul 18, 2011 #14
    Yes, standard error squared is (an estimate of) variance. But the variance of what? The last part of the sentence was concerned with that.

    In general, if you do an ANOVA or a regression, you'll get a bunch of standard errors. You get an SE for the overall mean, you get an SE for each group mean, if it's a multilevel or two-way ANOVA there will be some more SEs, and if it's a regression there'll be an SE for each coefficient. If I give you a number and I tell you it's the standard error of coefficient 2, then you know that the square of that number is an estimate of the variance of coefficient 2. And so on, for all the other SEs. That's what I meant.
  16. Jul 18, 2011 #15
    I thought standard deviation squared is variance. So, does standard deviation not exist, or are they just the same thing?
  17. Jul 18, 2011 #16
    A standard error is a kind of a standard deviation. But usually "standard deviation" is used for the sample measurements themselves, whereas "standard error" is for estimators. For instance, if you have 4 measurements, y1 - y4, the square of the standard deviation is an estimate of the variance of any one of the yi. The square of the standard error of the mean (which is half the standard deviation) is an estimate of the variance of the mean of the four y's.
  18. Jul 18, 2011 #17
    so, is this correct? var([itex]\overline{y}[/itex]i.-[itex]\overline{y}[/itex]..) = s2(1/ni-1/N)
  19. Jul 18, 2011 #18
    I'm really not sure without working it out or looking it up. You said your book said that was SE, but you didn't say what it's the SE of. I don't do ANOVA so often that I have all the formulas in my head (and anyway, I rely on a computer for the actual calculations, like any sensible person).
  20. Jul 18, 2011 #19
    umm, I think it should be right with the following sources I looked up:

    1. "Applied Linear Regression Models" 5th by Kutner and Li P738 Example
    2. "A First Course in Design and Analysis of Experiments" by Oehlert P44 top box and P43 bottom, free pdf on Oehlert's page.
  21. Jul 18, 2011 #20
    Of course it's RIGHT, but what is it? You said it's "the standard error". The standard error of WHAT? And why do you think this particular SE should be the variance of the difference between the global mean and the group means? I would have guessed it was most likely the variance of the global mean.
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook