Is group mean and overall mean independent?

In summary: I don't know.variance of the global mean and the group means?I would have guessed it was most likely the variance of the global...I don't know.
  • #1
colstat
56
0
In an ANOVA experiment, you have,
group mean [itex]\overline{y}[/itex].
overall mean [itex]\overline{y}[/itex]..

Are they independent?
Some samples overlap to calculate these means.

What is var([itex]\overline{y}[/itex].-[itex]\overline{y}[/itex]..) ?
 
Last edited:
Physics news on Phys.org
  • #2
You mean under the null hypothesis, I presume. No, they're not independent, for the reason you give.
 
  • #3
What is var([itex]\overline{y}[/itex].-[itex]\overline{y}[/itex]..) ?
 
  • #4
Umm, I'd have to look it up or work it out, and I'm too lazy to do that right now. But you should be able to find it in any stats book.
 
  • #5
Ok. Is it something like this?
var([itex]\overline{y}[/itex].) + var([itex]\overline{y}[/itex]..) + something else?
 
  • #6
colstat said:
Ok. Is it something like this?
var([itex]\overline{y}[/itex].) + var([itex]\overline{y}[/itex]..) + something else?
Well, in general Var(a-b) = Var(a) + Var(b) - 2Cov(a,b), so you could write it in the form you give. But there's also a more precise formula in this case based on partitioning the sums of squares that contribute to the distinct variances.
 
  • #7
what is 2Cov(a,b) in this case?
 
  • #8
colstat said:
what is 2Cov(a,b) in this case?
Cov(a,b) is the covariance of a and b, [itex]\mathbb{E}\left[\left(a-\mu_a\right)\left(b-\mu_b\right)\right][/itex]. Is that what you're asking, or are you asking me what it actually evaluates to when [itex]a=\overline{y}_{.}[/itex] and [itex]b=\overline{y}_{..}[/itex]?
 
  • #9
evaluation.
 
  • #10
colstat said:
evaluation.
Write [itex]\overline{y}_{..}[/itex] as a linear combination of the [itex]\overline{y}_{.}[/itex]. Now use Cov(a,b+c) = Cov(a,b) + Cov(a,c) to expand it. The [itex]\overline{y}_{.}[/itex] are all independent (under the null hypothesis), so all the cross covariances vanish. Cov(a, a) = Var(a), and Var(a/n) = Var(a)/n^2.
 
  • #11
The book gives standard error: s[itex]\sqrt{1/n.-1/N}[/itex], where s = [itex]\sqrt{MSE}[/itex]

How do I go from standard error to variance?
 
Last edited:
  • #12
colstat said:
The book gives standard error: s[itex]\sqrt{1/n.-1/N}[/itex], where s = [itex]\sqrt{MSE}[/itex]

How do I go from standard error to variance?
The square of a standard error is an estimate (usually unbiased) of the variance of whatever it's the standard error of.
 
  • #13
pmsrw3 said:
The square of a standard error is an estimate (usually unbiased) of the variance of whatever it's the standard error of.

I didn't get the last part of your sentence, are you saying standard error squared is variance?
 
  • #14
colstat said:
I didn't get the last part of your sentence, are you saying standard error squared is variance?
Yes, standard error squared is (an estimate of) variance. But the variance of what? The last part of the sentence was concerned with that.

In general, if you do an ANOVA or a regression, you'll get a bunch of standard errors. You get an SE for the overall mean, you get an SE for each group mean, if it's a multilevel or two-way ANOVA there will be some more SEs, and if it's a regression there'll be an SE for each coefficient. If I give you a number and I tell you it's the standard error of coefficient 2, then you know that the square of that number is an estimate of the variance of coefficient 2. And so on, for all the other SEs. That's what I meant.
 
  • #15
I thought standard deviation squared is variance. So, does standard deviation not exist, or are they just the same thing?
 
  • #16
A standard error is a kind of a standard deviation. But usually "standard deviation" is used for the sample measurements themselves, whereas "standard error" is for estimators. For instance, if you have 4 measurements, y1 - y4, the square of the standard deviation is an estimate of the variance of anyone of the yi. The square of the standard error of the mean (which is half the standard deviation) is an estimate of the variance of the mean of the four y's.
 
  • #17
so, is this correct? var([itex]\overline{y}[/itex]i.-[itex]\overline{y}[/itex]..) = s2(1/ni-1/N)
 
  • #18
I'm really not sure without working it out or looking it up. You said your book said that was SE, but you didn't say what it's the SE of. I don't do ANOVA so often that I have all the formulas in my head (and anyway, I rely on a computer for the actual calculations, like any sensible person).
 
  • #19
umm, I think it should be right with the following sources I looked up:

1. "Applied Linear Regression Models" 5th by Kutner and Li P738 Example
2. "A First Course in Design and Analysis of Experiments" by Oehlert P44 top box and P43 bottom, free pdf on Oehlert's page.
 
  • #20
colstat said:
umm, I think it should be right...
Of course it's RIGHT, but what is it? You said it's "the standard error". The standard error of WHAT? And why do you think this particular SE should be the variance of the difference between the global mean and the group means? I would have guessed it was most likely the variance of the global mean.
 
  • #21
Here is the pdf that contains the SE. Page 44.
 

1. What is the difference between group mean and overall mean?

The group mean refers to the average of a specific group or subset of data, while the overall mean is the average of the entire dataset. The group mean is a more specific measure, while the overall mean provides a general overview of the data as a whole.

2. Are group mean and overall mean calculated in the same way?

Yes, both group mean and overall mean are calculated by adding up all the values in the dataset and dividing by the number of values. The only difference is that the group mean is calculated for a specific group within the dataset, while the overall mean is calculated for the entire dataset.

3. How do you determine if group mean and overall mean are independent?

The independence of group mean and overall mean can be determined by analyzing the data and looking for any patterns or relationships between the two. If there is no significant relationship or correlation between the two, then they can be considered independent.

4. Can group mean and overall mean have the same value?

Yes, it is possible for the group mean and overall mean to have the same value. This can happen if the group being analyzed is the entire dataset, in which case the group mean would be equal to the overall mean.

5. Why is it important to understand the independence of group mean and overall mean?

Understanding the independence of group mean and overall mean is important because it allows for a more accurate and comprehensive analysis of the data. If the two are not independent, it can lead to misleading conclusions and inaccurate interpretations of the data.

Similar threads

  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
815
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
6
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
625
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
5
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
6
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
4
Views
778
  • Set Theory, Logic, Probability, Statistics
Replies
10
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
26
Views
2K
Back
Top