Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Number of Tests and Accuracy. Criteria?

  1. Mar 24, 2012 #1

    Bacle2

    User Avatar
    Science Advisor

    Hi, All:

    I have the following problem:

    My department head wants to accurately estimate class attendance, as a measure

    of the effectiveness of my teaching. For that, I used to take attendance weekly, i.e., once

    each week, selecting the day at random, from which I would construct a confidence interval

    at the end of the year. The department head wants me to switch from counting weekly to

    doing so bi-weekly, since she must enter the data in the computer , submit, etc. I think

    this is not a good idea, and I told her so.


    I wonder what criterion I could use to argue that this swich is likely to cause a

    non-trvial distortion in the estimate of the true mean weekly attendance.

    What I have considered, so far:

    1) I take the mean of all weekly attendance values, and I construct

    a confidence interval. Problem (for me) is that the confidence interval will become

    wider as N:= sample-size decreases. So, fewer measurements means smaller accuracy.

    2) Trying a difference-of-means test, between the weekly measurements and the

    biweekly measurements, and showing that the initial hypothesis is not accepted

    at, say, a 95% confidence level.

    3)Just a general argument that the Law of Large numbers suggests that more

    measurements I get , the more accurate the estimate will be.


    Do my arguments work? Should I consider anything else?

    Thanks for Your Suggestions.
     
  2. jcsd
  3. Mar 25, 2012 #2

    Stephen Tashi

    User Avatar
    Science Advisor

    If we consider all class days to have the same distribution of attendance, number 2 is the only one that sounds reasonable and if you go to the trouble of doing that, you are proving that you can handle taking bi-weekly attendance.

    Take attendance every class and report the highest two numbers every week. (Say that you thought "statistics as ordered" meant "order statistics".)

    If we consider the class days to have different distributions of attendance then taking bi-weekly sampling is a "sampling without replacement". I doubt this line of thinking has any practical implications for your dilemma, but it is interesting to contemplate.
     
  4. Mar 25, 2012 #3

    chiro

    User Avatar
    Science Advisor

    I would also suggest that you may even want to do some kind of paired analysis.

    The reason I suggest this is because if certain students have a pattern of missing attendance then this information would be useful for you in demonstrating that this kind of behavior might be attributed more to the student than yourself.

    If you had say a pattern of behavior where students with poor attendence history were unique with respect to other students that had high attendence history then even if you had some significant amount of people who didn't show up for class at all for the majority of the teaching period, then this would reflect more the student than yourself and it's important to take these kinds of things into account because if you didn't, the person you're under in the food chain will look at the statistic and then say 'this guy sucks' when given the other information, the person above you would say 'we seem to be accepting students that don't give a hoot' and that then becomes a separate administrative issue.

    I'm sure there are more things like this but to me considering this is used to evaluate you, I thought it was important to bring it up.
     
Know someone interested in this topic? Share this thread via Reddit, Google+, Twitter, or Facebook