1. Limited time only! Sign up for a free 30min personal tutor trial with Chegg Tutors
    Dismiss Notice
Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Homework Help: Intraclass Correlation Coefficient (ICC) the appropriate method?

  1. Mar 3, 2014 #1
    1. The problem statement, all variables and given/known data
    I wish to determine whether a SINGLE instrument provides reliable measures (test-retest reliability). This single instrument is not random (it's the only one available), and I will take 10 measurements for each individual that is part of a control group (and then again for each individuals that is part of the treatment group).

    2. Relevant equations

    3. The attempt at a solution
    I am reading a lot about intraclass correlation coefficient (ICC) but they all appear to require several different raters in packages such as SPSS. I am confused about whether I should use the ICC computed using SPSS or if I should fit a random effects model to directly calculate the ICC (or maybe they're the same thing?).

    For the ICC, I was thinking of using ICC(3,10) by averaging the 10 observations. However, I am baffled as to how to specify ICC when I want to look at single measures - the documentation I've found for ICC(3,1) doesn't look like it allows for repeated measures for individuals.

    For the random effects model, I would have 10 repeated measures for each individual, each as a linear combination of the group mean, the individual mean, plus an error that depends on the instrument. However, there may be interaction with the group, individual, and instrument so this may turn into a multilevel model. In that case, I'm not sure how reliability can be determined, and whether I can obtain confidence intervals for that.

    Please advise on which method would be more appropriate. Thanks!
  2. jcsd
  3. Mar 5, 2014 #2
    Sorry for double-posting. The problem has been solved.
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook

Have something to add?
Draft saved Draft deleted