Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Interclass correlation

  1. Apr 29, 2012 #1
    We have 18 subjects chosen at random, and they are rated by 6 randomly selected raters, and there is no requirement that the same rater rate all the subjects, we have a completely random one way design. Reliability is assessed with a ICC(1,1) or ICC(1) model depending on convention.
    The table looks like this

    A B C D E F (judges)

    Each judge rates 3 different subject out 18 only.

    A question: if there were 10 timeslots available for the subjects was it really necessary to have 6 judges?

    I am not sure what the question aks. In particular the part about the timeslots. Is the question asking to rate the subjects in repeated measures?
  2. jcsd
  3. Apr 29, 2012 #2


    User Avatar
    Science Advisor

    Hey _joey.

    I'm also not sure what you are asking. Are you trying to either guarantee some variance requirement or some requirement that each subject gets selected with some minimum probability?
  4. Apr 29, 2012 #3
    The question asks to assess the agreement between various pairs of raters rating subjects (let's say examination papers) and then it talks about 10 timeslots for this exam papers. No idea at all about the timeslot. There is probably some trick to it.
  5. Apr 29, 2012 #4
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook