Confidence intervals in psychological tests

  • Thread starter Thread starter DrDu
  • Start date Start date
  • Tags Tags
    intervals
AI Thread Summary
The discussion centers on the validity of applying confidence intervals to psychological tests, particularly IQ tests. It highlights the challenges in determining a "true IQ" for individuals, as factors like fatigue, drug use, or emotional states can influence test results. The concept of confidence intervals is clarified as a measure of uncertainty, typically used to reflect how an individual's score relates to a broader sample population rather than indicating a fixed score for the individual. The conversation emphasizes that confidence intervals are based on the variability of scores within a sample and are not applicable to individual results in a straightforward manner. Ultimately, the discussion raises questions about the methodology behind calculating confidence intervals in psychological assessments, particularly when repeatability is an issue.
DrDu
Science Advisor
Messages
6,421
Reaction score
1,003
Recently I saw the results of an IQ test given with confidence intervals. While I know very well what a confidence interval is, I am not sure how you can give one for a psychological test. I think to determine a CI you either have to know the "true IQ" of an ensemble of persons and see how the results of the test scatter. Or you must be able to repeat the test with the same person and see how the results scatter on repetition. However, you neither know the true IQ nor can you repeat the same test with the same person as it will remember previous results.
 
Biology news on Phys.org
IQ is an ambiguous term, so it seems doubtful that there is a "true" IQ that is always the same for that person. If the person is very very tired, for example, it can skew the results. Or if the person is on a drug. Or in love. Or whatever. In any case, even if you did know the true IQ, you wouldn't need a confidence interval. Confidence intervals are used because one is uncertain. As for what specific data they used for their confidence interval, you'll have to get that from the researcher. It's hard to discuss data we're in the dark about.
 
I know that the IQ can vary. My question is not specific to the IQ but how you define confidence intervals in general for psychologic quantifiers where you have problems with repeatability for one subject.
 
The confidence interval would refer to the sample population and NOT the individual. The test score is what the individual received with a margin of error

It describe the score one receives on his/her IQ test of being part a sample and how reflective it is to the whole population.

In other words it is comparing a sample population, of which the testee is part of, to the whole population, and then asking if the testee then does belong to a sample, of all the samples that can be taken of the population, reflecting the parameters of the population, or not.
 
I've been reading a bunch of articles in this month's Scientific American on Alzheimer's and ran across this article in a web feed that I subscribe to. The SA articles that I've read so far have touched on issues with the blood-brain barrier but this appears to be a novel approach to the problem - fix the exit ramp and the brain clears out the plaques. https://www.sciencealert.com/new-alzheimers-treatment-clears-plaques-from-brains-of-mice-within-hours The original paper: Rapid amyloid-β...
https://www.discovermagazine.com/the-deadliest-spider-in-the-world-ends-lives-in-hours-but-its-venom-may-inspire-medical-miracles-48107 https://en.wikipedia.org/wiki/Versutoxin#Mechanism_behind_Neurotoxic_Properties https://www.sciencedirect.com/science/article/abs/pii/S0028390817301557 (subscription or purchase requred) The structure of versutoxin (δ-atracotoxin-Hv1) provides insights into the binding of site 3 neurotoxins to the voltage-gated sodium channel...
Back
Top