Confidence intervals in psychological tests

  • Thread starter Thread starter DrDu
  • Start date Start date
  • Tags Tags
    intervals
AI Thread Summary
The discussion centers on the validity of applying confidence intervals to psychological tests, particularly IQ tests. It highlights the challenges in determining a "true IQ" for individuals, as factors like fatigue, drug use, or emotional states can influence test results. The concept of confidence intervals is clarified as a measure of uncertainty, typically used to reflect how an individual's score relates to a broader sample population rather than indicating a fixed score for the individual. The conversation emphasizes that confidence intervals are based on the variability of scores within a sample and are not applicable to individual results in a straightforward manner. Ultimately, the discussion raises questions about the methodology behind calculating confidence intervals in psychological assessments, particularly when repeatability is an issue.
DrDu
Science Advisor
Messages
6,405
Reaction score
1,002
Recently I saw the results of an IQ test given with confidence intervals. While I know very well what a confidence interval is, I am not sure how you can give one for a psychological test. I think to determine a CI you either have to know the "true IQ" of an ensemble of persons and see how the results of the test scatter. Or you must be able to repeat the test with the same person and see how the results scatter on repetition. However, you neither know the true IQ nor can you repeat the same test with the same person as it will remember previous results.
 
Biology news on Phys.org
IQ is an ambiguous term, so it seems doubtful that there is a "true" IQ that is always the same for that person. If the person is very very tired, for example, it can skew the results. Or if the person is on a drug. Or in love. Or whatever. In any case, even if you did know the true IQ, you wouldn't need a confidence interval. Confidence intervals are used because one is uncertain. As for what specific data they used for their confidence interval, you'll have to get that from the researcher. It's hard to discuss data we're in the dark about.
 
I know that the IQ can vary. My question is not specific to the IQ but how you define confidence intervals in general for psychologic quantifiers where you have problems with repeatability for one subject.
 
The confidence interval would refer to the sample population and NOT the individual. The test score is what the individual received with a margin of error

It describe the score one receives on his/her IQ test of being part a sample and how reflective it is to the whole population.

In other words it is comparing a sample population, of which the testee is part of, to the whole population, and then asking if the testee then does belong to a sample, of all the samples that can be taken of the population, reflecting the parameters of the population, or not.
 
Deadly cattle screwworm parasite found in US patient. What to know. https://www.usatoday.com/story/news/health/2025/08/25/new-world-screwworm-human-case/85813010007/ Exclusive: U.S. confirms nation's first travel-associated human screwworm case connected to Central American outbreak https://www.reuters.com/business/environment/us-confirms-nations-first-travel-associated-human-screwworm-case-connected-2025-08-25/...
Chagas disease, long considered only a threat abroad, is established in California and the Southern U.S. According to articles in the Los Angeles Times, "Chagas disease, long considered only a threat abroad, is established in California and the Southern U.S.", and "Kissing bugs bring deadly disease to California". LA Times requires a subscription. Related article -...
I am reading Nicholas Wade's book A Troublesome Inheritance. Please let's not make this thread a critique about the merits or demerits of the book. This thread is my attempt to understanding the evidence that Natural Selection in the human genome was recent and regional. On Page 103 of A Troublesome Inheritance, Wade writes the following: "The regional nature of selection was first made evident in a genomewide scan undertaken by Jonathan Pritchard, a population geneticist at the...
Back
Top