Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

A GCSE Physics Question from the UK


Is there a correlation?

Poll closed Dec 28, 2006.
  1. Yes

  2. No

  1. Dec 14, 2006 #1
    I have no idea if this is the right forum for this, but I'd genuinely like to hear what real scientists think of this question which is taken from a GCSE Physics test paper.

    Frances claims she can read people's minds. She asks them to think of a number.
    She says she can tell whether they are thinking of an even or odd number.

    She tried this out on 8 of her friends. She repeated it 4 times with each one. These are the results

    Friend / No of correct readings (out of 4)
    A 1
    B 4
    C 3
    D 2
    E 1
    F 3
    G 3
    H 2

    She says it is only people with dark hair who are telepathic. They give out "tele-waves". Friends B, C, F and G have dark hair.

    Is there a correlation between having dark hair and being telepathic YES/NO
    Last edited: Dec 14, 2006
  2. jcsd
  3. Dec 14, 2006 #2
    Although by no means conclusive I'd say that according to that data there appears to be a correlation. Of course she would need to do it on a lot more friends before she could publish her results!
  4. Dec 14, 2006 #3
    Interesting - and right at the heart of what "correlation" means.

    If 6 people toss a head and 2 people toss a tail, and you then notice that the 6 who tossed heads happen to be wearing shorts, does that mean you can claim a correlation between wearing shorts and tossing heads?:biggrin:

    If scientists start writing their hypothesis AFTER they have the test data, we're in for some very dodgy claims:eek:

    Further, if a scientist was to claim that from a sample of 32 people, 13 had got cancer and the same 13 took baths whilst the others showered, so there was a correlation between taking a bath and getting cancer, I think we'd all be concerned

    My dictionery (oxford) defines correlation as "a relationship in which one thing affects or depends on another" - clearly that isn't true
    Last edited: Dec 14, 2006
  5. Dec 14, 2006 #4
    Well if you forget the ridiculousness of the context and look at the raw data alone you'd be silly to deny a correlation. In my field (geophysics and geology) you often have to make conclusions based on little data/poor observations. Of course you always have to be aware of the pitfalls of misleading data and have to test your conclusions wherever possible. I suppose its harder in a subject where there is not necessarily a 'right' answer.
  6. Dec 14, 2006 #5
    The trouble is you can't ignore the context, and particularly in an exam which is designed to educate kids about the potential and limitations of scientific discovery.

    In my road all the houses with red doors have oil spots on the drive, so there's a clear correlation (as long as I ignore the fact that only houses with red doors own cars!)

    My dictionery (oxford) defines correlation as "a relationship in which one thing affects or depends on another" - clearly that isn't true
    Last edited: Dec 14, 2006
  7. Dec 14, 2006 #6


    User Avatar
    Science Advisor
    Homework Helper

    One way of testing the hypothesis: assume the guesses are random and calculate the expected number of people scoring 0 to 4 guesses. Compare with the observations:

    Score: Frequency: Expected frequency if results were random
    0 0 0.5
    1 2 2
    2 2 3
    3 3 2
    4 1 0.5

    You could do a standard statistical test (Chi-squared) but it's pretty clear what the result would be: there's no reason to believe the results were non-random.

    "If scientists start writing their hypothesis AFTER they have the test data, we're in for some very dodgy claims"...

    Of course scientists often invent a hypothesis after they have done an experiment. But they then go on to do MORE experiments to test if the hypothesis is true or not. In this case, having created the hypotheses about dark hair, she should then test other people - preferably without knowing what their hair colour is, e.g. by being in a different room from them.
  8. Dec 14, 2006 #7
    I guess that's true in the real world, although I'd rather say that scientists make observations from empirical data after which they formulate a hypothesis which they go on to test.

    This example looks to be a case of creating the hypothesis to fit the existing data and that never happens (unless you're performing clinical trials and are on retainer:devil: )
  9. Dec 14, 2006 #8
    "My dictionery (oxford) defines correlation as "a relationship in which one thing affects or depends on another" - clearly that isn't true."

    In my opinion a good scientist will not shut off the possibility based on their body of knowledge, after all knowledge can be a fragile thing.
  10. Dec 14, 2006 #9
    Agreed, but remember who the question was aimed at - 15 year olds who don't have the knowledge or experience to be able to make very sophisticated judgements about the "reasonability" of the data.

    You or I might play the lottery for fun, but with no real expectation of winning, but a scary number of people when you explain there is a 1 in 14Million chance say "agh but somebody's got to win it!"

    Try telling any 15 year old that you've just tossed 10 heads in a row, how likely is the next toss to be a head, and most will "reason" that it must be time for a tail by now!:surprised
  11. Dec 14, 2006 #10
    Well I'd be interested to know what the 'right' answer is. If exactly the same data were presented but they changed the words to I dunno, something about springs and it turned out that all the springs that could bear the heaviest loads were also springs with the thickest coil. Then clearly the right answer would be "yes" there's a correlation, but that's because there's a model that can explain that. Just because we can't explain this paranormal stuff doesn't mean we should just write it off without giving further investigation (although I personally wouldn't spend a minute of my time studying it!).
  12. Dec 15, 2006 #11
    Well the "right" answer is Yes, but I can't agree with it, and it isn't because I'm dismissing any paranormal event, It's because it's irresponsible to start drawing any conclusions from such limited data, and frankly it's stupid to have a yes/no answer.

    I think this discussion shows that you can justify either answer, and for me the A* answer would be

    "Although from the data there appears to be a strong relationship between hair colour and the ability to read minds, the sample is far too small and a blind test involving a hundereds or even thousands of people would be necessary before any correlation could be claimed. Additionally, as the hair colour claim was only made after the data was studied and not before conducting the experiment, it is only an observation and further work needs to be done to find other (more rational) explinations for the relationship"
  13. Dec 15, 2006 #12
    I thought of a much better reason why there is no correlation.

    By random chance you should score 50%
    Those with dark hair scored 81%
    The rest scored 37%

    If you combine them all, it comes out at 59% which is within the margins of 50% given the small sample size.

    If however you are going to claim telepathy is the justification for the "over achieving" of the dark haired friends, how can you explain the failure of the rest which should have come out at 50% even though no telepathy was involved. Both groups are equidistant from the mean so neither set of results has significance
  14. Dec 15, 2006 #13


    User Avatar
    Staff Emeritus
    Science Advisor
    Gold Member

    If p is the probability per trial to get it right, then the distribution for 4 trials is:

    P(0) = (1-p)^4
    P(1) = (1-p)^3 p 4
    P(2) = (1-p)^2 p^2 6
    P(3) = (1-p) p^3 4
    P(4) = p^4

    For the dark-haired people, the probability to get 4, 3, 3 and 3 is then:
    P_sample = P(4).P(3)^3 = p^(4+3x3) (1-p)^3 64
    This function peaks at p = 13/16, so the maximum-likelyhood estimator for p is 13/16. The ratio between f[13/16] (the "maximum likelyhood" estimator) and f[0.5] is 30. This means that the data are 30 times less probable with p = 1/2 than with p = 13/16.

    Hence, the set of data is rather in favor of p not equal 1/2 for the set of dark-haired people, although there is still 3% chance for this to be so.

    For the complementary set, 1, 2, 1, 2 we have P(1)^2 P(2)^2
    P_sample = (1-p)^10 p^6 16x36

    The maximum-likelyhood estimator here is p = 3/8.
    The ratio of p=1/2 over p=3/8, this time, is simply 0.6. So the data are 60% as likely to come from p=1/2 as they are from p=3/8. In other words, p=1/2 is entirely plausible.

    In other words, the claim seems to be true: the second sample is entirely compatible with p=1/2, while the first set of data has only 1/30 the chance to come from p=1/2, as compared to p = 13/16.

    Telepathy works, with a confidence interval of 97%.
    Last edited: Dec 15, 2006
  15. Dec 15, 2006 #14


    User Avatar
    Science Advisor
    Homework Helper

    That's not a valid conclusion unless we know more about the design of the experiment. Most likely, the process was:

    1. Do the experiment on 8 people chosen at random
    2. Select the 4 people with the highest scores and the 4 with the lowest scores.
    3. Finally, look for some difference between those two groups of 4, to "explain" the difference.

    In this case, you can't conclude anything. The reason is that there are thousands of possible differences that you could find between two random groups of 4 people, so you are guaranteed to find some difference, if you keep looking for long enough.

    All you have shown with your statistical test is that there is a difference in scores between the 4 people with the highest scores and the 4 people with the lowest scores. That's not a very surprising conclusion.

    A better test would be to find the probability distribution of the highest 4 scores chosen from 8, and compare that with the highest 4 scores in the experiment. If there is a real effect, you would expect these particular four people to do better than the expected value for the best 4 from 8.
  16. Dec 16, 2006 #15
    That was EXACTLY the process AlephZero, so you can always find some hypothesis to fit the data. If it hadn't been hair colour it could have been eye colour or shoe size or who had toast for breakfast etc etc...

    It's scary that this is being TAUGHT as GCSE Science!
  17. Dec 16, 2006 #16


    User Avatar

    Doubtless those who devise such courses and exams think that real science is dull and boring and telepathy might appeal more to kids.

    The question might have intended simply to check whether the students understand that the small sample size makes the data at best unrelaiable and at worst useless - but then it's either a 'science' question or a statistics question - it has nothing to do with physics in particular.

    (In the UK, at GCSE - ages 14-16 - many students are now obliged to study what's called 'co-ordinated science' - which counts as a double subject and covers phys, chem and bio - ie roughly 2/3 the content of each. Only when they reach post-16 eductation do those students get to choose which sciences they want to study.

    Also, for those who are not in the UK, there has been much debate here recently about a new science curriculum which many believe is little more than the discussion of popular science issues - without much in the way of real science content.


    Sorry for diverting the thread, but it's something that really annoys me....)
  18. Dec 16, 2006 #17
    no it's great that 16 year olds are being taught to recognise bad science. iirc gcse science is big on hypothesis testing and other basic principles of science
  19. Dec 16, 2006 #18


    User Avatar
    Staff Emeritus
    Science Advisor
    Gold Member

    That would be cheating. I thought it was: we claim that there is telepathy in the case of darkhaired people, so we take a sample of 8 people, 4 of which are dark-haired, and then do the test.
    Of course, if other combinations are "people with red pull-overs", "people with green eyes", etc... then you can conclude anything from anything.
    But I'm affraid that we are having prejudices here, because obviously telepathy is not to have had, and we try to find good reasons why the correlation is bogus. If the test was about the effectivity of a protective oil against sun burning, I wonder if one would be so critical. So in fact, what one is doing here is not a maximum-likelyhood estimator, but a Bayesian estimator with a big a priori for p=0.5.

    So WE are doing bad science here: we want to enforce the conclusion that there is NO correlation, irrespective of the data, and then try to find an excuse of why the obvious correlation in the data must be explained away.
  20. Dec 16, 2006 #19
    the question implies the dark haired hypothesis comes after the experiment and so this is bad science. the students will get marks if they spot this.

    this is what i understand it to mean (and i have taught GCSE science in the UK)
  21. Dec 16, 2006 #20


    User Avatar

    Why is it bad science to come up with a hypothesis after looking at experimental or statistical data?

    Surely the problem here is the sample size and the fact that other factors have not been considered?
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook