| Thread Closed |
Precognition paper to be published in mainstream journal |
Share Thread | Thread Tools |
| Nov19-10, 01:44 PM | #35 |
|
|
Precognition paper to be published in mainstream journal |
| Nov19-10, 06:27 PM | #36 |
|
|
). [Edit: And besides, there are easier ways to manipulate the data.]And forgive me for my confusion, but I'm not certain where you are getting the 53%? In my earlier reply, I was talking about the specific set of experiments described in the study as "Experiment 8: Retroactive Facilitation of Recall I" and "Experiment 9: Retroactive Facilitation of Recall II." These are the experiments where participants are asked to memorize a list of words, and try to recall the words. Then later, a computer generated random subset of half the total words are given to the subjects to perform "practice exercises" on, such as typing each word. The study seems to show that the words recalled are correlated to the random subset of "practice" words that was generated after the fact. Those are the only experiments I was previously discussing on this thread. I haven't even really looked at any of the other experiments in the study. To demonstrate the statistical relevance further, I've modified my C# a little bit to add some more information. I've attached it below. Now it shows how many of the simulated experiments produce a DR% that is greater than or equal to the DR% reported in the study. My results show 1 in 56 chance, and a 1 in 300 chance, for achieving a DR% that is greater than or equal to the mean DR% reported in the study, for the first and second experiment respectively (the paper calls them experiment 8 and experiment 9). The program simulated 10000 experiments in both cases -- the first with 100 participants per experiment, the second with 50, as per the paper. Here are the possible choices of interpretations, as I see them: (I) The author of the paper might really be on to something. This study may be worth further investigation and attempted reproduction.In my own personal, biased opinion [edit: being the skeptic that I am], I suspect that either (II) or (III) is what really happened. But all I am saying in this post is that the statics quoted in the paper are actually relevant. Granted, a larger sample size would have been better, but still, even with the sample size given in the paper, the results are statistically significant. If we're going to poke holes in the study, we're not going to get very far by poking holes in the study's statistics. Below is the revised C# code. It was written as console program in Microsoft Visual C# 2008, if you'd like to try it out. You can modify the parameters near the top and recompile to test out different experimental parameters and number of simulated experiments. (Again, pardon my inefficient coding. I wasn't putting a lot of effort into this). Code:
//Written by Collins Mark.
using System;
using System.Collections.Generic;
using System.Linq;
using System.Text;
namespace Precognition_tester
{
class Program
{
static void Main(string[] args)
{
int NumLoops = 10000; // <== number of experiments
int SampleSize = 50; // <== number of participants in each experiment.
// This represents the paper's mean DR% threshold. Used for
// comparison of simulated mean DR% values. Should be 2.27
// for SampleSize of 100, and 4.21% for SampleSize of 50,
// to compare directly with paper's results.
double DRcomparisonThreshold = 4.21;
double memoryMean = 18.4; // <== averge number of words recalled.
double memoryStDev = 5; // <== standard deviation of number of words
// recalled (I had to guess at this one)
int ItemsPerCat = 12;
int i;
Random uniRand = new Random();
// Load the category lists.
List<string> foodList = new List<string>();
foodList.Add("HotDogs");
foodList.Add("Hamburgers");
foodList.Add("Waffles");
foodList.Add("IceCream");
foodList.Add("Coffee");
foodList.Add("Pizza");
foodList.Add("Guinness");
foodList.Add("SausageEggAndCheeseBiscuit");
foodList.Add("Toast");
foodList.Add("Salad");
foodList.Add("Taco");
foodList.Add("Steak");
List<string> animalList = new List<string>();
animalList.Add("Cat");
animalList.Add("Dog");
animalList.Add("Snake");
animalList.Add("Whale");
animalList.Add("Bee");
animalList.Add("Spider");
animalList.Add("Elephant");
animalList.Add("Mongoose");
animalList.Add("Wambat");
animalList.Add("Bonobo");
animalList.Add("Hamster");
animalList.Add("Human");
List<string> occupationsList = new List<string>();
occupationsList.Add("Engineer");
occupationsList.Add("Plumber");
occupationsList.Add("TalkShowHost");
occupationsList.Add("Doctor");
occupationsList.Add("Janitor");
occupationsList.Add("Prostitute");
occupationsList.Add("Cook");
occupationsList.Add("Theif");
occupationsList.Add("Pilot");
occupationsList.Add("Maid");
occupationsList.Add("Nanny");
occupationsList.Add("Bartender");
List<string> clothesList = new List<string>();
clothesList.Add("Shirt");
clothesList.Add("Shoes");
clothesList.Add("Jacket");
clothesList.Add("Undershorts");
clothesList.Add("Socks");
clothesList.Add("Jeans");
clothesList.Add("Wristwatch");
clothesList.Add("Cap");
clothesList.Add("Sunglasses");
clothesList.Add("Overalls");
clothesList.Add("LegWarmers");
clothesList.Add("Bra");
// Add elements to superset without clustering
List<string> superset = new List<string>();
for (i = 0; i < ItemsPerCat; i++)
{
superset.Add(foodList[i]);
superset.Add(animalList[i]);
superset.Add(occupationsList[i]);
superset.Add(clothesList[i]);
}
mainLoop(
NumLoops,
SampleSize,
DRcomparisonThreshold,
ItemsPerCat,
memoryMean,
memoryStDev,
superset,
foodList,
animalList,
occupationsList,
clothesList,
uniRand);
}
// This is the big, main loop.
static void mainLoop(
int NumLoops,
int SampleSize,
double DRcomparisonThreshold,
int ItemsPerCat,
double memoryMean,
double memoryStDev,
List<string> superset,
List<string> foodList,
List<string> animalList,
List<string> occupationsList,
List<string> clothesList,
Random uniRand)
{
// Report something to the screen,
Console.WriteLine("Simulating {0} experiments of {1} participants each", NumLoops, SampleSize);
Console.WriteLine("...Calculating...");
// Create list of meanDR of separate experiments.
List<double> meanDRlist = new List<double>();
// Initialze DR comparison counter.
int NumDRaboveThresh = 0; // Number of DR% above comparison thesh.
// Loop through main big loop
for (int mainCntr = 0; mainCntr < NumLoops; mainCntr++)
{
// create Array of participant's DR's for a given experiment.
List<double> DRarray = new List<double>();
//Loop through each participant in one experiment.
for (int participant = 0; participant < SampleSize; participant++)
{
// Reset parameters.
int P = 0; // number of practice words recalled.
int C = 0; // number of control words recalled.
double DR = 0; // weighted differential recall (DR) score.
// Create recalled set.
List<string> recalledSet = new List<string>();
createRecalledSet(
recalledSet,
superset,
memoryMean,
memoryStDev,
uniRand);
// Create random practice set.
List<string> practiceSet = new List<string>();
createPracticeSet(
practiceSet,
foodList,
animalList,
occupationsList,
clothesList,
ItemsPerCat,
uniRand);
// Compare recalled count to practice set.
foreach (string strTemp in recalledSet)
{
if (practiceSet.Contains(strTemp))
P++;
else
C++;
}
// Compute weighted differential recall (DR) score
DR = 100.0 * (P - C) * (P + C) / 576.0;
// Record DR in list.
DRarray.Add(DR);
// Report output.
//Console.WriteLine("DR%: {0}", DR);
}
// record mean DR.
double meanDR = DRarray.Average();
meanDRlist.Add(meanDR);
// Update comparison counter
if (meanDR >= DRcomparisonThreshold) NumDRaboveThresh++;
// Report Average DR.
//Console.WriteLine("Experiment {0}, Sample size: {1}, mean DR: {2}", mainCntr, SampleSize, meanDR);
}
// Finished looping.
// Calculate mean of meanDR
double finalMean = meanDRlist.Average();
// Calculate standard deviation of meanDR
double finalStDev = 0;
foreach (double dTemp in meanDRlist)
{
finalStDev += (dTemp - finalMean) * (dTemp - finalMean);
}
finalStDev = finalStDev / NumLoops;
finalStDev = Math.Sqrt(finalStDev);
// Report final results.
Console.WriteLine(" ");
Console.WriteLine("Participants per experiment: {0}", SampleSize);
Console.WriteLine("Number of separate experiments: {0}", NumLoops);
Console.WriteLine("mean of the mean DR% from all experiments: {0}",
finalMean);
Console.WriteLine("Standard deviation of the mean DR%: {0}", finalStDev);
Console.WriteLine("");
Console.WriteLine("Comparison theshold (from study): {0}", DRcomparisonThreshold);
Console.WriteLine("Total number of meanDR above comparison threshold: {0}", NumDRaboveThresh);
Console.WriteLine("% of meanDR above comparison threshold: {0}%", 100.0*((double)NumDRaboveThresh)/((double)NumLoops));
Console.ReadLine();
}
static double Gaussrand(double unirand1, double unirand2)
{
return (Math.Sqrt(-2 * Math.Log(unirand1)) * Math.Cos(2 * Math.PI * unirand2));
}
static void createRecalledSet(List<string> recalledSet, List<string> superSet, double mean, double stdev, Random unirand)
{
// Determine how many words were recalled. (random)
double unirand1 = unirand.NextDouble();
double unirand2 = unirand.NextDouble();
while (unirand1 == 0.0) unirand1 = unirand.NextDouble();
while (unirand2 == 0.0) unirand2 = unirand.NextDouble();
double gaussrand = Gaussrand(unirand1, unirand2);
gaussrand *= stdev;
gaussrand += mean;
int recalledCount = (int)gaussrand;
if (recalledCount > superSet.Count) recalledCount = superSet.Count;
// Create temporary superset and copy elements over.
List<string> tempSuperSet = new List<string>();
foreach (string strTemp in superSet)
{
tempSuperSet.Add(strTemp);
}
// Randomize temporary superset.
shuffleList(tempSuperSet, unirand);
// Copy over first recalledCount items to recalledSet.
for (int i = 0; i < recalledCount; i++)
{
recalledSet.Add(tempSuperSet[i]);
}
}
static void createPracticeSet(
List<string> practiceList,
List<string> foodList,
List<string> animalList,
List<string> occupationsList,
List<string> clothesList,
int itemsPerCat,
Random uniRand)
{
List<string> tempFoodList = new List<string>();
List<string> tempAnimalList = new List<string>();
List<string> tempOccupationsList = new List<string>();
List<string> tempClothesList = new List<string>();
// load temporary lists.
foreach (string strTemp in foodList)
tempFoodList.Add(strTemp);
foreach (string strTemp in animalList)
tempAnimalList.Add(strTemp);
foreach (string strTemp in occupationsList)
tempOccupationsList.Add(strTemp);
foreach (string strTemp in clothesList)
tempClothesList.Add(strTemp);
// Shuffle temporary lists
shuffleList(tempFoodList, uniRand);
shuffleList(tempAnimalList, uniRand);
shuffleList(tempOccupationsList, uniRand);
shuffleList(tempClothesList, uniRand);
// Load practice list
for (int i = 0; i < itemsPerCat / 2; i++)
{
practiceList.Add(tempFoodList[i]);
practiceList.Add(tempAnimalList[i]);
practiceList.Add(tempOccupationsList[i]);
practiceList.Add(tempClothesList[i]);
}
// Shuffle practice list
shuffleList(practiceList, uniRand);
}
// method to shuffle lists.
static void shuffleList(List<string> list, Random unirand)
{
List<string> shuffledList = new List<string>();
while (list.Count() > 0)
{
int indexTemp = unirand.Next(list.Count());
shuffledList.Add(list[indexTemp]);
list.RemoveAt(indexTemp);
}
foreach (string strTemp in shuffledList) list.Add(strTemp);
}
}
}
|
| Nov19-10, 06:29 PM | #37 |
|
|
The test itself, as per the article had 50/50 odds of the test subject guessing correctly. So I don't see 53/47 as being statistically amazing. EDIT: I'm talking in regards to prediction so far as the coin toss odds. The 53% must be from another experiment. The first one in the article I believe. |
| Nov19-10, 06:54 PM | #38 |
|
|
Perhaps I should elaborate.
By always having a 50/50 chance of any outcome. No matter what you predict the odds of it occurring are the same. Any pattern you choose so far as a coin toss goes is equally likely to occur. So you really need to shift the odds to >70/30 to show strong predictability. I'd prefer a test with smaller odds, say 1 in 6, of you guessing the result. That way you have significant odds against you simply guessing on each turn. By using 50/50 you are swinging the odds in favour of a guess. Even a roll of the dice, giving the 1 in 6 odds, gives an even chance of any pattern occurring. However, it does mean that there is a 5 in 6 chance you are wrong on each go, making a string of correct predictions far more spectacular and significantly less likely. |
| Nov19-10, 08:20 PM | #39 |
|
|
![]() It's not the same. Let's take a 2 coin toss experiment to start. There are four possibilities. H H H T * T H * T T Only one possibility out of 4 gives you all heads. That's one chance in 4. But there there are two possibilities that given you equal number of heads and tails, H T and T H. So the probability to tossing equal number of heads vs. tails is 50% or one chance in two attempts. Moving on to a experiment with 4 tosses, H H H H H H H T H H T H H H T T * H T H H H T H T * H T T H * H T T T T H H H T H H T * T H T H * T H T T T T H H * T T H T T T T H T T T T There are 16 possible outcomes and only 1 with all heads. So there is one chance in 16 of getting all heads. But there are 6 ways of getting an equal number of heads and tails. So the probability of equal heads and tails is 6/16 = 37.5% or about one chance in 2.67 attempts. It turns out that one can calculate the number of ways to produce an outcome of the coin toss flip using [tex] \left( \begin{array}{c}n \\ x \end{array} \right) = \frac{n!}{x!(n-x)!} [/tex] where n is the number of tosses, and x is the number of heads (or tails). So for a 10-toss experiment, the chances of getting all heads is 1 in 1024, but the chances of getting equal number of heads and tails is 24.6094% or about 1 in 4. But if you don't care which coins come up heads as long as there is an even number of heads and tails, things are very different. The experiments presented in the paper don't really care which order the words are recalled, or which specific words happen to be in the "practice" or "control" set. The experiments are not looking for overly specific patters, they are looking for sums of choices that are statistically unlikely when taken as a whole. For a single roll of the die, the probability distribution is uniform. But that is not the case for rolling the die twice and taking the sum. Or, the same thing, guessing on the sum of two dice rolled together. If you were to guess on the sum being 2 (snake eyes), you have a 1 chance in 36 On the other hand, if you were to guess that the sum is 7, your odds are incredibly better. There are 6 combinations that give you a score of 7. That makes your odds 6/36 = 16.6667% or 1 chance in 6. [Edit: fixed a math/typo error.] [Another edit: Sorry if this is a bit off topic but this subject is fascinating. It's a curious aspect of nature that things tend to reach a state of equilibrium. At the heart of nature, this aspect is because there are a far greater number of possible states that are roughly equally distributed and far fewer states at the extremes. At sub-microscopic scales, there's really no such thing as friction and all collisions are essentially elastic and reversible. But when considering groups of atoms and particles taken together, there are far more states that have roughly equal distribution and far fewer at extreme situations, all else the same (such as the total energy being the same in all possible states). it's this property that we are talking about here that explain friction, inelastic collisions, non-conservative forces, and the second law of thermodynamics when scaled up to macroscopic scales. And perhaps most importantly, the reason that getting 5 heads in a 10-toss coin experiment is far more likely than getting 10 heads is essentially the same reason why my coffee cools down on its own instead of heating up spontaneously.] |
| Nov19-10, 09:21 PM | #40 |
|
|
Yes, I was referring to predicting a specific pattern.
As per another thread, probability isn't my strong suit. A very interesting post from you there and I thank you. Cleared up some other questions I had as well. |
| Nov19-10, 11:00 PM | #41 |
|
|
It's got to be this one (well reasoned opinion). Frankly, I think it's because the tests are fundamentally non-causal (i.e. don't take place during forward propagation on the positive t-axis). You can never remove the systematic bias from the test: the data point is always taken before the test is performed. I don't mean that in a trivial "oh, that's neat" way. Seriously consider it. The data being taken in a "precognitive memorization test" is taken prior to the test being performed. 1)Memorize words 2)Recall words test 3)Record results 4)Perform typing test So we have a fundamental problem. This is situation in which one of the following two scenarios MUST be true: 1) Either the list of words to be typed during the typing test are generated PRIOR to the recall test, or 2) the list of words to be typed during the typing test are generated AFTER the recall test. In the case of (1), it would be impossible to separate precognition from remote viewing. In the case of (2), there is a tiny chance that the event is actually causal (in that the generation process could be influenced by the results of the recalled word test). (For the purposes of this problem description I am assuming that causal events are more likely than non-causal events.) |
| Nov19-10, 11:08 PM | #42 |
|
|
The study paper says in the experiment, "Experiment 1: Precognitive Detection of Erotic Stimuli," that there were 100 participants. 40 of the participants were shown each 12 erotic images (among other images), and the other 60 participants were each shown 18 erotic images (among others). That makes the total number of erotic images shown altogether, (40)(12)+ (60)(18) = 1560 erotic images shown. The paper goes on to say, However, after reading that, it's not clear to me whether the 53.1% is the total hit rate averaged across all total erotic pictures from all participants, or whether that is the average erotic-image hit rate of each participant. I don't think it matters much, but I'm going to interpret it the former way, meaning a hit rate of 53.1% of the total 1560 erotic images shown. So this is sort of like a 1560-toss coin experiment. 53.1% of 1560 is ~828. So I'm guessing that the average number of "correct" guesses is 828 out of 1560 (making the percentage more like 53.0769%). We could use the binomial distribution [tex] P(n|N) = \left( \begin{array}{c}N \\ n \end{array} \right) p^n (1-p)^{(N-n)} = \frac{N!}{n!(N-n)!} p^n (1-p)^{(N-n)} [/tex] Where N = 1560, n = 828, and p = 0.5. But that would give us the probability of getting exactly 828 heads out of 1560 coin tosses. But we're really interested in finding the probability of getting 828 heads or greater, out of 1560 coin tosses. So we have to take that into consideration too, and our equation becomes, [tex] P = \sum_{k = n}^N \left( \begin{array}{c}N \\ k \end{array} \right) p^k (1-p)^{(N-k)} = \sum_{k = n}^N \frac{N!}{k!(N-k)!} p^k (1-p)^{(N-k)} [/tex] Rather than break my calculator and sanity, I just plopped the following into WolframAlpha: "sum(k=828 to 1560, binomial(1560,k)*0.5^k*(1-0.5)^(1560-k))"Thank goodness for WolframAlpha. (http://www.wolframalpha.com) The results are the probability is 0.00806697 (roughly 0.8%) That means the probability of 53.1% heads or better in 1560-toss coin experiment, merely by chance with a fair coin, is 1 in 124. Similarly, the chances of the participants randomly choosing the "correct" side of the screen in erotic image precognition test 53.1% or better, on average, on the first experiment (with all 100 subjects choosing which side 12 or 18 times each), merely by chance, is 1 out of 124. I'd call that statistically significant.
|
| Nov19-10, 11:49 PM | #43 |
|
|
In fact, and I could be wrong, I understood it to mean that the options were always "left" or "right" but that not every left=right set contained a possible correct answer. I think I'll have to read again. |
| Jan9-11, 03:39 AM | #44 |
|
|
A story on daryl bem's paper in the new york times:
Another quote: |
| Jan9-11, 08:58 AM | #45 |
|
|
Forget the article and focus on the actual paper, which is a different matter. Beyond that, you need to learn what the scientific method is so you can understand when you posit that null hypothesis, and why. Nobody here should have to argue with you, just to realize that you need further education on the subject. For instance, would it be logical to assume the existence (i.e. truth of hypothesis) of something, then go about to prove your assumption? That's called... NOT SCIENCE... in fact it's enough to end your career regardless of the research subject. To pass off the results of a test designed to exploit a known neurological process is just... stupid. There's something to be examined here, but IF it's repeatable, then it doesn't sound ESPy to me at all. This is ESP in the way that forgetting where your keys are, then suddenly having an idea in your mind that they're under couch! You must be psychic, and all because of your mindset while waiting for your search pattern to improve based on dim memory. |
| Jan9-11, 10:26 AM | #46 |
|
|
|
| Jan9-11, 10:35 AM | #47 |
|
|
|
| Jan9-11, 11:22 AM | #48 |
|
|
Here is a PDF of a response paper:
http://dl.dropbox.com/u/1018886/Bem6.pdf It looks like there are some serious flaws with the ESP paper. The one I have the biggest problem with is coming up with a hypothesis from a set of data, and then using that same set of data to test the hypothesis. It's a version of the Texas Sharpshooter Fallacy. Here's what the paper I linked has to say, in part, on this matter: |
| Jan9-11, 11:28 AM | #49 |
|
|
|
| Jan9-11, 12:24 PM | #50 |
|
Recognitions:
|
Perhaps this falls into the category of "journalism" that seems so despised in this discussion, but Jonah Lehrer wrote a nice article for The New Yorker that touches on issues relevant to the debate (similar to the points already brought up in the thread: that subtle biases in study design, analysis and interpretation can introduce significant biases and lead to erroneous results). In particular, he talks about some work done by Jonathan Schooler:
In essence, Schooler replicated the results of the Bem paper but, after performing many more tests, showed that the results were noting but a statistical anomaly. I'm not aware whether Schooler published these results. This, especially in light of other such examples detailed in Lehrer's piece, is why I'm hesitant to trust findings based primarily on statistical data without a plausible, empirically-tested mechanism explaining the results. |
| Jan9-11, 06:05 PM | #51 |
|
|
. Plus, your article actually offers information rather than obscuring it when the original paper is available. Thank you.
|
| Thread Closed |
| Thread Tools | |
Similar Threads for: Precognition paper to be published in mainstream journal
|
||||
| Thread | Forum | Replies | ||
| Has anybody here been published in a scientifc journal ? | Academic Guidance | 85 | ||
| Published paper is needed | General Physics | 10 | ||
| New published issue of Journal of Physics Students (JPS) | General Physics | 0 | ||
| New published issue of Journal of Physics Students (JPS) | General Physics | 0 | ||
| Getting Published in a Journal | General Discussion | 2 | ||