billschnieder
- 808
- 10
Does a non-realistic dataset have any values at all?DrChinese said:By definition, a non-realistic dataset does NOT have 3 simultaneous values.

Does a non-realistic dataset have any values at all?DrChinese said:By definition, a non-realistic dataset does NOT have 3 simultaneous values.
billschnieder said:Does a non-realistic dataset have any values at all?![]()
DrChinese said:How is this:
a b c
+ - *
- * +
* + +
+ - *
Where * is undefined, and the other 2 map to actual observations.
DrChinese said:How is this:
a b c
+ - *
- * +
* + +
+ - *
Where * is undefined, and the other 2 map to actual observations. Now, where is yours big talker? Howsa 'bout just the dataset.
rlduncan said:This data set could have been generated by tossing two coins at a time. Right!
The number of mismatches are:
nab=2
nbc=0
nac=1
nbc+nac≥nab is violated. How do you explain the violation. Is coin tossing non-local?
DrChinese said:There are a lot of Bell inequalities. The one you used is not applicable in this case. I think you have discovered one of the points I am making. Bill often switches from one example to the other, throwing things around.
In my challenge, the Bell lower limit is 1/3 (matches). The quantum mechanical value is .25 - which is the cos^2(120 degrees). My example yields .25, which is fine because it is not realistic and so Bell does not apply.
What I am saying is that no realistic dataset will produce results below 1/3 once we have a suitably large sample. Bill or you can provide the dataset, I will select which 2 angles to choose from for each set of 3 values for a/b/c. That's the challenge.
billschnieder said:EXPERIMENTAL:
We have 3 coins labelled "a","b","c", one of which is inside a special box. Only two of them can be outside the box at any given time because you need to insert a coin in order to release another. So experimentally we decide to perform the experiment by tossing pairs of coins at a time, each pair a very large number of times. In the first run, we toss "a" and "b" a large number times, in the second one we toss "a" and "c" a large number of times and in the third we toss "b" and "c". Even though the data appears random, we then calculate <ab>, <ac> and <bc> and substitute in our equation and find that the inequality is violated! We are baffled, does this mean therere is non-local causality involved? For example we find that <ab> = -1, <ac> = -1 and <bc> = -1 Therefore |-1 - 1| + 1 <= 1, or 3 <= 1 which violates the inequality. How can this be possible? Does this mean there is spooky action at a distance happening?
gill1109 said:Quick response to Gordon. You said you could get half-way to the desired correlations, easily. I said "exactly", because half-way does not violate CHSH. Sorry, I have not found out exactly what you mean by Y, W, and I don't know what you mean by the classical OP experiment. My discussion was aimed at Aspect, done more recently, better still, by Weihs.
...
gill1109 said:Usually we discuss hypothetical experiments where timing is fixed. Like: every second we send off two photons. They may or may not get measured at the measurement stations. Detection efficiency is then usually defined in terms of the proportion of photons lost in either wing of the experiment.
In real experiments, the times of the departure of the photons and times they are measured are not fixed externally. Photons leave spontaneously and get measured at times which are not controlled by us. No, the measurement process itself generates times of events in both wings of the experiment. We use a "coincidence window" to decide which events are to be thought of as belonging together.
This opens a new loophole a bit different and in fact more potentially harmful than the detector efficiency loophole. If a "photon" arrives at a detector with a plan in its mind what setting it wants to see, and what outcome it will generate, cleverly correlated with the plan of its partner in the other wing of the experiment, then this photon can arrange to arrive a bit earlier (ie the measurement process is faster) if it doesn't like the setting it sees. At the same time, its partner in the other wing of the experiment arranges to arrive a bit later (ie its measurement process is slower) if it doesn't like the setting it sees. If they both see "wrong" settings the time interval between their arrivals is extended so much that they no longer count as a pair in the statistics.
All the photons get measured, detector efficiency is 100%, but many events are unpaired.
I wrote about this with Jan-Ake Larsson some years ago:
arXiv:quant-ph/0312035
Bell's inequality and the coincidence-time loophole
Jan-Ake Larsson, Richard Gill
This paper analyzes effects of time-dependence in the Bell inequality. A generalized inequality is derived for the case when coincidence and non-coincidence [and hence whether or not a pair contributes to the actual data] is controlled by timing that depends on the detector settings. Needless to say, this inequality is violated by quantum mechanics and could be violated by experimental data provided that the loss of measurement pairs through failure of coincidence is small enough, but the quantitative bound is more restrictive in this case than in the previously analyzed "efficiency loophole."
Europhysics Letters, vol 67, pp. 707-713 (2004)
gill1109 said:Thanks GW
If indeed the experiment is a perfect idealized experiment ... as in Bell's "Bertlmann's socks" paper then there is no way to beat CHSH in a local realistic way. Bell's 1964 paper is not about experiments, whether idealized and/or perfect or not. There are very good reasons why Bell moved from his initial inequality to CHSH and why he rather carefully spelt out the details of an idealized CHSH-type experiment in his later work.
gill1109 said:GW: the point of CHSH is that it gives us an easy way to see why local realist models can't generate E(A,B)=-a.b without recourse to trickery.
DrChinese said:Gordon has not supplied anything yet.
billschnieder said:See post #102.
billschnieder said:But if E(A,B) is calculated in a local realistic manner and gives -a.b the way Gordon has done, and Joy Christian has done, and De Raedt has done, and Kracklauer etc. ..., then there has to be something wrong with your claim that it can't. It is up to you to point out the trickery then. The CHSH being therefore a red-herring for this particular discussion.
To add to that: also Joy Christian has not really done so. It's now concluded by almost everyone that he simply messed up and tried in vain to undo the mess. As for the solutions of the remaining ones, those are not of the kind that Gordon is after (post #122).DrChinese said:Gordon has not supplied anything yet.
And your inability to confirm his claim is relevant in what way?DrChinese said:Christian claims to have done this in the reference provided below, but at this point I cannot confirm his claim. (I am discussing the matter with him.)
PuhleeseDe Raedt et al created a computer simulation which violates a Bell Inequality (winning the DrC challenge in the process)
but still failing to violate Bell's Theorem (since it no longer matches the predictions of QM).
http://arxiv.org/pdf/1112.2629v1
Einstein-Podolsky-Rosen-Bohm laboratory experiments: Data analysis and simulation
H. De Raedt, K. Michielsen, F. Jin
(Submitted on 12 Dec 2011)
Data produced by laboratory Einstein-Podolsky-Rosen-Bohm (EPRB) experiments is tested against the hypothesis that the statistics of this data is given by quantum theory of this thought experiment. Statistical evidence is presented that the experimental data, while violating Bell inequalities, does not support this hypothesis. It is shown that an event-based simulation model, providing a cause-and-effect description of real EPRB experiments at a level of detail which is not covered by quantum theory, reproduces the results of quantum theory of this thought experiment, indicating that there is no fundamental obstacle for a real EPRB experiment to produce data that can be described by quantum theory.
http://arxiv.org/pdf/0712.3781v2
Event-by-event simulation of quantum phenomena: Application to Einstein-Podolosky-Rosen-Bohm experiments
H. De Raedt, K. De Raedt, K. Michielsen, K. Keimpema, S. Miyagarbagea
(Submitted on 21 Dec 2007 (v1), last revised 25 Dec 2007 (this version, v2))
We review the data gathering and analysis procedure used in real Einstein-Podolsky-Rosen-Bohm experiments with photons and we illustrate the procedure by analyzing experimental data. Based on this analysis, we construct event-based computer simulation models in which every essential element in the experiment has a counterpart. The data is analyzed by counting single-particle events and two-particle coincidences, using the same procedure as in experiments. The simulation models strictly satisfy Einstein's criteria of local causality, do not rely on any concept of quantum theory or probability theory, and reproduce all results of quantum theory for a quantum system of two $S=1/2$ particles. We present a rigorous analytical treatment of these models and show that they may yield results that are in exact agreement with quantum theory. The apparent conflict with the folklore on Bell's theorem, stating that such models are not supposed to exist, is resolved. Finally, starting from the principles of probable inference, we derive the probability distributions of quantum theory of the Einstein-Podolsky-Rosen-Bohm experiment without invoking concepts of quantum theory.
You do not know that so why do you state it as though you do?harrylin said:To add to that: also Joy Christian has not really done so.
It is true that many people do not believe Joy Christian, but that is not a reason to state their opinion as fact, nor does it mean he is wrong. I recommend you follow the discussion on FQXi where he explains his program in more detail and his article in which he responds to gill1109's criticisms.It's now concluded by almost everyone that he simply messed up and tried in vain to undo the mess. As for the solutions of the remaining ones, those are not of the kind that Gordon is after (post #122).
harrylin said:To add to that: also Joy Christian has not really done so. It's now concluded by almost everyone that he simply messed up and tried in vain to undo the mess.
billschnieder said:De Raedt et al will laugh at your so called "DrC Challenge".
But this is a fundamental misunderstanding on your part. There is no such thing as full universe in QM. QM gives you correlations for the experimental outcome, the same thing they calculated. If you want to claim that the outcome is the full universe, then you can not use a different standard for their simulation, you must also look only at the outcome.DrChinese said:And it does not match QM for the full universe, thereby respecting Bell.
BTW I do not doubt that Kristel and Hans might have spent a lot of their valuable time with you. Although I do doubt that, that time was spent on, let-alone winning, the "DrC challenge."However, in fact I worked closely with Kristel (and Hans) on theirs for about a month, and they were kind enough to devote substantial time and effort to the process. In the end we did not disagree on the operation of their simulation. It is fully local and realistic.
billschnieder said:But this is a fundamental misunderstanding on your part. There is no such thing as full universe in QM. QM gives you correlations for the experimental outcome, the same thing they calculated. If you want to claim that the outcome is the full universe, then you can not use a different standard for their simulation, you must also look only at the outcome.
billschnieder said:BTW I do not doubt that Kristel and Hans might have spent a lot of their valuable time with you. Although I do doubt that, that time was spent on, let-alone winning, the "DrC challenge."
Gordon Watson said:GW Statement 1: I derive the results for both W (the classical OP experiment) and Y (the well-known Aspect (2004) experiment) in a classical way.
Delta Kilo said:Delta Kilo Response 1: No, you don't. You did not provide classical derivation for Y. Instead you just "borrowed" the result from Aspect paper. Aspect makes it very clear eq(6) was derived using QM rather than classical model.
Gordon Watson said:GW Statement 2: Analytically, via my way: Going the whole-way (100%, say, with Y) is as easy as going half-way (50%, with W).
Delta Kilo said:Delta Kilo Response 2: No, it isn't. There is a big difference: one satisfies Bell's inequality, another violates it.
DrChinese, this seems to be interpreting Bell's theorem too broadly. Bell's theorem says nothing about whether local hidden variable theories can reproduce, say, the energy spectrum of the hydrogen atom; it only discusses whether theories can reproduce the specific correlations QM predicts for entangled particles. If a theory were to break the Bell inequality fair and square, Bell's theorem would put no further barriers to such a theory matching any other predictions of QM. So in judging a "challenge" to Bell's theorem, it seems to me that we should only focus on whether and how the model violates the Bell inequality. And in the case of de Raedt, all you need to say is that it exploits one of the experimental loopholes of currently practical Bell tests, and is thus not a valid counterexample to Bell's theorem, which after all is a rigorously proven theoretical result.DrChinese said:De Raedt et al created a computer simulation which violates a Bell Inequality (winning the DrC challenge in the process) but still failing to violate Bell's Theorem (since it no longer matches the predictions of QM).
This makes no sense. There is no such thing as full universe. Only the outcomes matter for Bell or QM.DrChinese said:If you look at the simulation, you can vary the size of the window. This is only the outcomes that are "visible". Since the model is realistic, we can also display the full universe (which of course never matches the QM expectation, respecting Bell).
The "full universe" issue you're talking about concerns the existence of counterfactual outcomes. But the "full universe" issue that DrChinese is discussing in regard to de Raedt's model is that it exploits the fair sampling loophole: the model only reproduces the predictions of QM if we take a small coincidental detection window, but if we had better experiments that would detect ALL entangled pairs emitted by the source, then de Raedt's model would be in stark disagreement with the predictions of QM.billschnieder said:This makes no sense. There is no such thing as full universe. Only the outcomes matter for Bell or QM.
I did not realize that until recently; the latest discussions on the different forums clarified this for me beyond reasonable doubt, in part thanks to Christian himself. However, all that is off topic here (you can send me a PM).billschnieder said:You do not know that so why do you state it as though you do? [..]
GW,Gordon Watson said:E(AB)_{Aspect(2004)} = E(AB)_Y = \int d\lambda \rho (\lambda ) (AB)_Y <br /> <br /> = \int d\lambda \rho (\lambda )A(\textbf{a}, \lambda )B(\textbf{b}, \lambda )_Y
<br /> <br /> = \int d\lambda \rho (\lambda )[ 2 \cdot P(B^+|Y,\,A^+) - 1] <br /> <br /> = \int d\lambda \rho (\lambda)[2⋅cos^2(\textbf{a}, \textbf{b}) - 1]
<br /> <br /> = cos[2(\textbf{a}, \textbf{b})] = QED!
E(AB)_Y = \int d\lambda \rho (\lambda ) (AB)_Y <br /> = \int d\lambda \rho (\lambda )A(\textbf{a}, \lambda )B(\textbf{b}, \lambda )_Y
What the heck is that? Why are you integrating over λ a probability which is not a function of λ, what is that supposed to mean? (Thankfully there is no harm done, but it is just pointless and conceptually wrong thing to do, as P(B|A) is itself an implicit integral over all possible λ. I assume you are integrating the whole thing and not just multiplying ∫ρ(λ)dλ by the expression in the square brackets, which would be equally silly) Where did Y come from?= \int d\lambda \rho (\lambda )[ 2 \cdot P(B^+|Y,\,A^+) - 1]
Now, this cos^2 was taken from Aspect paper, where it was obtained as a prediction of QM. This happens to be exactly the case I mentioned earlier which cannot be factorized into A(\textbf{a}, \lambda )B(\textbf{b}, \lambda) \rho(\lambda). And so your 'derivation' instead of being 'incorrect in general' becomes just 'wrong' .= \int d\lambda \rho (\lambda)[2⋅cos^2(\textbf{a}, \textbf{b}) - 1]
From what I understand, V represents the experimental conditions.Delta Kilo said:While individual bits and pieces may look sort of all right, the steps do not follow one from another at all.
But crucially ... how did you get here form there?
Delta Kilo said:GW,
Sorry but this is not a derivation, this is wishful thinking. While individual bits and pieces may look sort of all right, the steps do not follow one from another at all.
That's Bell's LR condition all right. Fair enough.What the heck is that? Why are you integrating over λ a probability which is not a function of λ, what is that supposed to mean? (Thankfully there is no harm done, but it is just pointless and conceptually wrong thing to do, as P(B|A) is itself an implicit integral over all possible λ. I assume you are integrating the whole thing and not just multiplying ∫ρ(λ)dλ by the expression in the square brackets, which would be equally silly) Where did Y come from?
But crucially ... how did you get here FROM there? [GW EDIT]
I mean I sort of know where you got this expression from, don't bother telling me, but... you didn't actually derive it from the previous line of your 'proof', did you? I mean, you did not actually start with the first expression and somehow transmogrify it into the second one by applying strict rules of math, did you?
You do understand that there is no connection whatsoever between what you just did and the previous line, don't you? That the two expressions were written under different set of assumptions, specifically that the second line describes all possible set-ups where certain symmetry conditions are met while the first one only applies to LR ones? That it is incorrect in general to put equal sign between them? That there are plenty of counter-examples where 2 \cdot P(B^+|Y,\,A^+) - 1 cannot be factorized into A(\textbf{a}, \lambda )B(\textbf{b}, \lambda) \rho(\lambda)? etc. etc.Now, this cos^2 was taken from Aspect paper, where it was obtained as a prediction of QM. This happens to be exactly the case I mentioned earlier which cannot be factorized into A(\textbf{a}, \lambda )B(\textbf{b}, \lambda) \rho(\lambda). And so your 'derivation' instead of being 'incorrect in general' becomes just 'wrong' .[GW emphasis added]
billschnieder said:From what I understand, V represents the experimental conditions.
E(AB)_V = \int_{\Lambda} (A^\lambda \cdot B^\lambda)_V \, \rho (\lambda )_V \, d\lambda
Instead of integrating over continuous variables λ, we can instead do a summation over discrete outcomes
E(AB)_V = \sum_{ij} (A^i\cdot B^j)P(A^iB^j|V), \;\;\;\; ij \in [++, +-, -+, --]
Note that the only difference between the discrete case and above case is that A^\lambda is a function of λ, and A^i is an outcome.
No, we don't. We don't have separate local settings a and b. Instead we have global V which presumably includes a and b along with any other settings and both A and B depend on the entire V.billschnieder said:But in both equations, we have the separable product A \cdot B satisfying the locality condition.
There is nothing to prove here. The two expressions are equivalent!Delta Kilo said:Yes, sure we can. But why don't we actually try to prove it instead of just saying it?
Wikipedia said:In probability theory, the expected value (or expectation, or mathematical expectation, or mean, or the first moment) of a random variable is the weighted average of all possible values that this random variable can take on. The weights used in computing this average correspond to the probabilities in case of a discrete random variable, or densities in case of a continuous random variable. From a rigorous theoretical standpoint, the expected value is the integral of the random variable with respect to its probability measure.
Delta Kilo said:It turns out to be is impossible to find such A and B for the LR case:
P(A_i,B_j|a,b) = \int_\Lambda \delta(A(a,\lambda)-A_i) \delta(B(b,\lambda)-B_j) \rho(\lambda) d\lambda
Delta Kilo said:We don't have separate local settings a and b. Instead we have global V which presumably includes a and b along with any other settings and both A and B depend on the entire V.
Here you refer to the statistical analysis of a small sample. However, P usually stands for probability. As in your coin toss example, the probability of head (fair coin) P=0.5 even if you throw for example heads twice.billschnieder said:[..] P(B^+|V,\,A^+) simply means for a given experiment V, we find all the pairs for which A+ was observed on one side [..].
I did not say the coin was fair and what if the experimnent T can never be repeated because the coins were so fragile that they could only be tossed 7 times. That is why the calculation has to be conditioned on the specific experimental conditions T whose outcomes you have.harrylin said:Here you refer to the statistical analysis of a small sample. However, P usually stands for probability. As in your coin toss example, the probability of head (fair coin) P=0.5 even if you throw for example heads twice.
Delta Kilo said:Yes, sure we can. But why don't we actually try to prove it instead of just saying it?
billschnieder said:Instead of integrating over continuous variables λ, we can instead do a summation over discrete outcomes
E(AB)_{W°Y} = \sum_{ij} (A^i\cdot B^j)P(A^iB^j|W°Y), \;\;\;\; ij \in [++, +-, -+, --]
Note that the only difference between the discrete case and above case is that A^\lambda is a function of λ, and A^i is an outcome. But in both equations, we have the separable product A \cdot B satisfying the locality condition.
Delta Kilo, please reconsider. What you write is surely wrong?Delta Kilo said:No, we don't. We don't have separate local settings a and b. Instead we have global W°Y which presumably includes a and b along with any other settings and both A and B depend on the entire W°Y.
Delta Kilo said:If I now substitute all that into the integral and take it, the answer is going to be
P(A=1,B=1|a,b)=\frac{1}{2}cos^2(a-b)
However, you will notice that B depends on V which includes both a and b.
It turns out to be is impossible to find such A and B for the LR case:
P(A_i,B_j|a,b) = \int_\Lambda \delta(A(a,\lambda)-A_i) \delta(B(b,\lambda)-B_j) \rho(\lambda) d\lambda
billschnieder said:...
Therefore substituting above, we get
E(AB)_V = 2 \cdot P(B^+|V,\,A^+) - 1
E(AB)_V = -2 \cdot P(B^+|V,\,A^-) + 1
All that remains now is to use Malus law to get P(B^+|V,\,A^+) (or P(B^+|V,\,A^-) for the case where A(·) = - B(·)) according to the experimental conditions V.
Gordon Watson said:A({\textbf{a}}, \lambda) = \int d\lambda\delta (\lambda - {\textbf{a}}^+\bigoplus {\textbf{a}}^-) cos[2s({\textbf{a}}, \lambda)] = \pm 1.<br /> <br />
B({\textbf{b}}, \lambda') = \int d\lambda'\delta (\lambda' - {\textbf{b}}^+\bigoplus {\textbf{b}}^-) cos[2s({\textbf{b}}, \lambda')] = \pm 1.
Where \bigoplus = XOR.
Do you see a problem with these functions? If not, how does your integral proceed, please, with them?
Thanks,
GW
No in general they are not.billschnieder said:There is nothing to prove here. The two expressions are equivalent!
billschnieder said:I think you forgot to mention that s is the spin. Is that correct?
Delta Kilo said:No in general they are not.
E(a,b)=\sum_{ij} A_iB_j P(A_i,B_j|a,b)
is applicable to any discrete random values A, B with no restrictions whatsoever, while
E(a,b)=\int_\Lambda A(a,\lambda) B(b,\lambda) \rho(\lambda) d\lambda
describes a particular LR setup, where A and B are both functions of random variable λ.
If you treat the two formulas above as a system of equations, and solve it with respect to P(..) you will get the answer:
P(A_i,B_j|a,b)=\int_\Lambda \delta_{A(a,\lambda),A_i} \delta_{B(b,\lambda),B_j}\rho(\lambda) d\lambda
In fact, given any two of the above formulas you can derive the third.
So for the first two formulas to be true simultaneously, the probability has to be representable in this particular form. Malus law cannot be represented is this form.
Of course you understood that I did not mean generally, we are discussing Bell, and in this case the two are equivalent. The expectation value E(AB)_V is defined over any probability measure of the probability space V. You can pick anyone you like and you will get the same result. ρ(λ) is just as valid a probability measure over V as ρ(ij), ij ∈ [++,+−,−+,−−]. The latter just makes it easier to compare with how E(AB) is calculated in real experiments. So you cannot think the calculation is wrong without claiming the same about how the Bell-test experimentalists analyse their data.Delta Kilo said:No in general they are not.
I do not agree with that characterization. The chain rule of probability theory, P(AB|X) = P(A|X)P(B|X,A), is valid generally. P(AB|X) = P(A|X)P(B|X) is ONLY valid in the limited case in which P(B|X,A) = P(B|X) and even then the chain rule is still valid (ie, the two expressions give you the exact same result). There will never be a situation in which P(AB|X) = P(A|X)P(B|X) would be valid while P(AB|X) = P(A|X)P(B|X,A) is not. In any case, as demonstrated in the coin-toss example a few posts back, separability of the probability is not a requirement for locality.So for the first two formulas to be true simultaneously, the probability has to be
representable in this particular form.
If you postulate that the two forms are equivalent, then it immediately and automatically follows from the math that the probability has this particular form I have given you.billschnieder said:Of course you understood that I did not mean generally, we are discussing Bell, and in this case the two are equivalent.
I am now totally confused. What is V? Earlier it appeared to be either a label identifying particular experimental setup, or a set of parameters including settings a and b. Now you tell me it is a probability space? And ρ(λ) is defined over V?. And the most important, where did the settings a and b go? Can we please get the notation straight, so that E(a,b) is a function of a and b as it should be?billschnieder said:The expectation value E(AB)_V is defined over any probability measure of the probability space V. You can pick anyone you like and you will get the same result. ρ(λ) is just as valid a probability measure over V as ρ(ij), ij ∈ [++,+−,−+,−−].
Where did I say anything at all about P(AB|X) = P(A|X)P(B|X)? I didn't, obviously, because this condition just means "for a given X, A|X and B|X are independent", which is clearly not true. Instead I said there must exist such A(a,λ), B(b,λ) and ρ(λ) so that the probability can be expressed asbillschnieder said:The chain rule of probability theory, P(AB|X) = P(A|X)P(B|X,A), is valid generally. P(AB|X) = P(A|X)P(B|X) is ONLY valid in the limited case in which P(B|X,A) = P(B|X) and even then the chain rule is still valid (ie, the two expressions give you the exact same result). ...
That really is a matter of physical interpretation. Say you have a physical process described by a bunch of equations. Suppose you can assign regions of space-time to each physical quantity. Then if you can massage the equations in a way so that each value in the LHS in the intersections of past light-cones of all values in the RHS, then it is local-realistic, otherwise it is not.billschnieder said:It now appears you are saying Malus law is non-local. Did I understand that correctly?