# Bell's derivation; socks and Jaynes

by harrylin
Tags: bell socks jaynes
 P: 3,187 Hello, For this little discussion I base myself on Bell's paper on Bertlmann's socks: http://cdsweb.cern.ch/record/142461 Although I have participated in a number of discussions about Bell's theorem, I always had the uneasy feeling not to fully understand the definitions of symbols and the notation - in particular how to account for lambda in probability calculations. So, although I intend to discuss here the validity (or not) of Jayne's criticism of Bell's equation no.11, I'll start very much more basic. Using Bell's example of socks, I think that we could write for example: P1(pink) = 0.5 Here P1(pink) stands for the probability to observe a pink sock on the left foot on an arbitrary day. An experimental estimation of it is found by taking the total from many observations, divided by the number of observations. As the colour depends on Bertlmann's mood, we can then account for that mood as an unknown variable "lambda" (here I will just put X, for unknown). However, any local realistic theory that proposes such an unknown variable as explanation, still must predict the same observed result. Therefore, I suppose that if we include X as causal factor, we must still write: P1(pink|X) = 0.5 Thus far correct?
P: 177
 Quote by harrylin P1(pink) = 0.5 Here P1(pink) stands for the probability to observe a pink sock on the left foot on an arbitrary day. An experimental estimation of it is found by taking the total from many observations, divided by the number of observations. As the colour depends on Bertlmann's mood, we can then account for that mood as an unknown variable "lambda" (here I will just put X, for unknown). However, any local realistic theory that proposes such an unknown variable as explanation, still must predict the same observed result. Therefore, I suppose that if we include X as causal factor, we must still write: P1(pink|X) = 0.5 Thus far correct?
I don't think this is quite correct. Rather, if X correlates with Bertlmann wearing a pink sock then P1(pink|X)=(P1(pink)/P(X))>0.5. Instead, $\int{}P_1(pink|X)P(X)dX=P_1(pink)=0.5$ (obviously if X is a causal factor it must correlate with P1(pink)). I think what Bell is saying in equation 11 is that if one knew λ (in addition to the local conditions) there would be no residual correlations between the distributions of the measurements (after accounting for its effects).
P: 3,187
 Quote by IsometricPion I don't think this is quite correct. Rather, if X correlates with Bertlmann wearing a pink sock then P1(pink|X)=(P1(pink)/P(X))>0.5. Instead, $\int{}P_1(pink|X)P(X)dX=P_1(pink)=0.5$ (obviously if X is a causal factor it must correlate with P1(pink)). [..]).
Thanks for that clarification! I had not looked at it that way. However, X is like EPR's hidden function: Bertlmann's unknown and unpredictable mood determines what socks he will wear. X stands for the physical model, which is here an invisible random function (indeed, it happens in his head) that delivers one of {pink, not pink}. Obviously the chance to observe a Bertlmann pair of socks on Bertlmann's feet is simply 1. Then we must have, for the case that half of the time a pink sock is observed on the left foot:
P1(pink|X)=P1(pink)/P(X) = P1(pink)/1 =0.5

It's exactly the same as for a fair coin: P(head | fair coin) = 0.5.

I can imagine that someone would like to split the probability estimation up into unknown "knowns": then we can separate it into the cases that Bertlmann decides to put a pink sock on his left leg, and the cases that he decides to put another colour on his left leg. However, what we are interested in the result over many times, and then we are necessarily back at where we were here above. Thus, I don't see any use for that.

P: 177
Bell's derivation; socks and Jaynes

 Quote by harrylin X stands for the physical model, which is here an invisible random function (indeed, it happens in his head) that delivers one of {pink, not pink}. Obviously the chance to observe a Bertlmann pair of socks on Bertlmann's feet is simply 1. Then we must have, for the case that half of the time a pink sock is observed on the left foot: P1(pink|X)=P1(pink)/P(X) = P1(pink)/1 =0.5 It's exactly the same as for a fair coin: P(head | fair coin) = 0.5.
I misinterpreted what you meant by X. I took it to mean a variable taking on values from the set of moods, some subset of which would correlate with Bertlmann wearing a pink sock instead of the mood model itself. In the latter case, I certainly agree with your results.

Edit: A couple of papers that may be relevent to this discussion: Jaynes' view of EPR, a critque of Jaynes' view
P: 3,187
@IsometricPion: thanks for the links! I suspect that our own discussion here, which is based on http://cdsweb.cern.ch/record/142461, will show that the Arxiv paper misses the point; we'll see!

instead of running to eq.11, I will first work out the example that Bell gave in his introduction, as he did not do so himself.
Note that in Bell's paper the pictures come after the text. I'll start with a partial re-take.

Elaborating on Bell's example of Bertlmann's socks, we could write for example:

P1(pink) = 0.5

Here P1(pink) stands for the probability to observe a pink sock on the left foot on an arbitrary day. An experimental estimation of it is found by taking the total from many observations, divided by the number of observations.

As the colour depends on Bertlmann's mood, we can account for that mood as an unknown function "lambda" (here I will just put X, for unknown). However, any "classical" theory that proposes such a physical model, still must predict the same observed result. Therefore, if we include X as invisible cause for the outcome, we must still write:

P1(pink|X) = 0.5
(Compare: P(head | fair coin) = 0.5)

Similarly we can write for the right leg:

P2(pink|X) = 0.5

Bell remarks:
 Which colour he will have on a given foot on a given day is quite unpredictable. But when you see that the first sock is pink you can already be sure that the second sock will not be pink. Observation of the first, and experience of Bertlmann, gives immediate information about the second.
The fact that "pink" on the left foot implies "not pink" on the right foot implies a strong correlation between results. We can acknowledge that correlation as follows, with for convenience a slight change of notation:

P(L,R|X) =/= P1(L|X) P2(R|X)

Here L stands for "pink on left leg", and R stands for "pink on right leg".

Ok so far?
 P: 5 pink = 1, not pink = -1 then: P(LR) = 0, because L and R are always different; formally: P(LR) = P(L|R)*P(R); P(R) = P(L) = 1/2; but: P(L|R) = 0 <> P(L); (both socks have never the same colour) corr = 0 - 1 = -1, full anti-correlation. And using Bell reasoning: P(LR) = P(L)*P(R) = 1/2 * 1/2 = 1/4; corr = 2*1/4 - 2*1/4 = 0. Two random socks, and completely independent, of course.
 P: 3,187 @ alsor: it appears that in this matter we both agree with Jaynes. However, again you ran far ahead of me and I'm not sure if everyone who, so far, didn't "see" this point of Jaynes etc., could follow you. So, I'll continue my slow pace to make sure that everyone who watches this topic can follow me and that we all agree on the basic facts as well as notation. I'll catch up with you later.
P: 177
 Quote by alsor And using Bell reasoning: P(LR) = P(L)*P(R) = 1/2 * 1/2 = 1/4; corr = 2*1/4 - 2*1/4 = 0. Two random socks, and completely independent, of course.
This misrepresents Bell's model of local hidden variables. Equation 11 of his paper assumes one knows the values of the hidden variables, in this case Bartlmann's mood. So, P(L|bartlmann feels like wearing a pink sock on his right foot)=0 (since beyond his mood one also knows that he does not wear the same color socks) and P(R|bartlmann feels like wearing a pink sock on his right foot)=1. Thus P(L|mood=right, pink)*P(R|mood=right, pink)=1*0=0.

If instead one does not know his mood (or anything about it other than it can take on one of two sets of values), P(L)=P(L|RP)P(RP)+P(L|R¬P)P(R¬P)=0*0.5+1*0.5=0.5, by exchangeability. The problem Jaynes sees with Bell's reasoning is not his statistical or mathematical procedure/ability, rather he thinks Bell is to restrictive in what he (Bell) consideres to be valid variables for the probability distributions for a theory upholding local realism.
P: 3,187
 Quote by IsometricPion [..]The problem Jaynes sees with Bell's reasoning is not his statistical or mathematical procedure/ability, rather he thinks Bell is to restrictive in what he (Bell) consideres to be valid variables for the probability distributions for a theory upholding local realism.
Thanks for the correction; however, although indeed Bell doesn't make a blunder of that proportion, Jaynes certainly points out a subtle error in Bell's equation; according to Jaynes it is not correct.
Anyway, we're not there yet: the problem with the illustration of Bertlmann's socks is that it by far doesn't catch the complexity of the problem at hand. If the observations would always be perfectly anti-correlated, there wouldn't be a riddle.

Now, I'm afraid that his next illustration of Lille and Lyon matches it even less well; thus, for this discussion I have been trying to come up with a variant of Bertlmann's socks that addresses the fact that the local conditions affect the observed correlation, but I didn't come up with a good looking one (I thought of observation of white or yellow socks in daylight/artificial light, as well as mud on his socks, but I'm not satisfied). Any better suggestion? If not, we should perhaps move on to the introduction of eq.11.
P: 1,414
 Quote by harrylin Although I have participated in a number of discussions about Bell's theorem, I always had the uneasy feeling not to fully understand the definitions of symbols and the notation - in particular how to account for lambda in probability calculations.
Metaphors are unnecessary and sometimes confusing, imho. Why not just refer to Bell's original formulation of a local realistic QM expectation value. Where does lambda appear and what does it refer to?
P: 3,187
 Quote by ThomasT Metaphors are unnecessary and sometimes confusing, imho. Why not just refer to Bell's original formulation of a local realistic QM expectation value. Where does lambda appear and what does it refer to?
While it may appear that he defines it very precisely, different people interpret it slightly differently in the literature. Moreover, I wasn't in the clear about notation. However, this discussion is already making it quite clear (I just needed a memory refresh!); we're now moving on to Bell vs Jaynes.
Mentor
P: 11,782
 Quote by harrylin we're now moving on to Bell vs Jaynes.
I'm pretty much a spectator in these discussions, but I'd like to point out that there was a long thread here about three years ago, about Jaynes's objections to Bell:

This was before you joined PF, so you may not have seen this. It may or may not fit in with the direction you were planning to go.

It was split off from another thread, by the way, which is why it appears to start in the middle of a discussion.
P: 3,187
 Quote by jtbell I'm pretty much a spectator in these discussions, but I'd like to point out that there was a long thread here about three years ago, about Jaynes's objections to Bell: http://www.physicsforums.com/showthread.php?t=283519 This was before you joined PF, so you may not have seen this. It may or may not fit in with the direction you were planning to go. It was split off from another thread, by the way, which is why it appears to start in the middle of a discussion.
Thank you! Indeed I had not seen that one... BTW I was also very much a spectator of another current thread in which I saw the suggestion to start this topic. Now I'll first check out the old thread.
P: 3,187
 Quote by harrylin Thank you! Indeed I had not seen that one... BTW I was also very much a spectator of another current thread in which I saw the suggestion to start this topic. Now I'll first check out the old thread.
Ok, I'm afraid that I will need some time to work through that old thread; and I'm very busy this week.

Still, I started reading it and I notice some disagreement about what Bell claimed to prove. There is no use getting into arguments about the meaning of "local realism" and philosophy. What the "local realist" Einstein insisted on, and what Bell claimed to be incompatible with QM, was "no spooky action at a distance". Or, as Bell put it in his first paper:
 that the result of a measurement on one system be unaffected by operations on a distant system with which it has interacted in the past.
Those who deviate from that issue are shooting at straw men.

Bell puts it this way in his Bertlmann's socks paper:
 What is held sacred is the principle of "local causality" - or "no action at a distance". [...] What [Einstein] could not accept was that an intervention at one place could influence, immediately, affairs at the other.
The focus of this discussion is Bell's attempt to prove that Einstein's "no action at a distance" principle is incompatible with QM, in the light of Jayne's first criticism.
P: 3,187
 Quote by jtbell I'm pretty much a spectator in these discussions, but I'd like to point out that there was a long thread here about three years ago, about Jaynes's objections to Bell: http://www.physicsforums.com/showthread.php?t=283519 This was before you joined PF, so you may not have seen this. It may or may not fit in with the direction you were planning to go. It was split off from another thread, by the way, which is why it appears to start in the middle of a discussion.
I now had a better look at it, and I think that in particular posts #26 and #31 are important. Anyway I'll give a short summary of how I now see it.

If Jaynes' criticism focuses on Bell's equation no.11 in his "socks" paper, it was perhaps due to a misunderstanding about what Bell meant (his comments were based on an earlier paper).

P(AB|a,b,x) = P(A|a,x) P(B|b,x) (Bel 11)

Here x stands for Bell's lambda, which corresponds to the circumstances that lead to a single pair correlation (in contrast to my earlier X, which causes the overall correlation for many pairs).

According to Jaynes it should be instead, for example:

P(AB|a,b,x) = P(A|B,a,b,x) P(B|a,b,x)

Perhaps Jaynes thought that Bell meant:

P(AB|a,b,X) = P(A|a,X) P(B|b,X)

in which case Jaynes claimed that:

P(AB|a,b,X) = P(A|B,a,b,X) P(B|a,b,X)

This is really tricky.

However, he really was disagreeing with the integral equation.
According to him, it should not be:

P(AB|a,b) = ∫ P(A|a,x) P(B|b,x) p(x) dx

but:

P(AB|a,b) = ∫ P(AB|a,b,x) P(x|a,b) dx

and thus:

P(AB|a,b) = ∫ P(AB|a,b,x) p(x) dx = ∫ P(A|B,a,b,x) P(B|a,b,x) p(x) dx

Is my summary of the disagreement correct?

What is the significance of little p(x) instead of P(x)?
PF Gold
P: 5,385
 Quote by harrylin According to Jaynes it should be instead, for example: P(AB|a,b,x) = P(A|B,a,b,x) P(B|a,b,x)
http://bayes.wustl.edu/etj/articles/cmystery.pdf

As I read it, this is one of Jaynes's arguments. However, I think it is attacking a straw man. The essence of Bell's argument does not require the factorization so much as a definition of what realism is.

For a SINGLE photon, not a pair: does it have a well-defined polarization at 0, 120, and 240 degrees independent of the act of observation? Once you answer this in the affirmative, as any local realist must, the Bell conclusion (a contradiction between the assumption and QM's predictions) follows quickly. If you answer as no, then you already deny local realism so it is moot.

So I really don't see the significance here of Jaynes' argument. The only people that take it seriously are local realists looking for support for their position. The vast majority of scientists see it for what it is, something of a technicality with no serious implications for the Theorem whatsoever.

In other words, it would be helpful to see an example that somehow related specifically to photon polarization rather than urns (which does not seem to be much of an analogy).
P: 1,583
 Quote by DrChinese http://bayes.wustl.edu/etj/articles/cmystery.pdf
Speaking of this paper, does anyone know what Jaynes is talking about in the end of page 14 and going on to page 15, concerning "time-alternation theories"? He seems to be endorsing a local realist model which makes predictions contrary to QM, and he claims that experiments peformed by "H. Walther and coworkers on single atom masers are already showing some resemblance to the technology that would be required" to test such a theory. Does anyone one know whether such a test has been peformed in the decades since he wrote his paper?
P: 177
 Quote by harrylin Is my summary of the disagreement correct? What is the significance of little p(x) instead of P(x)?
I think it is clear that λ in Bell's paper corresponds to x here (rather than X). While I am less certain of Jaynes' meaning I think it is probably x as well (since it appears on the left side of the | indicating that it is a variable in some of his equations). Jaynes is pretty consistent, so I would expect everything he denotes by λ to refer to the same thing (i.e., all his λ's should correspond with x's rather than X's).

Jaynes refers to probabilities essentially as logical statements of uncertain truth value. His P(y|Y) correspond to logical statements where Y is the predicate and y is the antecedent the truth value of which one is uncertain (the amount of (rational) belief one has that y has a value between u and v is P(u≤y≤v|Y)=∫uv P(y|Y)dy). He refers to any probability not of this form as p(y), since one cannot ascribe a logical statement to such a probability without more information regarding its context. Since the context here is clear and consistently applied, I think it is just a matter of formalism (i.e., there is no substantial difference). (Jaynes defines what he means by these symbols in Appendix B of Probability Theory: The Logic of Science.)

Jaynes states what he thinks are Bell's hidden assumptions:
 Quote by Jaynes in Clearing Up Mysteries (1)...Bell took it for granted that a conditional probability P(X Y) [sic P(X|Y)] expresses a physical causal influence, exerted by Y on X. ... (2)The class of Bell theories does not include all local hidden variable theories...
He goes on to mention a type of local hidden variable theory he does not think Bell's theorm covers, though I do not yet understand his arguement as to why it isn't covered.

I think a key point to this discussion is how to define local realism in terms of the functional dependence of probability distributions of outcomes of the EPR (thought) experiment. Once this is agreed upon (i.e., all the variables and symbols we are using are well-defined) the rest should just be a matter of mathematics (about which I think we all should be able to agree).

 Related Discussions Quantum Physics 2 Quantum Physics 3 Science & Math Textbooks 0 General Discussion 12 General Physics 4