Requirements of All Hidden Variable Theories

In summary, the article "All quantum observables in a hidden-variables model must commute simultaneously" by James Malley discusses the implications of hidden-variable models for quantum events. The paper shows that, under certain assumptions, all observables in these models must commute simultaneously. This conclusion is in line with the ideas of Bell, Kochen, and Specker, and is also equivalent to the conditions under which the Bell-Clauser-Horne inequalities are derived. The author also notes that this conclusion has implications for the collection of no-go proofs, such as the Greenberger-Horne-Zeilinger, Mermin, and Peres proofs. However, some critics argue that this conclusion does not apply to theories such as Bohmian Mechanics, which can
  • #1
DrChinese
Science Advisor
Gold Member
8,137
1,881
I came across this article, which was published in the February 2004 issue of Physical Review A.

"All quantum observables in a hidden-variables model must commute simultaneously" by James Malley

Abstract: Under a standard set of assumptions for a hidden-variables model for quantum events, we show that all observables must commute simultaneously. And, despite Bell's complaint that a key condition of von Neumann's was quite unrealistic, we show these these conditions are entirely equivalent to those later introduced by Bell, Kochen and Specker. As is it known that these conditions are also equivalent to those under which the Bell-Clauser-Horne inequalities are derived, we see that any experimental violations of the inequalities demonstrate only that quantum observables do not commute.The same conclusion applies to the collection of elegant inequality-free no-go proofs of Greenberger-Horne-Zeilinger, Mermin and Peres.

In essence, this paper states that all hidden variable theories - local or non-local - must necessarily require that observables commute - which is empirically false. This conclusion makes sense to me, if for no other reason than it is another way of saying that reality is observer dependent (and which hidden variable theories are designed to negate).

Von Neumann's famous HV no-go proof of 1932, which was torn down by Bell, is also vindicated in a certain sense. (Although I would not call it a ironclad defense.)

It seems to me that as time passes, it will become clear that no Hidden Variable theory can be made which is both self-consistent and consistent with basic predictions of QM.
 
Physics news on Phys.org
  • #2
What troubles me about that paper (its been on my list to think about for a while!) is that one can clearly augement classical mechanics in such a way that some observables don't commute. Namely, one can simply bring in a disturbance principle. So I generally think of non-commutativity as not being "as much" of a unique feature as Bell violation. A more sophisticated line of thinking is to look at a subset of quantum states and measurements for which the wigner function is always positive - these will have an LHV description, but the observables won't necessarily commute. I know those guys know that, so they must be saying something deeper...
 
  • #3
DrChinese said:
Malley Abstract: ... despite Bell's complaint that von Neumann's was quite unrealistic, we show these ..entirely equivalent to those introduced by Bell...
I’ve found Bell's writings on von Newmann's points as "absurd" convincing. But I'm not able to follow how Malley has Bell as being "equivalent" to von Newmann's. I'd be concerned that if this link was convincing it would indicate that Bell's would be insufficient to contradict LR by his own argument against von Newmann.

I think for the moment I'll question trying to redeem von Newmann’s as equivalent to Bell.
 
  • #4
DrChinese said:
In essence, this paper states that all hidden variable theories - local or non-local - must necessarily require that observables commute - which is empirically false.

What does that even mean? What's given empirically is information about things that are observed. "Observables" (which I guess you're thinking of as operators given the talk of their status vis a vis commutation) are an element of a particular *theory*, namely orthodox QM. How in the world could it possibly be proved that "all observables must commute simultaneously" for theories which might not even *include* the idea of "operators as observables"?

Case in point: Bohmian Mechanics, which can be formualted in terms of a wave-function obeying Schroedinger's equation and particles following definite trajectories *and that's it*.

So the question I have is this: how could this guy's claim possibly be true in regard to Bohmian Mechanics? What does/would it even *mean* when applied to that theory? And, if the claim doesn't apply to Bohm, what in the heck is it supposed to apply to?

It seems to me that as time passes, it will become clear that no Hidden Variable theory can be made which is both self-consistent and consistent with basic predictions of QM.

Sigh. Quit worrying abstractly about what hidden variable theories can and can't do, and just study up on Bohm's theory already! :smile: Then you won't have to wring your brains trying to figure out what is and isn't possible -- you'll just have an explicit *example* of how a hidden variable theory can be made to actually *work* (and hence a counter-example to most of the silly claims that they can't be made to work).
 
  • #5
ttn said:
Case in point: Bohmian Mechanics, which can be formualted in terms of a wave-function obeying Schroedinger's equation and particles following definite trajectories *and that's it*.

So the question I have is this: how could this guy's claim possibly be true in regard to Bohmian Mechanics? What does/would it even *mean* when applied to that theory? And, if the claim doesn't apply to Bohm, what in the heck is it supposed to apply to?

I interpret his statement as follows: Bohmian Mechanics cannot be a self-consistent non-local Hidden Variable theory because:

a) BM predicts [tex]pq\ne qp[/tex]
b) BM is a HV theory
c) All HV theories must predict [tex]pq=qp[/tex] (this is the part Malley added)

I realize that those who accept BM as a viable alternative to oQM will not accept his conclusion. However, I think it is worthy of consideration, especially given where it was published.

Specifically, I find merit in the concept that - BY DEFINITION - any theory that claims to be "Bell realistic" (i.e. Hidden Variable theories) cannot have pq=qp. If they did, then they would be an observer dependent theory. And that is precisely why Hidden Variable theories exist: so there is NO OBSERVER DEPENDENCE for reality. What is the point of having Hidden Variables if this fundamental tenet of QM is preserved?

---------

In other words, you SAY you have a "super" theory in your hand that solves every problem - but BM avails itself of certain criticisms and you certainly must be aware of these given your stated views. Why do you have such difficulty acknowledging the obvious? You don't have to agree with a criticism to acknowledge it. So what if Malley's work is aimed squarely at BM? You are always free to write a rebuttal to Malley and get it published.

This above part is not meant to start a debate, but rather to get us back to the substance of this thread. Which is about Malley's work. So I would simply ask if Malley's ideas could be discussed here. I will start a separate thread to discuss the merits of Bohmian Mechanics. I would invite you to participate in that discussion and would be most interested in learning to see BM in its best light.
 
Last edited:
  • #6
DrChinese said:
And that is precisely why Hidden Variable theories exist: so there is NO OBSERVER DEPENDENCE for reality. What is the point of having Hidden Variables if this fundamental tenet of QM is preserved?

This is where you need to be careful. Take a hidden variable theory which interprets quantum states as epistemic (analogous to Liouville distributions in classical mechanics - i.e. they correspond to some probability distribution over some hidden variables. This is the sort of thing Einstein wanted, in analogy with statistical mechanics and thermodynamics). Then that HVT for QM is very observer dependent - collapse of the wavefunction corresponds to "collapse" of the observers probability distribution when they acquire information after a measurement for example. So features of an HVT may well be observer dependent without being unnatural.

Irrelevant aside: Personally I prefer to call HV theories "ontological models of quantum mechanics" since it is more neutral as to the status of underlying variables...
 
  • #7
Tez said:
Irrelevant aside: Personally I prefer to call HV theories "ontological models of quantum mechanics" since it is more neutral as to the status of underlying variables...

I actually prefer the term "realistic" in place of "hidden variables". I think these have very different implications even though they are often thrown around as identical.

Hidden variables are inputs to a black box set of functions. Bell collectively calls these lambda. A Hidden Variable theory hypothesizes lambda exists. This somewhat follows his (1) but lambda is actually discarded in the wash when it comes down to it.

A realistic theory is one in which particle observables have simultaneous definite values independent of the act of observation. This corresponds to the idea of the moon being there when we aren't looking at in, in Einstein's terms. Bell has a completely different definition for these: in his terms, they are A, B and C (actually he calls them a-hat, b-hat, c-hat and these are the hypothetical measurement settings). In the original Bell, this definition comes in several spots, but the critical one is just after his (14): "It follows that c is another unit vector..." (in addition to A and B). You never go anywhere in Bell without having C in addition to A and B, and I think this point is generally overlooked because it is so casually introduced.

So if you can agree with my thinking (probably a dangerous thing to do), then Bell Reality can be defined as the hypothesis that A, B and C exist independently of observation. In my definition of a realistic theory, there can be simultaneous "reality" for observables even if there is no determinism present that explains the values. This is beneficial because you don't waste time trying to determine the mechanical relationship of hypothetical input variables (inputs) to the outcomes (outputs). So skip lambda altogether as you don't need it for anything anyway. You don't need it to prove Bell.

So I believe that a Bell Realistic theory says that a particle has attributes independent of their observation. This view has absolutely nothing to do with entanglement or Bell tests. I do not believe a Bell Inequality will apply to a theory if you don't agree with this definition.

(Admittedly, there are a lot of ways to make your definitions when it comes to Bell and everyone has their own little twists. I am trying to stick with what I personally believe is Bell's exact mathematical definition - which is why I call it Bell Reality. Bell Reality does not exactly map to EPR's "elements of reality", which have a stricter definition than I think is necessary.)
 
  • #8
DrChinese said:
I interpret his statement as follows: Bohmian Mechanics cannot be a self-consistent non-local Hidden Variable theory because:
a) BM predicts [tex]pq\ne qp[/tex]

My question was what this statement even *means*. Since Bohmian Mechanics isn't formulated in terms of operators, I literally have no idea what you are talking about when you say "BM predicts [that certain operators don't commute]."

c) All HV theories must predict [tex]pq=qp[/tex] (this is the part Malley added)

I just looked very briefly at Malley's paper, and then at another more recent one (quant-ph/0505016, co-authored with Arthur Fine). This latter paper ends with the following statement: "Finally, the sharp conflict with noncommutativity presented here makes essential use of the inner product machinery of Hilbert space and does not apply to models for quantum theory that do not, with the Bohm model being a primary case in point." In other words, this allegedly-general proof that "Under a standard set of assumptions for a hidden-variables model for quantum events, we show that all observables must commute simultaneously" doesn't even apply to the one really-existing example of a hidden variable theory! At very least this means the proof isn't *nearly* as generally applicable (i.e., as interesting) as Malley tries to suggest. I'm inclined to think this makes the proof entirely *uninteresting*, but maybe that's just me.

Specifically, I find merit in the concept that - BY DEFINITION - any theory that claims to be "Bell realistic" (i.e. Hidden Variable theories) cannot have pq=qp.

As we have discussed before, according to your definition of "Bell realistic", Bohmian Mechanics isn't a Bell realistic theory. Yet it's clearly a hidden variable theory if anything is. So I think your terminology ("Bell realism") is just confusing and misleading.

In other words, you SAY you have a "super" theory in your hand that solves every problem

I don't think I ever said that. But I will say one thing: if one wants to understand whether there might be a viable hidden variable alternative to OQM, one would be better-served by studying Bohm's theory than by studying "impossibility proofs". Study the example first, then you'll be able to see with hardly any effort what's *wrong* with (nearly) all the alleged proofs that it can't work. The fact is, it does work.

- but BM avails itself of certain criticisms and you certainly must be aware of these given your stated views.

Sure, I'm aware of some possible objections to BM. But I'm also aware that 99% of the objections that are usually given against BM, are completely bogus or completely false or complete nonsense. Goldstein does a nice job of listing these bogus objections in the Stanford article you linked to on the other thread.

Why do you have such difficulty acknowledging the obvious?

Different things are obvious to different people, I guess. You seem to think that it's obvious that Malley's proof is general and right, and that this therefore constitutes some kind of problem for BM. To me it's obvious that his proof is (at best) simply inapplicable to (at least) some hidden variable theories. It seems in this case I was right, given what Malley confesses at the end of that other paper.

This above part is not meant to start a debate, but rather to get us back to the substance of this thread. Which is about Malley's work. So I would simply ask if Malley's ideas could be discussed here. I will start a separate thread to discuss the merits of Bohmian Mechanics. I would invite you to participate in that discussion and would be most interested in learning to see BM in its best light.

Yes, you're absolutely right; my intention isn't to hijack this thread. I think there's plenty of value in analyzing Malley's paper. I just think the best way to do that is to know going in that it doesn't apply to BM. Just like, if there were a thread here dedicated to studying von Neumann's anti-hidden-variables proof, I'd interject that a hidden variable theory actually *exists*, so we know going in that the proof is *wrong*, which means our analysis should be in the nature of a post-mortem.
 
  • #9
ttn said:
As we have discussed before, according to your definition of "Bell realistic", Bohmian Mechanics isn't a Bell realistic theory. Yet it's clearly a hidden variable theory if anything is. So I think your terminology ("Bell realism") is just confusing and misleading.

Apparently, there is an operational difference between "Bell Realism" and "Hidden Variables". Bell Realism is the requirement that observables have well-defined values independent of the act of observation. That is a component of Bell's Theorem, and I see that as simply a statement of fact. If that is true, then the question is does BM qualify as a Bell Realistic theory? Perhaps it doesn't - even if it is truly a hidden variable theory. I do not purport to know enough about BM to be aware of these differences.

But that is certainly relevant to Malley's paper. :smile:

EPR argued that QM is incomplete because there are "elements of reality" which map to my definition of Bell Realism (i.e. that observables have well-defined values independent of the act of observation, or in EPR's terms that there is not simultaneous reality to non-commuting observables). Bell essentially shows that conclusion as incorrect. Malley is addressing this too.

But as I follow your argument: BM does not qualify as a Bell realistic theory even if it is a good Hidden Variable theory. The reason is that the distinction between the observer and that being observed is not being asserted by BM (just as it is not in oQM) - and it would need to be in order to qualify. If that were the case, then it would become clear to me that the distinction in terms is more relevant than I would have previously suspected. It certainly never occurred to me that BM could fit in between such cracks!
 
  • #10
DrChinese said:
Bell Realism is the requirement that observables have well-defined values independent of the act of observation.

Which ones? All of them? Or just some? BM has particle positions that exist independent of the act of observation (and which observation simply reveals). Does that make it "Bell Realistic"? Or maybe it isn't Bell Realistic, because Bell Realism requires that *all* observables have pre-measurement values that measurement reveals. But then it is *trivial* to see that no "Bell Realistic" theory can reproduce QM predictions. For example, [tex]L_x = \pm 1/2[/tex], and same for [tex]L_y[/tex] and [tex]L_z[/tex]. But we know [tex]L^2 = L_x^2+L_y^2+L_z^2 = 3/4[/tex]. But clearly there are no ways to assign values to the components that will give the right value for [tex]L^2[/tex].

In other words, your definition of "Bell Reality" amounts to the same sort of criterion von Neumann and all the others used to prove that you can't have a realistic theory that reproduces the QM predictions. And we know that all of those "proofs" are wrong, because there exists an explicit counter-example. So I will simply repeat my earlier statement that you'd be better served by looking at how a *real*, *viable* hidden variable theory actually *works*, than by arbitrarily dreaming up plausible-sounding criteria for how they "should" work and then worrying about who can prove what theorem about whether in fact they can be made to work that way.



EPR argued that QM is incomplete because there are "elements of reality" which map to my definition of Bell Realism (i.e. that observables have well-defined values independent of the act of observation, or in EPR's terms that there is not simultaneous reality to non-commuting observables). Bell essentially shows that conclusion as incorrect.

EPR argued that the assumption of locality *requires* the existence of these "elements of reality". Bell didn't prove that this *argument* (from locality to hidden variables) is incorrect. He showed that the *conclusion* of that argument entails something that is contradicted by experiment. And that means the premise of that original argument (locality) must be wrong. That, at least, is how Bell interpreted what he did.

If you think Bell disproved the possibility of hidden variable theories (or you think Bell thought that's what he did) then it's rather a mystery why Bell was the #1 champion of Bohmian Mechanics for about 20 years!



But as I follow your argument: BM does not qualify as a Bell realistic theory even if it is a good Hidden Variable theory.

Honestly, I have no idea. You haven't defined "Bell realistic" precisely enough (yet?) to make it possible to decide if a given theory is or isn't "Bell realistic."

Not that I'm encouraging you to do that. As I said above, I think it's rather pointless. This thread started with your praise (well, your mention) of a paper that claims to show that hidden variables are impossible (b/c all hvt's have to endorse commuting observables which is, allegedly, empirically falsified). My point is simply that this seems like a backwards and contorted strategy. If you want to know whether it's possible to have a realistic quantum theory, don't waste your time getting tangled up in these abstract impossibility proofs. It's a waste of time. Just look at Bohm's theory and understand how it works, because it *does* work, and that means all the "impossibility proofs" are *wrong*. Bohm *disproves* the impossibility proofs, by explicit counterexample.

It certainly never occurred to me that BM could fit in between such cracks!

This makes it sound like BM lives in some very dark, shady nether-region of the space of all possible hidden variable theories. It makes it sound like, by virtue of the fact that it eludes all the alleged impossibility proofs, Bohmian mechanics is somehow suspect. But I think that's a very misleading perspective. Bohmian Mechanics is the *obvious* way of adding hidden variables to quantum theory to reproduce the QM predictions (but eliminate the measurement problem, i.e., QM's "unprofessional vagueness and ambiguity"). And (in a certain sense) it's the only serious example of a hvt that really exists and is known to work. So if anything's shady, it's all the other (unspecified, non-existent) theories. All of these weird non-existent (or only very vaguely specified) theories (like the ones you seem to call "Bell realistic") are the ones that hide in the cracks. Bohmian Mechanics is right out there in the direct sunlight for all to see -- so let's all take advantage of that fact and look!
 
  • #11
DrChinese said:
I came across this article, which was published in the February 2004 issue of Physical Review A.
"All quantum observables in a hidden-variables model must commute simultaneously" by James Malley
Abstract: Under a standard set of assumptions for a hidden-variables model for quantum events, we show that all observables must commute simultaneously. And, despite Bell's complaint that a key condition of von Neumann's was quite unrealistic, we show these these conditions are entirely equivalent to those later introduced by Bell, Kochen and Specker. As is it known that these conditions are also equivalent to those under which the Bell-Clauser-Horne inequalities are derived, we see that any experimental violations of the inequalities demonstrate only that quantum observables do not commute.The same conclusion applies to the collection of elegant inequality-free no-go proofs of Greenberger-Horne-Zeilinger, Mermin and Peres.
In essence, this paper states that all hidden variable theories - local or non-local - must necessarily require that observables commute - which is empirically false. This conclusion makes sense to me, if for no other reason than it is another way of saying that reality is observer dependent (and which hidden variable theories are designed to negate).
Von Neumann's famous HV no-go proof of 1932, which was torn down by Bell, is also vindicated in a certain sense. (Although I would not call it a ironclad defense.)
It seems to me that as time passes, it will become clear that no Hidden Variable theory can be made which is both self-consistent and consistent with basic predictions of QM.
With all respect to you; did you read the paper of Aharonov and Gruss: Two-time interpretation of quantum mechanics ; arXiv :quant-ph/0507269 v1 28 Jul 2005? There is an interesting exposé of the actual situation concerning the question you are indirectly asking; I believe. I didn't red the other interventions on this thread; so I apologize if my suggestion is in someway a repetition of some other made here. The classification proposed by Aharonov and Gruss pages 1 + 2 seems to be clear enought to me.
 
  • #12
So my intervention does not concern the question of commutation but only the properties owned by the different types of theories (HLV, BM, local, non local, deterministic or not, ...). Perhaps it can help to reduce the number of questions and eliminate some theoretical possibilities inside your investigation (e.g: a non local theory defies the relativistic covariance...)
 
  • #13
ttn said:
So I will simply repeat my earlier statement that you'd be better served by looking at how a *real*, *viable* hidden variable theory actually *works*, than by arbitrarily dreaming up plausible-sounding criteria for how they "should" work and then worrying about who can prove what theorem about whether in fact they can be made to work that way.

EPR argued that the assumption of locality *requires* the existence of these "elements of reality". Bell didn't prove that this *argument* (from locality to hidden variables) is incorrect. He showed that the *conclusion* of that argument entails something that is contradicted by experiment. And that means the premise of that original argument (locality) must be wrong. That, at least, is how Bell interpreted what he did.

1. You haven't defined "Bell realistic" precisely enough (yet?) to make it possible to decide if a given theory is or isn't "Bell realistic."

2. This makes it sound like BM lives in some very dark, shady nether-region of the space of all possible hidden variable theories. It makes it sound like, by virtue of the fact that it eludes all the alleged impossibility proofs, Bohmian mechanics is somehow suspect...

1. I am trying to map Bell Reality to the exact definition Bell uses, so I think that is pretty specific. Assume that a particle has simultaneous well-defined values for observables independent of a measurement. For Bell that was 3 different angle settings for a SG magnet which he calls a, b and c. These are NOT hidden variables in the sense that they are somehow deterministic! The purpose of the EPR argument was not to restore determinism to the theory, but rather to restore the concept of an objective reality independent of the role of the observer.

2. You are putting words in my mouth on this one, there was nothing sinister intended by my comment. The cracks are the distance between 2 definitions that are almost always used interchangeably - those of "Hidden Variable" and "Bell Realistic". It has nothing to do with BM. And I am as guilty of using those terms interchangeably as anyone anyway.

The point is that I learned something I didn't know before: BM is a hidden variable theory which apparently does not qualify as a realistic theory by Bell's standards.
 
  • #14
DrChinese said:
1. I am trying to map Bell Reality to the exact definition Bell uses, so I think that is pretty specific. Assume that a particle has simultaneous well-defined values for observables independent of a measurement. For Bell that was 3 different angle settings for a SG magnet which he calls a, b and c.

OK, sure. Really he assumes even more than that -- namely, that there exist *functions* like A(a,L) which specify Alice's outcome as a function of the particle state (L) and Alice's magnet setting (a). But the existence of this function obviously entails what you specifically mention -- the values of A for three different values of a.


These are NOT hidden variables in the sense that they are somehow deterministic!

I don't follow you. In the paper you have in mind (Bell's first paper on this stuff) he does assume deterministic hidden variables -- i.e., the functions A(a,L) and B(b,L) that I mentioned above. These are *functions*, right? You tell me the state of the particles and the orientation of your polarizer, and the function spits out what the outcome is going to be -- and it's either +1 or -1, nothing wishy-washy or superpositiony or stochastic. One can derive Bell-type inequalities without the assumption of determinism, too... but then, determinism is *required* by the fact of perfect correlations (when Alice's a and Bob's b are the same). Any randomness will have to show up as a chance for imperfect correlations, so (assuming we want to reproduce this particular aspect of the QM predictions) we can dispense with non-deterministic local theories right away.

But I don't really understand why you said what you said about determinism, so maybe I'm missing your point. But I think it's nevertheless clear that Bell's hidden variables -- the functions A(a,L) and B(b,L) -- are deterministic. The outcomes are determined by the setting and the state, without any randomness.

The purpose of the EPR argument was not to restore determinism to the theory, but rather to restore the concept of an objective reality independent of the role of the observer.

The purpose of the EPR argument was to prove exactly what it proved -- that locality *requires* the existence of local hidden variables... i.e., that the locality requirement *conflicts* with the completeness assumption. If you want locality, you have to have hidden variables. If you want completeness, you have to jettison locality.


The point is that I learned something I didn't know before: BM is a hidden variable theory which apparently does not qualify as a realistic theory by Bell's standards.

I'm still not clear on the definition of "bell reality". But one thing is for sure: BM is a hidden variable theory which does not qualify as a *local* theory by Bell's standards. BM violates Bell Locality. That's just a formal and rigorous way of saying something that's rather plainly obvious anyway: BM is a non-local theory. And *that* is the main reason why Bell's Theorem doesn't apply to it. Bell's Theorem proves that *local* hidden variable theories have to disagree with the QM predictions (and, it seems, experiment). Nonlocal theories (like Bohm's or like OQM) can of course agree with experiment.

I know this is old ground that we've been over painfully many times, but I think it's a crucial point that people seem to repeatedly miss. Bell's Theorem shows that non-locality is inevitable. It simply doesn't speak to the issue of completeness (i.e., hidden variables) at all. Post-Bell, it is entirely possible to have a viable theory either with or without hidden variables -- OQM and Bohm being the obvious two examples. What we now know you *can't* have is a local (specifically, "Bell Local") theory.

So why encumber QM with hidden variables if you're stuck with non-locality either way? To solve the measurement problem. Which Bohm's theory does, clearly and unambiguously. And it provides a wonderfully simple, intelligible ontology to boot. Who could ask for anything more?
 
  • #15
ttn said:
I know this is old ground that we've been over painfully many times, but I think it's a crucial point that people seem to repeatedly miss. Bell's Theorem shows that non-locality is inevitable. It simply doesn't speak to the issue of completeness (i.e., hidden variables) at all. Post-Bell, it is entirely possible to have a viable theory either with or without hidden variables -- OQM and Bohm being the obvious two examples. What we now know you *can't* have is a local (specifically, "Bell Local") theory.
Actually, and the good doctor has been repeatedly pointing this out, Bell's theorem makes multiple assumptions, and (stipulating that oQM makes accurate predictions) only eliminates local and realistic theories.
For example, it's entirely plausible to have a local, hidden, non-realistic theory, and, from what I know, an example might be the Many Worlds interpretation where Bell's [itex]\lambda[/itex] isn't necessarily well-defined until measurement occurs, another possibility might be a non-standard notion of probability.
Moreover, it's not always clear which assumption to consider as invalid: It's not necessarily pretty, but it seems like 'tiny wormholes' could also be a viable QM interpretation. In this case, Bell's theorem does not apply because there is no space-like seperation.
Naturally, there are limitations on what assumptions we're willing to question.
 
  • #16
ttn said:
OK, sure. Really he assumes even more than that -- namely, that there exist *functions* like A(a,L) which specify Alice's outcome as a function of the particle state (L) and Alice's magnet setting (a). But the existence of this function obviously entails what you specifically mention -- the values of A for three different values of a.

I don't follow you. In the paper you have in mind (Bell's first paper on this stuff) he does assume deterministic hidden variables -- i.e., the functions A(a,L) and B(b,L) that I mentioned above. These are *functions*, right? You tell me the state of the particles and the orientation of your polarizer, and the function spits out what the outcome is going to be -- and it's either +1 or -1, nothing wishy-washy or superpositiony or stochastic.

One can derive Bell-type inequalities without the assumption of determinism, too... but then, determinism is *required* by the fact of perfect correlations (when Alice's a and Bob's b are the same). Any randomness will have to show up as a chance for imperfect correlations, so (assuming we want to reproduce this particular aspect of the QM predictions) we can dispense with non-deterministic local theories right away.

OK, we going to agree to disagree about Bell proving non-locality. And this discussion doesn't need that branch since we have another thread for that. :smile:

But I am going to point out that the hidden variable functions "i.e., the functions A(a,L) and B(b,L)" are mentioned in Bell DISAPPEAR completely by the end of his (21). In fact, you absolutely need no reference to the hidden variables to make his proof. So I am saying unambiguously that the hidden variables of (1) and (2) play no part in the proof of Bell's Theorem. The only relevance is that we need to make explicit that:

"The vital assumption is that the result B for particle 2 does not depend on the setting a of the magnet for particle 1, nor A on b."

This is the Bell Locality condition, plain and simple. You need this and the Bell Reality condition to get Bell's Theorem. You don't need Hidden Variables EVEN though Bell refers to them as if they were important to the final result.

It is instead the Bell Realistic requirement (in his (14), "It follows that c is another unit vector"). If there is no a, b and c, then there is no proof. You only need a, b and c with specific angle settings and the cos^2 rule to get a truth table with "impossible" values. You can see my version this proof for yourself and see that there are no hidden variables - only simultanous non-negative values for the 8 hypothetical outcome permutations.

Assuming there are hidden variables - local or non-local - that actually determine the outcomes is not needed. The last question is whether the setting at Alice affects the outcome at Bob and therefore skews the experiment itself. You handle this by assumption - if you think it is needed. If you do incorporate it, as Bell did, then the scope of the theorem is made to apply to local realistic theories rather than all realistic theories.

And again, Bell's definition of Realism is intended to match up to EPR's elements of reality. Despite their name, these are observable properties and are NOT hidden variables. Determinism is NOT required to explain the perfect correlations. Otherwise oQM would have been ruled out a long time ago. The Born rule says it all.
 
  • #17
DrChinese said:
In essence, this paper states that all hidden variable theories - local or non-local - must necessarily require that observables commute - which is empirically false. This conclusion makes sense to me, if for no other reason than it is another way of saying that reality is observer dependent (and which hidden variable theories are designed to negate).

I don't see how non-local hidden variable theories can be categorically invalidated since they're not necessarily causal.
 
  • #18
DrChinese said:
But I am going to point out that the hidden variable functions "i.e., the functions A(a,L) and B(b,L)" are mentioned in Bell DISAPPEAR completely by the end of his (21). In fact, you absolutely need no reference to the hidden variables to make his proof. So I am saying unambiguously that the hidden variables of (1) and (2) play no part in the proof of Bell's Theorem.

So... let me get this straight. You're saying that you can derive a Bell Inequality without assuming hidden variables? You only need to assume... what? Bell Locality?

I think you're wrong that this is possible, though of course I'd love to see how the proof goes if you want to show me. But even leaving that aside, I don't understand how this relates to what I took you to be saying before. If you can derive a Bell Inequality without any assumption of hidden variables, then it follows (from the fact that the Bell Inequality is violated in experiments) that Bell Locality (or whatever you *did* assume in the derivation) is false. And that sounds a lot like the conclusion I've been pulling my hair out to convince you of (though by a somewhat more complicated argument). So I'm now quite baffled.


The only relevance is that we need to make explicit that:
"The vital assumption is that the result B for particle 2 does not depend on the setting a of the magnet for particle 1, nor A on b."
This is the Bell Locality condition, plain and simple. You need this and the Bell Reality condition to get Bell's Theorem.

Yeah, that's Bell Locality. I agree. But what exactly is this "Bell Reality" condition we also need to get the inequality? You said before that you wanted to identify "Bell Reality" with the idea of hidden variables, but then you said above we don't have to postulate any hidden variables to get the inequality. Ack.

You don't need Hidden Variables EVEN though Bell refers to them as if they were important to the final result.

OK, so you need "Bell Reality" but not "Hidden Variables". You'll have to define these terms, though, or else this is really vague. Usually people use the term "hidden variables" to refer to any extra variables beyond the wave function. So Bell's outcome functions A(a,L) (etc.) are hidden variables... at least the way people I know have always used that term.


It is instead the Bell Realistic requirement (in his (14), "It follows that c is another unit vector"). If there is no a, b and c, then there is no proof. You only need a, b and c with specific angle settings and the cos^2 rule to get a truth table with "impossible" values. You can see my version this proof for yourself and see that there are no hidden variables - only simultanous non-negative values for the 8 hypothetical outcome permutations.

This is a standard derivation -- same as the one in, e.g. Sakurai's text, and I think it goes back originally to Wigner. But regardless, you're loopy if you think there are no hidden variables in this derivation. These 8 different categories you're talking about are the 8 possible states that could explain the perfect correlations (when A and B measure along the same axis) -- each state attributing a definite possible outcome to the measurements on each side (and, crucially, all 3 measurements even though only one can in fact be performed!). Each row of your table is one of the 8 possible "hidden variable states", one of the 8 possible "values" of "lambda" in this situation.

Now maybe you want to play pointless semantic games and say that your 8 different possibilites aren't "hidden variables" but are instead "Bell realities" or something. But please don't. Each row of your table is supposed to be a possible state of the particles, and each row attributes more definite identity to the state than is contained in the wf (namely, it attributes definite values for the 3 possible spin outcomes). So it has hidden variables.

Assuming there are hidden variables - local or non-local - that actually determine the outcomes is not needed.

Then why do you do it in your proof?

The last question is whether the setting at Alice affects the outcome at Bob and therefore skews the experiment itself. You handle this by assumption - if you think it is needed. If you do incorporate it, as Bell did, then the scope of the theorem is made to apply to local realistic theories rather than all realistic theories.

Are you saying you can get a Bell Inequality without the locality assumption either! :smile:


And again, Bell's definition of Realism is intended to match up to EPR's elements of reality. Despite their name, these are observable properties and are NOT hidden variables.

You're confusing yourself with terminology. Of course the hidden variables are in some sense observable. If you think particles carry around instruction sets that tell them how to react for spin measurements along different axes, you can obviously "observe" (at least) part of the instruction set by making some measurement or other. But the point is that QM doesn't attribute any such instruction set, and what "hidden variables" *means* is: anything additional to the wf that's supposed to describe the state of a quantum system. If your point is just that this is a stupid name, since (as is the case with Bohm's theory) the "hidden variables" are often anything but hidden, I agree. But then that's a very different point.


Determinism is NOT required to explain the perfect correlations.

Of course not. OQM is non-deterministic and explains the perfect correlations just fine. But then it's not Bell Local. My actual claim was that, once you insist on Bell Locality, determinism is required to explain the perfect correlations.
 
  • #19
NateTG said:
I don't see how non-local hidden variable theories can be categorically invalidated since they're not necessarily causal.

There are groups of no-go theorems out there that are nipping at the non-local HV theories. The basic idea, as I read them, is that they must make assumptions that result in an internal inconsistency somewhere even if that inconsistency is not otherwise obvious. So even a non-deterministic one might make assumptions are problematic. Honestly, it comes back to how the theory defines "hidden variable" or "realistic".

Mind you, I am not sure they are good proofs. However, I have to wonder aloud** how we can have Bell non-locality and yet have signal locality. So that is what leads me to the idea that the proofs *might* have some merit.

I am still trying to evaluate Malley's proof. It is pretty involved, probably more than I can handle. But try I will.

**It's a rhetorical question, because obviously you can construct such a theory as ttn has demonstrated.
 
Last edited:
  • #20
DrChinese said:
I have to wonder aloud** how we can have Bell non-locality and yet have signal locality.

I know, I know, it was a rhetorical question. But it's a good one, so it deserves to be answered anyway. So...

There are at least two ways. Either the non-local causation is *uncontrollable* so we can't use it to send a signal (this is the case with OQM -- if you could make the wave function collapse one way or the other by controlling which of the two possible outcomes occurs locally, you could send a signal). Or the non-local causation is "in principle controllable" but, in fact, washed out by ineliminable uncertainty over the initial conditions (this is the case with Bohm's theory -- if you knew the initial positions of both particles in the pair, you could control the trajectory of one particle by adjusting the magnetic fields exerted on the other, and thereby send a signal, but since knowledge of the initial positions is limited by the QEH, you can't send a signal).

There might be other ways, too, for a theory to be Bell Nonlocal but still Signal Local. But those seem to be the most obvious two ways, and it's interesting that the two existing theories utilize them.
 
  • #21
ttn said:
But those seem to be the most obvious two ways, and it's interesting that the two existing theories utilize them.

Funny, I think of QM as signal local, Bell Local AND Bell non-realistic. Only the collapse of the wave function is non-local and I am not too sure about that.
 
  • #22
I am thinking aloud right now, attempting to come up with a way of sending a signal via Bell non-locality.

So let's say we fire photon's through a beam-splitter and recombine them to generate an interference pattern. Now imagine we place a down-converter inside beams A and B, which generates signal beams A' and B' respectively. If A' or B' is detected, this tells us which beam photon P is a member of, thus destroying the interference pattern. Now imagine the detectors are one lightyear away. In attempt to return the interference pattern to the screen, somebody removes the detectors.

To me it appears that this act would not only send a signal faster than light, it would send a signal backward in time. The signal photons would be one year old, and so the interference pattern should appear a year before the detectors are removed.

My assumption here is that I have made a mistake. I have no knowledge of the math of quantum mechanics. I am merely relaying this because it is something that has puzzled me recently.
 
  • #23
DrChinese said:
Funny, I think of QM as signal local, Bell Local AND Bell non-realistic. Only the collapse of the wave function is non-local and I am not too sure about that.

Um, "orthodox QM" includes the collapse postulate, right? (Without it, the theory would be *trivially* inconsistent with experiment, since it would predict that experiments don't have definite outcomes, which, in fact, they do.) So it's not local.

In other words, if you "think of QM as ... Bell Local", you're just wrong. Orthodox QM violates Bell Locality; that's just a plain fact (as I've pointed out here almost ad nauseum). That OQM is local in some other sense (e.g., that it is signal local) or that some other theory is Bell Local (e.g., some crazy nonsense you get by trying to have OQM but without the collapse postulate) doesn't change that fact.

Whether or not OQM is "Bell Realistic" is, to me at least, an open question, since you still haven't clearly pinned down what you mean by that adjective.
 
  • #24
ttn said:
DrChinese said:
Funny, I think of QM as signal local, Bell Local AND Bell non-realistic. Only the collapse of the wave function is non-local and I am not too sure about that.

Um, "orthodox QM" includes the collapse postulate, right? (Without it, the theory would be *trivially* inconsistent with experiment, since it would predict that experiments don't have definite outcomes, which, in fact, they do.) So it's not local.

In other words, if you "think of QM as ... Bell Local", you're just wrong. Orthodox QM violates Bell Locality; that's just a plain fact (as I've pointed out here almost ad nauseum). That OQM is local in some other sense (e.g., that it is signal local) or that some other theory is Bell Local (e.g., some crazy nonsense you get by trying to have OQM but without the collapse postulate) doesn't change that fact.

Whether or not OQM is "Bell Realistic" is, to me at least, an open question, since you still haven't clearly pinned down what you mean by that adjective.

Seems to me this is one of those online debates that can never end because it's based on a difference in preference so deep that neither of you can appreciate the other's points. And who really cares? QM is what it is and I think you both agree that signals, information and such can't be sent faster than light using entanglement. For me it's sufficient to say that QM is DrChinese-local but not ttn-local and leave it at that!
 
  • #25
selfAdjoint said:
For me it's sufficient to say that QM is DrChinese-local but not ttn-local and leave it at that!

Well said! :-p
 
  • #26
selfAdjoint said:
For me it's sufficient to say that QM is DrChinese-local but not ttn-local and leave it at that!

Bah. What is that sufficient for, really? Ending an otherwise never-ending argument, maybe. But surely there's a real fact of the matter that, in principle, could be clarified to the point that people would agree. I mean, "Bell Locality" is a perfectly precisely defined idea: the probability of an event given some complete specification of the state in the past light cone, doesn't change if you *also* conditionalize on some junk that is spacelike separated. That is, P(A|lambda) = P(A|lambda,...) where the "..." refers to events/information that is spacelike separated from the measurement event A. It's straightforward to ask of a given theory: is this theory consistent with this mathematical condition, or not? And for a theory like OQM whose rules we all agree about, there *shouldn't* be some big problem or ambiguity about whether it is or isn't Bell Local. The fact just is, that OQM isn't Bell Local.

But if you are unable or unwilling let yourself see that, I can't force you. So I'll stop pushing the point. But don't fool yourself into believing there's some virtue in "agreeing to disagree". This is not an optional, personal, subjection issue. There's a right answer and a wrong answer. OQM just is or just isn't Bell Local. Maybe you're not clear on the definitions involved or not sure about how to answer the question, so you have to just say "I don't know what the answer is." But please, please, please don't imply that these basic foundational questions have no answers. That's a terribly unscientific attitude.
 
  • #27
Signal Locality

As to signal locality, I just made a post that appears to violate it as well, which can't be right. Does anybody have an answer to it, or should I start a new thread since even though this relates it is slightly off topic. (And maybe the question has already been asked and answered several hundred times.)
 
  • #28
ttn said:
I mean, "Bell Locality" is a perfectly precisely defined idea:

If that's so, why the long debate over precisely what it DOES mean? Are you one of these people who, like Carrol's Humpty-Dumpty, insist that words precisely mean only what you decree them to?

To my mind the argument isn't over QM but over the meaning of Bell's text; that is, it is fundamentally a literary disagreement. And literary disagreements, aside from being OT in a physics forum, are never-ending.
 
  • #29
selfAdjoint said:
If that's so, why the long debate over precisely what it DOES mean? Are you one of these people who, like Carrol's Humpty-Dumpty, insist that words precisely mean only what you decree them to?
To my mind the argument isn't over QM but over the meaning of Bell's text; that is, it is fundamentally a literary disagreement. And literary disagreements, aside from being OT in a physics forum, are never-ending.

Anyone who wants to know what "Bell Locality" means should read his last essay: La Nouvelle Cuisine. He makes it crystal clear there (though he calls it his "local causality condition", not "Bell Locality").

That said, I will now do my part to help prevent this discussion from becoming never-ending.
 

Related to Requirements of All Hidden Variable Theories

1. What is the concept of hidden variables in theories?

The concept of hidden variables in theories refers to the idea that there may be underlying variables or factors that are not directly observable, but can still influence the behavior or outcomes of a system.

2. What are the requirements for a theory to be classified as a hidden variable theory?

There are three main requirements for a theory to be considered a hidden variable theory: 1) it must propose the existence of hidden variables, 2) it must provide a mechanism for how these hidden variables influence the system, and 3) it must be able to make testable predictions that can be compared to experimental data.

3. How do hidden variable theories differ from other types of theories?

Hidden variable theories differ from other types of theories, such as deterministic or probabilistic theories, in that they propose the existence of underlying variables that cannot be directly observed, but can still affect the behavior of the system.

4. What is the significance of hidden variable theories in science?

The significance of hidden variable theories in science lies in their potential to provide a deeper understanding of complex systems and their behavior. They can also help to bridge gaps between different theories and provide more comprehensive explanations for phenomena.

5. Are there any limitations or controversies surrounding hidden variable theories?

Yes, there are some limitations and controversies surrounding hidden variable theories. One limitation is that they are often difficult to test and verify experimentally. There is also ongoing debate about the validity and necessity of hidden variables in certain theories, as well as the interpretation of their role in determining outcomes.

Similar threads

Replies
80
Views
4K
  • Quantum Physics
Replies
7
Views
1K
Replies
7
Views
1K
  • Quantum Physics
Replies
1
Views
772
Replies
44
Views
3K
Replies
93
Views
5K
Replies
17
Views
2K
  • Quantum Physics
3
Replies
72
Views
7K
Replies
33
Views
3K
Replies
25
Views
2K
Back
Top