A Statistical ensemble interpretation done right

  • #251
PeterDonis said:
I disagree. For example, (2) is our current belief regarding traveling faster than light. You could quibble and say that we might discover a method of FTL travel some time in the future, but our best current theories of physics say it's impossible--not just that we haven't figured out how yet, but that there is no way to do it at all. Reasonable discussions of our best current theories make use of statements like this all the time.
There are a lot of things that we can be certain are impossible. But claiming to know that something cannot be known is quite different than a claim postulating that you can't travel faster than the speed of light. But even if it is granted that the original claim was just a postulate that the uncertainty in QT is not due to ignorance (afaik there's no such postulate in QT), there's still a burden to define those terms in a non-contradictory way and I haven't seen such definitions.
 
Physics news on Phys.org
  • #252
Fra said:
A common method is proof by contradiction.

Sure bell ansatz does not cover all possibilities, but it is an example of a proof by contradiction, as QM(and more important -experiments) does not obey the implied inequality that follows from explaining it all by an uninformed physicist assuming bell style local realism.

/Fredrik
Yes, it proves that those possibilities it covers are inconsistent (contradictory) with its assumptions. It doesn't prove that it is impossible to find a possibility that is consistent with its assumptions.
 
  • #253
lodbrok said:
You don't see the contradiction between "complete knowledge" and "uncertainty"? How exactly does uncertainty arise when you have "complete knowledge"?
If I know that a quantum system is prepared in a pure state, then I have "complete knowledge" about the system, but I don't know, which measurement result I get when measuring an observable for whose representing operator this state is not an eigenstate. So in QT, even with complete knowledge, there's uncertainty about the outcome of measurements.

There are also the uncertainty relations. E.g., for momentum and position you get ##\Delta x \Delta p_x \geq \hbar/2##, which implies that neither position nor momentum can ever be determined, although either of them can be as precisely determined as you like, but then the other becomes very uncertain and vice versa.
lodbrok said:
Mathematically:
Certainty = Probability 1 or Probability 0 = Complete Knowledge
Uncertainty = 0< Probability < 1
"Complete Knowledge" and "Certainty" mean the same thing. If you disagree, provide a consistent mathematical definition for both.
Not in QT. The point is that in a given pure state ("complete knowledge") never all observables take determined values.
lodbrok said:
The second part of your statement (bold) illustrates the problem. A pure state does not mean "complete knowledge" of the system it means complete information about the preparation procedure. That's why non-compatible observables are uncertain.
Within QT knowing that the system is prepared in a pure state means that you have "complete knowledge". It's simply not possible to prepare the system "more precisely" in any sense than preparing it in a pure state. That's also why the von Neumann entropy of a pure state is 0, i.e., then there's no "missing information".
 
  • #254
I would say that the overall "uncertainty" in predictions has at least two sources, beyond the simple "ignorance" we discussed....

1) Non-commutativity of what we want to predict, this is new to QM

2) Uncertainty because in a real inference you never attain infinite confidence in finite time, this we have also in classical mechanics

(1) this is not even a postualte, it follows from the NEW definition of observables. Those that keep thinking p and x can be known with arbitrary precision in QM, are simply confusing the classical mechanics _definiton_ of the generalized momenat, with the quantum mechanical defintions with conjugate variables. This is a simple property of the fourier transform defining all conjugate variables.

(2) A "pure state" in QM, means we have infinide confidence in the state preparation. This is of course not possible exactly. It's a fiction, just as is zero entropy. From discussions on here, we clearly disagree wether this is a "practical issue" of no fundamental importance for understanding the nature of interactions or not. I think this is a practical issue in classical mechanics, but at least not in the way I "interpret" QM in the context of trying to acheive unification, including gravity. I find that this "practical issue" in rather a potential natural regulator, that can bring order to things which today is a mess of divergences and fine tuning. At least I think it's an objective possibility, we can't rule it out.

In this thread, my main focus was on (2), which per see, has nothing to do with bells theorem. I think it's helpful to distinguish the cases here.

/Fredrik
 
  • #255
lodbrok said:
A pure state does not mean "complete knowledge" of the system it means complete information about the preparation procedure.
I think this statement needs to be refined, as many different procedures can produce the same state. The state does not tell us the name of the physicist doing the preparing, for example.

An instrumentalist might say something like a pure state is complete insofar as it minimizes von Neumann entropy.
 
  • Like
Likes gentzen and vanhees71
  • #256
lodbrok said:
There are a lot of things that we can be certain are impossible.
Which contradicts your previous claim.

lodbrok said:
But claiming to know that something cannot be known
Nobody made such a claim. The claim that was made is that it might be the case that that something cannot be known. Nobody claimed that we know that is the case. But you were claiming that "something cannot be known" was not even a possibility at all. Now you are contradicting yourself.

lodbrok said:
is quite different than a claim postulating that you can't travel faster than the speed of light.
It isn't a postulate in relativity, it's a consequence of the theory. If the theory eventually turns out to be only an approximation to some other theory, that some other theory might say something different about this.

lodbrok said:
But even if it is granted that the original claim was just a postulate that the uncertainty in QT is not due to ignorance (afaik there's no such postulate in QT), there's still a burden to define those terms in a non-contradictory way and I haven't seen such definitions.
I don't know what you're talking about. Such definitions have been given in this thread. You might not like them, but that doesn't mean they aren't there.
 
  • #257
PeterDonis said:
Which contradicts your previous claim.Nobody made such a claim. The claim that was made is that it might be the case that that something cannot be known. Nobody claimed that we know that is the case. But you were claiming that "something cannot be known" was not even a possibility at all. Now you are contradicting yourself.
I'd say the "standard claim" of QT is not only that "something cannot be known" (i.e., the values of all observables of any given system at once) but it says that indeed in Nature there's no state that the values of all observable of a system cannot take determined values. It's not about subjective ignorance, for whatever reason, but about objective behavior of Nature.

Of course, this claim can never be proven mathematically. No physical content, in fact, can be proven by pure math/thought, but we can check it by experiments/observations in Nature.

Bell's work is so important in this matter, because it translated a vague philosophical claim by EPR into a clear scientific hypothesis, which can be tested against the predictions of QT, i.e., the assumption of "realism" (i.e., all values of all observables always take determined values) and "locality" (i.e., that properties of far-distant parts of any system are independent, which should rather be called "separability" than "locality", as discussed many times, controversally, in this forum), leading to Bell's inequalities, which are violated by the predictions of QT for entangled quantum systems.

All corresponding tests lead to the conclusion that QT is right (Nobel prize in physics 2022).
PeterDonis said:
It isn't a postulate in relativity, it's a consequence of the theory. If the theory eventually turns out to be only an approximation to some other theory, that some other theory might say something different about this.
I thought we discuss QT here. The quibbles of EPR of course apply in both non-relativistic QM and relativistic QFT.

Of course, as any physical theory also QT is open for revision, as soon as new, reproducible empirical facts become known, which cannot be explained by it. It's pretty clear that QT is not complete, as long as we don't have a consistent quantum theory including the gravitational interaction. Unfortunately there are no empirical hints at, how a more comprehensive theory might look like.
 
  • Like
Likes Lord Jestocost
  • #258
vanhees71 said:
I thought we discuss QT here.
QFT, which depends on SR, is part of QT.
 
  • #259
PeterDonis said:
You don't know how to do it because it is impossible to do it. No matter how much effort you expend, you will never be able to figure out how to do it because it is impossible.
PeterDonis said:
No, but you can consider that as a possibility if you've been trying and trying and not succeeding.
But considering it as a possibility is different from knowing that it is impossible. Thus if we don't know how we also don't know whether it is impossible to know or whether we just haven't been able to figure it out how.
 
  • Like
Likes Lord Jestocost
  • #260
vanhees71 said:
t says that indeed in Nature there's no state that the values of all observable of a system cannot take determined values. It's not about subjective ignorance, for whatever reason, but about objective behavior of Nature.
This is correct only when you replace Nature by QT, and 'values of observables' by 'eigenvalues of operators corresponding to observables'. Equating these is an interpretation, not as claim of QT !
 
  • Like
Likes physika, Lord Jestocost and gentzen
  • #261
PeterDonis said:
QFT, which depends on SR, is part of QT.
The most important "philosophical" or rather "interpretative" questions raised by quantum mechanics also remain with the transition to quantum field theory.
 
  • #262
A. Neumaier said:
This is correct only when you replace Nature by QT, and 'values of observables' by 'eigenvalues of operators corresponding to observables'. Equating these is an interpretation, not as claim of QT !
That's part of the minimal statistical interpretation. A mathematical scheme without any relation to observable facts about Nature is not a physical theory. "Values of observables" are readings on a measurment device.
 
  • #263
vanhees71 said:
That's part of the minimal statistical interpretation.
But the minimal interpretation is an interpretation. QT has different interpretations. For example, what you claim is wrong in the maximal, thermal interpretation.
vanhees71 said:
A mathematical scheme without any relation to observable facts about Nature is not a physical theory.
But a minimal interpretation is deliberately silent (by minimality) about anything more than guaranteed by the observations. Assertions about irreducible randomness are no longer minimal.
vanhees71 said:
"Values of observables" are readings on a measurment device.
The only thing standard QT says about these is that in experiments that can be described well by idealized von-Neumann-measurements, these values are determined stochastically by Born's rule. The latter contains no statement about the reasons for the observed randomness.
 
  • Like
Likes mattt, Lynch101, lodbrok and 1 other person
  • #264
A. Neumaier said:
But the minimal interpretation is an interpretation. QT has different interpretations. For example, what you claim is wrong in the maximal, thermal interpretation.
What is the maximal, thermal interpretation? Is it what you hitherto called "thermal interpretation"? With this I still have my quibbles of understanding. So I can't really comment on it.
A. Neumaier said:
But a minimal interpretation is deliberately silent (by minimality) about anything more than guaranteed by the observations. Assertions about irreducible randomness are no longer minimal.
In the minimal statistical interpretation you claim that all there is are the probabilities for the outcomes of measurements, and nothing else, not described by QT, which implies that there is "irreducible randomness". I always thought that's why many (usually philosophically inclined) physicists have their epistemological problems with it. Einstein seems to have been a proponent of this interpretation, but at the same time he was dissatisfied with this conclusion and thus thought QT to be "incomplete", i.e., there should indeed be a deterministic (or "realistic") description, and that's why he looked for his unified classical field theories.
A. Neumaier said:
The only thing standard QT says about these is that in experiments that can be described well by idealized von-Neumann-measurements, these values are determined stochastically by Born's rule. The latter contains no statement about the reasons for the observed randomness.
The reasons for physical theories are usually that it works, i.e., it's in accordance with the observations, and that's the case also for QT ;-)).
 
  • Like
Likes Lord Jestocost
  • #265
vanhees71 said:
What is the maximal, thermal interpretation? Is it what you hitherto called "thermal interpretation"?
It is just the thermal interpretation, with 'maximal' added for emphasis and contrast, since it contains the minimal interpretation, but also much more that is not addressed in the latter.
vanhees71 said:
In the minimal statistical interpretation you claim that all there is are the probabilities for the outcomes of measurements,
Yes.
vanhees71 said:
and nothing else,
No. This is not the minimal interpretation, but your addition to it. It makes an absolute, empirically not checkable and hence purely philosophical statement about Nature.

The minimal interpretation drops this, and hence is more minimal than what you like to call minimal. It is the consensus part where all interpretations agree.

vanhees71 said:
not described by QT, which implies that there is "irreducible randomness". I always thought that's why many (usually philosophically inclined) physicists have their epistemological problems with it.
Yes, because it is an extremely strong additional philosophical assumption, not needed to explain the success of QT!
vanhees71 said:
The reasons for physical theories are usually that it works, i.e., it's in accordance with the observations, and that's the case also for QT ;-)).
For this one only needs the minimal interpretation, and not your nonminimal addition 'and nothing else'!
 
Last edited:
  • Like
Likes physika, mattt, PeterDonis and 1 other person
  • #266
vanhees71 said:
In the minimal statistical interpretation you claim that all there is are the probabilities for the outcomes of measurements, and nothing else, not described by QT, which implies that there is "irreducible randomness". I always thought that's why many (usually philosophically inclined) physicists have their epistemological problems with it. Einstein seems to have been a proponent of this interpretation, but at the same time he was dissatisfied with this conclusion and thus thought QT to be "incomplete", i.e., there should indeed be a deterministic (or "realistic") description, and that's why he looked for his unified classical field theories
One charge against the minimal ensemble interpretation noted by Home and Whitaker is that the interpretation dismisses foundational problems rather than solves them.
Home + Whitaker quoting Squires said:
Though Squires considers: “This is a perfectly reasonable view, and it may be the correct one to take”, it cannot be said he actually supports it: “We must not, however, go on to claim that we have solved the problems... We have merely ignored them. We do not only have experimental results for ensembles. Individual systems exist and the problems arise when we observe them. It is possible to argue that quantum theory says nothing about such individual systems but, even if this is true, the problems do not go away.”
[edit] - Broken link. Here is the explicit link https://citeseerx.ist.psu.edu/viewd...E21C5C27?doi=10.1.1.675.655&rep=rep1&type=pdf
 
  • Like
Likes Lynch101 and vanhees71
  • #267
Which problems? If you simply accept that QT is a complete description, then you must simply accept the "irreducible randomness", and there are no more problems, which only arise, because you claim that QT were incomplete, because you think that Nature must be deterministic, and thus only a deterministic theory can be complete, i.e., the only "allowed randomness" is due to ignorance, as in classical statistical physics.

Of course, you can never prove that any theory is a complete description, because it may well be that you find some empirical evidence that clearly contradicts the theory, and then you need to find a new theory.

In the case of QT it's also clear that it's intrinsically incomplete, because there's no satisfactory theory of the gravitational interaction compatible with it, but this may or may not be related to the probabilistic Nature of QT, i.e., whether a more comprehensive theory, including gravitation, will be deterministic again or not, one cannot say without having found this theory.
 
  • #268
vanhees71 said:
If you simply accept that QT is a complete description, then you must simply accept the "irreducible randomness"
No. The thermal interpretation accepts the first but not the second, because, compared to Born's rule it has a more comprehensive interpretation of the relation between QT and experiment.
vanhees71 said:
Of course, you can never prove that any theory is a complete description,
This is why a minimal interpretation cannot accept this as part of the interpretation. Since you accept it, your interpretation is not minimal.
 
  • Like
Likes physika, weirdoguy, PeterDonis and 1 other person
  • #269
vanhees71 said:
Which problems? If you simply accept that QT is a complete description, then you must simply accept the "irreducible randomness", and there are no more problems, which only arise, because you claim that QT were incomplete, because you think that Nature must be deterministic, and thus only a deterministic theory can be complete, i.e., the only "allowed randomness" is due to ignorance, as in classical statistical physics.

Of course, you can never prove that any theory is a complete description, because it may well be that you find some empirical evidence that clearly contradicts the theory, and then you need to find a new theory.

In the case of QT it's also clear that it's intrinsically incomplete, because there's no satisfactory theory of the gravitational interaction compatible with it, but this may or may not be related to the probabilistic Nature of QT, i.e., whether a more comprehensive theory, including gravitation, will be deterministic again or not, one cannot say without having found this theory.
I am fairly sympathetic to the position that QT can be considered complete under the appropriate interpretations. More specifically, if we conceptualize an ensemble, the state is a complete description of the ensemble. Note that this is distinct from saying a single system is completely described by the state. This relations diagram conveys Ballentine's position at least.
1699277946884.png
 
  • Like
Likes Lynch101, vanhees71, lodbrok and 1 other person
  • #270
A. Neumaier said:
considering it as a possibility is different from knowing that it is impossible
Agreed. But it can still be considered as a possibility in a reasonable discussion of physics. The post by @lodbrok that I responded to was denying that.
 
  • #271
vanhees71 said:
If you simply accept that QT is a complete description
The minimal interpretation makes no such claim. It does not say that QT is complete or that it is incomplete. It is simply silent on all such matters. So, as @A. Neumaier has already commented, you are clearly not using the minimal interpretation.
 
  • #272
This is again splitting hairs. I only said that it is a logical possibility to assume that indeed not all observables take always predetermined values. Then QT, in the minimal statistical interpretation, can be "considered complete". I did not claim that QT were complete. IMHO none of our current theories is complete (but for different reasons than the "foundational problems" of QT, i.e., the lack of a description of the gravitational interaction that is consistent with Q(F)T).
 
  • Sad
  • Like
Likes weirdoguy and Lord Jestocost
  • #273
vanhees71 said:
This is again splitting hairs.
No, it isn't. It is, once again, observing that you refuse to be consistent in your use of terms.

vanhees71 said:
I only said that it is a logical possibility to assume that indeed not all observables take always predetermined values. Then QT, in the minimal statistical interpretation, can be "considered complete".
Which, again, is not the minimal interpretation. The minimal interpretation does not say anything about "logical possibilities" or whether QT can be "considered complete". It is silent on all such matters.

It is very confusing to me that you, who have repeatedly claimed that you have no interest in interpretation discussions, continue to post in them, without, apparently, even understanding your own viewpoint.

vanhees71 said:
I did not claim that QT were complete.
Really?

vanhees71 said:
If you simply accept that QT is a complete description
I wonder if you even read what you post.
 
  • #274
vanhees71 said:
Which problems? If you simply accept that QT is a complete description, then you must simply accept the "irreducible randomness", and there are no more problems, which only arise, because you claim that QT were incomplete, because you think that Nature must be deterministic, and thus only a deterministic theory can be complete, i.e., the only "allowed randomness" is due to ignorance, as in classical statistical physics.

Of course, you can never prove that any theory is a complete description, because it may well be that you find some empirical evidence that clearly contradicts the theory, and then you need to find a new theory.

In the case of QT it's also clear that it's intrinsically incomplete, because there's no satisfactory theory of the gravitational interaction compatible with it, but this may or may not be related to the probabilistic Nature of QT, i.e., whether a more comprehensive theory, including gravitation, will be deterministic again or not, one cannot say without having found this theory.
What is it a complete description of though? Is it a complete description of a statistical sample (or "ensemble") or is it a complete description of each individual element of the statistical sample (or "ensemble")?
 
  • #275
Lynch101 said:
What is it a complete description of though? Is it a complete description of a statistical sample (or "ensemble") or is it a complete description of each individual element of the statistical sample (or "ensemble")?
Since this thread is about the statistical ensemble interpretation, we are discussing here interpretations of the first type (with the caveat that "ensemble" is not the same thing as "statistical sample"--this was discussed earlier in the thread). However, AFAIK not all versions of the statistical ensemble interpretation claim that the description given by QT of the statistical ensemble is complete.
 
  • Like
Likes vanhees71 and Lynch101
  • #276
PeterDonis said:
Since this thread is about the statistical ensemble interpretation, we are discussing here interpretations of the first type (with the caveat that "ensemble" is not the same thing as "statistical sample"--this was discussed earlier in the thread). However, AFAIK not all versions of the statistical ensemble interpretation claim that the description given by QT of the statistical ensemble is complete.
Cheers PD. I read through the thread alright and saw the discussion about the use of the term "ensemble". I put it in brackets and quote marks moreso because Vanhees uses the term in place of statistical sample.

To what extent would you say the SEI (or perhaps some expressions of it) are actually interpretations as distinct from "shut up an calculate"?
 
  • #277
Lynch101 said:
I put it in brackets and quote marks moreso because Vanhees uses the term in place of statistical sample.
And, as I said, that has been corrected in previous discussion. The quantum state in the statistical ensemble interpretation represents, as the name says, the ensemble (with the definition given in Ballentine that I posted earlier), which, as I said, is not the same thing as the finite statistical sample that we actually get from running experiments.

Lynch101 said:
To what extent would you say the SEI (or perhaps some expressions of it) are actually interpretations as distinct from "shut up an calculate"?
This question is unanswerable. If you have a specific reference from the literature or a specific post earlier in this thread, you can ask about that.
 
  • #278
Lynch101 said:
What is it a complete description of though? Is it a complete description of a statistical sample (or "ensemble") or is it a complete description of each individual element of the statistical sample (or "ensemble")?
Of course, probabilistic notions make only sense for statistical samples (as proxies of an ensemble). That's very accurate lnguage, and we agreed to use it in this thread. In everyday discussions among physicsts (particularly experimentalists) "ensemble" is the usual lingo. Nobody talks about "statistical samples", but that's admittedly imprecise and may lead to confusion when it comes to fine details about interpretation.
 
  • Like
Likes Lynch101 and Lord Jestocost
  • #279
The standard empirical interpretation of quantum mechanics is already statistical. However, a statistical (ensemble) interpretation can also be treated as a semantic interpretation which provides an understanding of empirical data. In contrast to the standard (Copenhagen) interpretation, the statistical interpretation does not refer to an individual object but it refers to a collective (ensemble) of similarly prepared ones.

Alexander Pechenkin in “The Statistical (Ensemble) Interpretation of Quantum Mechanics” (Chapter 50 of “The Oxford Handbook of the History of Quantum Interpretations”, Oxford University Press (2022))
 
  • Like
Likes dextercioby, Lynch101 and vanhees71
  • #280
PeterDonis said:
Since this thread is about the statistical ensemble interpretation, we are discussing here interpretations of the first type (with the caveat that "ensemble" is not the same thing as "statistical sample"--this was discussed earlier in the thread). However, AFAIK not all versions of the statistical ensemble interpretation claim that the description given by QT of the statistical ensemble is complete.
In those versions of the SEI which claim that the description of the statistical ensemble (given by QT) is complete, do they say anything about the process by which the statistical ensemble becomes populated, as in, the process whereby the individual elements of the ensemble come to be part of the ensemble?

Am I using the correct terminology when I say that the finite statistical sample used in experiments, acts as a proxy for testing the predictions QT makes with regard to an abstract ensemble?

The thing I'm trying to get at is, I know there is an experimental process which gives rise to the statistical sample. I'm just wondering if the aforementioned (or indeed any) versions of SEI describe both the process and the ensemble (where the statistical sample acts as a proxy for the ensemble), or does it just describe the ensemble?
 
Last edited:
  • #281
Lynch101 said:
In those versions of the SEI which claim that the description of the statistical ensemble (given by QT) is complete, do they say anything about the process by which the statistical ensemble becomes populated, as in, the process whereby the individual elements of the ensemble come to be part of the ensemble?
In the minimal interpretation the quantum state (mathematically represented by the statistical operator of the system under consideration) describes a preparation procedure on the individual system. The ensemble is given by infinitely many equally and independently prepared individual systems.
Lynch101 said:
Am I using the correct terminology when I say that the finite statistical sample used in experiments, acts as a proxy for testing the predictions QT makes with regard to an abstract ensemble?
That's right. As with any probaiblistic prediction you have to statistically estimate the error/statistical significance of the estimate of the probability due to the finite sample. In addition you also have systematic uncertainties, which also have to be carefully analyzed.
Lynch101 said:
The thing I'm trying to get at is, I know there is an experimental process which gives rise to the statistical sample. I'm just wondering if the aforementioned (or indeed any) versions of SEI describe both the process and the ensemble (where the statistical sample acts as a proxy for the ensemble), or does it just describe the ensemble?
Theoretical physicists are concerned with the predictions according to QT, i.e., the properties of the abstract, idealized ensemble. The experimentalists then have to figure out, how to measure it and also do the statistical and systematic analysis :-).
 
  • #282
vanhees71 said:
In the minimal interpretation the quantum state (mathematically represented by the statistical operator of the system under consideration) describes a preparation procedure on the individual system. The ensemble is given by infinitely many equally and independently prepared individual systems.
I know this might seem like splitting hairs, but I'm just trying to get a more precise understanding of it. If there is more precise terminology I should use, please let me know. I'm striving to articulate my own thinking as clearly as possible.

Although I understand how they are intrinsically linked, I would distinguish between the following:
  • the preparation procedure (using specific apparatus)
  • the measurement procedure* (using other specific apparatus)
  • the process between

*the measurement procedure results in specific measurement outcomes/observations which form the elements of the statistical sample.

If we were to say that the SEI describes ensemble, for which the statistical sample serves as a proxy, I would interpret that as meaning, it describes ratio of the different elements of the sample i.e. the ratio of one measurement outcome relative to another. For example: measurement outcomes where 50% spin up: 50% spin down.

If we were to say that the SEI describes the preparation procedure, I would interpret that as being distinct from a description of the statistical sample.

To use a classical analogy, the preparation procedure might be the preparation of fair coins, while the ensemble (approximated by the statistical sample) would be the outcomes of N-trials of flipping those fair coins.

The process in between then would be the process by which the coins are flipped.

Does that make sense?
 
  • #283
Lynch101 said:
In those versions of the SEI which claim that the description of the statistical ensemble (given by QT) is complete, do they say anything about the process by which the statistical ensemble becomes populated, as in, the process whereby the individual elements of the ensemble come to be part of the ensemble?
The ensemble does not get "populated" since it does not refer to any actual runs of the preparation procedure or individual systems produced by it. It refers to the abstract (infinite) set of all possible systems that can be produced by the preparation procedure. (See, for example, Ballentine, which I believe I've referred to earlier in this thread.)

Lynch101 said:
Am I using the correct terminology when I say that the finite statistical sample used in experiments, acts as a proxy for testing the predictions QT makes with regard to an abstract ensemble?
We use a finite statistical sample to test the QT predictions, yes. But we do that whether we're using an ensemble interpretation or not.

Lynch101 said:
To use a classical analogy, the preparation procedure might be the preparation of fair coins, while the ensemble (approximated by the statistical sample) would be the outcomes of N-trials of flipping those fair coins
No, the ensemble would not be that. See above.
 
  • #284
PeterDonis said:
The ensemble does not get "populated" since it does not refer to any actual runs of the preparation procedure or individual systems produced by it. It refers to the abstract (infinite) set of all possible systems that can be produced by the preparation procedure. (See, for example, Ballentine, which I believe I've referred to earlier in this thread.)
Ah yes, of course. I think I had it clearer in my mind in my subsequent post. Is the terminology I'm using accurate, if I talk about the the statistical sample being populated by individual elements?

PeterDonis said:
We use a finite statistical sample to test the QT predictions, yes. But we do that whether we're using an ensemble interpretation or not.
Thanks PD, I'm clear on that.

PeterDonis said:
No, the ensemble would not be that. See above.
Am I right in saying the statistical sample would be the outcomes of N*-trials of flipping those fair coins, while the ensemble would be the, as you mention, abstract infinite set.

*The use of N implying a finite set.
 
  • #285
Lynch101 said:
Am I right in saying the statistical sample would be the outcomes of N*-trials of flipping those fair coins, while the ensemble would be the, as you mention, abstract infinite set.
Yes.
 
  • Like
Likes vanhees71 and Lynch101
  • #286
Lynch101 said:
I know this might seem like splitting hairs, but I'm just trying to get a more precise understanding of it. If there is more precise terminology I should use, please let me know. I'm striving to articulate my own thinking as clearly as possible.

Although I understand how they are intrinsically linked, I would distinguish between the following:
  • the preparation procedure (using specific apparatus)
  • the measurement procedure* (using other specific apparatus)
  • the process between

*the measurement procedure results in specific measurement outcomes/observations which form the elements of the statistical sample.

If we were to say that the SEI describes ensemble, for which the statistical sample serves as a proxy, I would interpret that as meaning, it describes ratio of the different elements of the sample i.e. the ratio of one measurement outcome relative to another. For example: measurement outcomes where 50% spin up: 50% spin down.

If we were to say that the SEI describes the preparation procedure, I would interpret that as being distinct from a description of the statistical sample.
You have to define somehow the statistical sample in the lab. It's given by the preparation procedure. E.g., in a Bell experiment with photons it's given by a laser and a BBO crystal + some other optical equipment to get entangled photon pairs by spontaneous parametric down-conversion. Just shining long enough with your laser you get (in random temporal sequence) a sample of such prepared "Bell states" of photon pairs. Then you do measurements on this sample with outcomes that you can analyze statistically and compare it with the predictions of the model (QED).
Lynch101 said:
To use a classical analogy, the preparation procedure might be the preparation of fair coins, while the ensemble (approximated by the statistical sample) would be the outcomes of N-trials of flipping those fair coins.
That sounds right.
Lynch101 said:
The process in between then would be the process by which the coins are flipped.
The process in between is theoretically described by Newtonian mechanics of rigid bodies moving in the gravitational field of the Earth and subject to air resistance. The probabilistic description in this case comes just from the ignorance of the precise initial conditions. That's of course very different from the quantum probabilities of the above example with two photons. They are prepared (idealizing the real-world situation a bit) in a pure state, i.e., you have maximal possible knowledge of their state, but this doesn's imply that you know all observables. E.g., the polarization state of the single photons in this pair is maximally uncertain, i.e., the single photons are both simply unpolarized and described by a mixed state of maximum entropy.
Lynch101 said:
Does that make sense?
Sounds good to me.
 
  • #287
Lynch101 said:
To use a classical analogy, the preparation procedure might be the preparation of fair coins, while the ensemble (approximated by the statistical sample) would be the outcomes of N-trials of flipping those fair coins.
There is some ambiguity in the analogy here, insofar as whether or not you consider the flipping of the coin as part of the preparation or part of the measurement.

There is also some ambiguity in Ballentine's 1970s account. Ballentine, in his treatment of measurement (section 4.1), considers an initial state (equation 4.2) in the state space of the measured system, and a final state (equation 4.3) in the state space of the measured system + measurement apparatus. He then says the square of the amplitudes present in both expressions give the relative frequencies observed if the experiment is repeated "many times".

Home and Whitaker ( https://citeseerx.ist.psu.edu/viewd...E21C5C27?doi=10.1.1.675.655&rep=rep1&type=pdf ) review Ballentine's account. They say that these squared amplitudes are the relative frequencies "over the ensemble" of finding the measurement apparatus in the corresponding pointer states. Home and Whitaker invoke an infinite number of experimental runs, and our actually existing sample is more likely to reproduce the relative frequencies over the infinite ensemble, the larger our sample is. So using your analogy, it might be clearer to say.

i The preparation procedure is the flipping of a coin
ii The state represents an infinite ensemble of flipped coins
ii The measurement is the revealing of the coin face to some detection device
iv The possible outcomes are heads or tails
v The sample is actually existing outcome data compiled from a finite number of measurements

Statement ii is where a distinction between quantum and classical arises. If we are to quantise your analogy, instrumentalists like Asher Peres would replace "measurement" with "test". He would say something like

ii The test is the response of some detection device to the coin

Ballentine would be more agnostic, only committing himself to statistical statements about the data, whatever a datum might imply about a coin.
 
Last edited:
  • Like
Likes dextercioby, Lynch101 and vanhees71
  • #288
Lord Jestocost said:
The standard empirical interpretation of quantum mechanics is already statistical. However, a statistical (ensemble) interpretation can also be treated as a semantic interpretation which provides an understanding of empirical data. In contrast to the standard (Copenhagen) interpretation, the statistical interpretation does not refer to an individual object but it refers to a collective (ensemble) of similarly prepared ones.

Alexander Pechenkin in “The Statistical (Ensemble) Interpretation of Quantum Mechanics” (Chapter 50 of “The Oxford Handbook of the History of Quantum Interpretations”, Oxford University Press (2022))
Just going back over the thread, and LJ's post helped to clarify a few things for me.

I'm not sure if this is the same for anyone else, but when it comes to the SEI, I think I have been guilty of trying to consider it in the context of the questions to which I, and others (I believe), are seeking answers.

Am I reading LJ's reference (and other posts in this thread) correctly when I say that, the SEI interprets the mathematics of quantum theory as a statistical description of the observed properties of an abstract, infinite set/ensemble of similarly prepared particles - against which observed statistical samples can be compared - and simply stops there? It is minimal in the sense that it states nothing more than what can definitively be implied by the mathematical formalism.

Where I have potentially been misinterpreting it, is in thinking that the SEI says there is nothing more to be explained, but (strictly speaking), does the SEI leave the door open for further explanation on issues such as:
  • What are the properties of individual particles*?
  • What is the process by which the statistical sample, in physical experiments, is populated by individual elements?
  • Can anything further, beyond the minimal statistical description of an ensemble, be inferred from the mathematical formalism?
*Would "degrees of freedom" be a more accurate term here?
 
  • #289
From Home + Whitaker's review: "It is convenient to make an immediate comment concerning the relation between ensemble interpretations and hidden-variable theories. The existence of hidden variables would explain why one uses an ensemble interpretation; the ensembles would consist of systems with all possible distributions of values for the hidden variables. However use of an ensemble interpretation does not imply acceptance of hidden variables, to the possibility of which it remains neutral"
 
  • #290
Lynch101 said:
Just going back over the thread, and LJ's post helped to clarify a few things for me.

I'm not sure if this is the same for anyone else, but when it comes to the SEI, I think I have been guilty of trying to consider it in the context of the questions to which I, and others (I believe), are seeking answers.

Am I reading LJ's reference (and other posts in this thread) correctly when I say that, the SEI interprets the mathematics of quantum theory as a statistical description of the observed properties of an abstract, infinite set/ensemble of similarly prepared particles - against which observed statistical samples can be compared - and simply stops there? It is minimal in the sense that it states nothing more than what can definitively be implied by the mathematical formalism.

Where I have potentially been misinterpreting it, is in thinking that the SEI says there is nothing more to be explained, but (strictly speaking), does the SEI leave the door open for further explanation on issues such as:
  • What are the properties of individual particles*?
  • What is the process by which the statistical sample, in physical experiments, is populated by individual elements?
  • Can anything further, beyond the minimal statistical description of an ensemble, be inferred from the mathematical formalism?
*Would "degrees of freedom" be a more accurate term here?
The SEI leaves no new “door open” as compared to the orthodox interpretation of quantum mechanics.

To my mind, however, one should avoid the term "statistical ensemble interpretation" beccause a misleading reading of the term "ensemble" as a type of "Gibbs ensemble" can lead to enormous misunderstandings.
 
  • #291
Lord Jestocost said:
The SEI leaves no new “door open” as compared to the orthodox interpretation of quantum mechanics.

To my mind, however, one should avoid the term "statistical ensemble interpretation" beccause a misleading reading of the term "ensemble" as a type of "Gibbs ensemble" can lead to enormous misunderstandings.
No new door, no.

But, and this could well be due to my own biases with which I was approaching my attempts to understand the SEI, I sometimes interpret statements made in relation to the SEI as claiming there is nothing else to be explained beyond the statistical description of the ensemble; or, in terms of it's relation to the physical experimental set-up, that there is nothing to be explained beyond the correspondence of the statistical sample to the predictions of QT.
 
  • #292
Lynch101 said:
I sometimes interpret statements made in relation to the SEI as claiming there is nothing else to be explained beyond the statistical description of the ensemble; or, in terms of it's relation to the physical experimental set-up, that there is nothing to be explained beyond the correspondence of the statistical sample to the predictions of QT.
The "minimal" statistical interpretation more or less says that; but discussion in this thread is not limited to that version of the statistical interpretation.
 
  • #293
Lynch101 said:
Just going back over the thread, and LJ's post helped to clarify a few things for me.

I'm not sure if this is the same for anyone else, but when it comes to the SEI, I think I have been guilty of trying to consider it in the context of the questions to which I, and others (I believe), are seeking answers.

Am I reading LJ's reference (and other posts in this thread) correctly when I say that, the SEI interprets the mathematics of quantum theory as a statistical description of the observed properties of an abstract, infinite set/ensemble of similarly prepared particles - against which observed statistical samples can be compared - and simply stops there? It is minimal in the sense that it states nothing more than what can definitively be implied by the mathematical formalism.
I think that's correct, at least that's how I also understand the minimal statistical interpretation.
Lynch101 said:
Where I have potentially been misinterpreting it, is in thinking that the SEI says there is nothing more to be explained, but (strictly speaking), does the SEI leave the door open for further explanation on issues such as:
  • What are the properties of individual particles*?
Before any empirical evidence indicates otherwise, QT in the minimal interpretation precisely describes the properties of individual particles. The inevitable consequence is that Nature is not deterministic, i.e., observables only take determined values if the particle is prepared in a corresponding state.
Lynch101 said:
  • What is the process by which the statistical sample, in physical experiments, is populated by individual elements?
The interaction between the measured system and the measurment device leads to an entanglement between the measured observable and the "pointer state" of the measurement apparatus. The outcome of the measurment is random with probabilities given by Born's rule.
Lynch101 said:
  • Can anything further, beyond the minimal statistical description of an ensemble, be inferred from the mathematical formalism?
I don't think so.
Lynch101 said:
*Would "degrees of freedom" be a more accurate term here?
No. It's too unspecific. If you want to discuss particles, call them particles :-)). QT describes, however much more than single particles but rather everything except the gravitational interaction.

As with any theory this of course is subject to revision, as soon as empirical evidence provides new facts. That QT is incomplete is also clear, because it doesn't describe the gravitational interaction. It's not yet clear, how a more complete theory may look like and which revisions of all the issues discussed in conncection with the "foundations of QT" may be necessary.
 
  • Informative
  • Like
Likes Lord Jestocost and Lynch101
  • #294
PeterDonis said:
The "minimal" statistical interpretation more or less says that; but discussion in this thread is not limited to that version of the statistical interpretation.
Just to clarify this a but further.

I would make the distinction between the following positions:
  1. QT describes the statistical ensemble which is a complete description of "the physical reality" (EPR) of the experimental set-up, so there is nothing further to be described/explained.
  2. QT describes the statistical ensemble but that is not a complete description of "the physical reality" (EPR) of the experimental set-up, so there is more to be described/explained.
  3. QT describes the statistical ensemble but that is not a complete description of "the physical reality" (EPR) of the experimental set-up, so there is more to be described/explained. However, no further explanation is possible.

Which of those would you say corresponds to the SEI. Or would there be a more precise way of articulating it?
 
  • #295
vanhees71 said:
The interaction between the measured system and the measurment device leads to an entanglement between the measured observable and the "pointer state" of the measurement apparatus. The outcome of the measurment is random with probabilities given by Born's rule.
Ah, OK. This seems like a fairly straight forward picture, if I am interpreting it correctly.

To use a pretty crude classical analogy. If we imagine a microscopic sphere* prepared by some preparation procedure, which travels from the preparation device to the detector via a polarising filter or magnetic filed (as appropriate). Whether or not it passes the filter or is deflected up/down is simply random.

Would that be in the right direction in terms of understanding?

*Sphere is used here more as a placeholder.
 
  • #296
How are you modelling the "microscopic sphere"? With a hidden variable state ##\lambda##?

[edit to add] - You have to be careful about asserting properties of a microscopic system independent of measurement.
 
  • #297
Morbert said:
How are you modelling the "microscopic sphere"? With a hidden variable state##\lambda##?
No, no hidden variables.

My understanding is that hidden variables (with a hidden variable state ##\lambda##) would mean it is pre-determined whether or not the "sphere" will pass through the filter, or be deflected up/down as it passes through a magnetic field. Is that accurate?

However, without such hidden variables, whether or not the "sphere" will pass through the filter or be deflected up/down as it passes through a magnetic field, would simply be randomised.
 
  • #298
Morbert said:
Decoherent histories has been around for a good few decades at this stage, with one motivation for its development being the description of closed systems, and measurements as processes therein.
https://iopscience.iop.org/article/10.1088/1742-6596/2533/1/012011/pdf

It gives a clear account of what it means for a measurement to occur in a closed system.
No. It only gives an account of events ''that we can talk about at the breakfast table'' (according to the above paper) - not of dynamical processes that would qualify as measurement processes.

In particular, their discussion assumes measurement results that fall from heaven, given by a POM or POVM in addition to the untary dynamics of the system, rather than taking the state of the universe and deriving from it the distribution of the values read from a macroscopic detector that is part of the dynamics.

Thus everything is empty talk embellishing Born's rule.
 
  • #299
Lynch101 said:
No, no hidden variables.

My understanding is that hidden variables (with a hidden variable state ##\lambda##) would mean it is pre-determined whether or not the "sphere" will pass through the filter, or be deflected up/down as it passes through a magnetic field. Is that accurate?

However, without such hidden variables, whether or not the "sphere" will pass through the filter or be deflected up/down as it passes through a magnetic field, would simply be randomised.
The issue isn't whether the sphere evolves stochasitcally or deterministically. The issue is the conceptualisation of the sphere itself. For example, if the sphere has some real state ##\lambda## then orthodox quantum interpretation is bijectively incomplete, insofar as there isn't a one-to-one correspondence between the real state of the microscopic system and the quantum state.

While it is ok to say a given ensemble interpretation frames QM as a complete theory of the statistics of ensembles, a discussion about a complete theory of reality requires further exploration of priors.
 
  • #300
Morbert said:
For example, if the sphere has some real state ##\lambda## then...
And what if it doesn't?
 
  • Like
Likes vanhees71 and Lynch101
Back
Top