stevendaryl said:
there is a mismatch between that universal applicability and the way it is (usually) presented, which is in terms of probabilities for observables (or expectations for observables, in the density matrix formulation).
The probability interpretation is questionable as a foundation, as it it always associated with the idea of frequent measurement (or even more anthropocentric ideas). But measurements are a comparably rare event in Nature (especially if we average over the duration of the existence of the universe).
The shut-up-and-calculate version of quantum mechanics is universally applied, always making use of the notion of expectation - typically without reference to measurements, and only sometimes using their interpretation in terms of probabilities (needed only for interpreting scattering experiments, where it has a rational basis in abundant statistics). Thus a good interpretation should only be based on expectation, not on probabilities.
Chapters 8 and 10 of
my online book on quantum mechanics were designed explicitly to take this into account, resulting in a presentation without the mismatch that you mention. The basics were also discussed
here on PF.
I got the idea from a book on classical probability by
Peter Whittle, Probability via expectation (4th edition, 2000). From the preface to the third edition (starting with a reference to the first edition from 1970):
Peter Whittle said:
The particular novelty of the approach was that expectation was taken as the prime concept, and the concept of expectation axiomatized rather than that of a probability measure. [...] In re-examining the approach after this lapse of time I find it more persuasive than ever. [...] I would briefly list the advantages of the expectation approach as follows.
- (i) It permits a more economic and natural treatment at the elementary level.
- (ii) It opens an immediate door to applications, because the quantity of interest in many applications is just an expectation.
- (iii) Precisely for this last reason, one can discuss applications of genuine interest with very little preliminary development of theory. On the other hand, one also finds that a natural unrolling of ideas leads to the development of theory almost of itself.
- (iv) The approach is an intuitive one, in that people have a well-developed intuition for the concept of an average. Of course, what is found 'intuitive' depends on one's experience, but people with a background in the physical sciences have certainly taken readily to the approach. [...]
- (v) The treatment is the natural one at an advanced level. [...] The accepted concepts and techniques of weak convergence and of generalized processes are characterized wholly in terms of expectation.
- (vi) Much conventional presentation of probability theory is distorted by a preoccupation with measure-theoretic concepts which is in a sense premature and irrelevant. These concepts (or some equivalent of them) cannot be avoided indefinitely. However, in the expectation approach, they find their place at the natural stage.
- (vii) On the other hand, a concept which is notably and remarkably absent from conventional treatments is that of convexity. (Remarkable, because convexity is a probabilistic concept, and, in optimization theory, the necessary invocations of convexity and of probabilistic ideas are intimately related.) In the expectation approach convexity indeed emerges as an inevitable central concept.
- (viii) Finally, in the expectation approach, classical probability and the probability of quantum theory are seen to differ only in a modification of the axioms - a modification rich in consequences, but succinctly expressible.
The 4th edition treats quantum mechanics in the final Chapter 20. In particular, in Theorem 20.1.5,
Whittle derives the Born rule as conditional probability, thus removing all weirdness from its interpretation. (Later, he characterizes the Schroedinger equation, unfortunately placing the ##i## systematically on the wrong side of the equation, so getting the dynamics backwards. But in spite of this small lapse,
I can highly recommend the book!