bhobba said:
The key issue is how such a world emerges from a theory that only makes predictions about observations that appear in such a world. That is a very deep issue and the true quantum mystery.
I agree that is the central issue, but I'd frame it differently. I don't hold that worlds ever emerge from theories, since I reject the concept that nature follows mathematics. Instead, it seems closer to what actually happens that we fit mathematics to nature like a template or a (sometimes amazingly) close approximation. Given that, it is perfectly natural to expect that all physical theories must involve predictions about observations, so the inscrutable nature of an observation should always be difficult or impossible to remove from any theory. So for me, the deep question is, what is the
connection between observations and mathematics? They seem like two completely different things, but apparently they are quite deeply connected. That we cannot understand the connection is not cause to imagine it isn't there, as the success of physics shows that connection is quite clearly there. So we should not make it our goal to remove the connection, but rather to accept it, study it, and understand it better.
A lot of progress has been made - but issues still remain and more research is required before a satisfactory explanation is found. I suspect a few revolutions will occur along the way - indeed we may be in the middle of one right now - I find the following very thought provoking:
https://www.simonsfoundation.org/quanta/20130917-a-jewel-at-the-heart-of-quantum-physics/
Wow, that's potentially monumental. I would cull out this quote:“They are very powerful calculational techniques, but they are also incredibly suggestive,” Skinner said. “They suggest that thinking in terms of space-time was not the right way of going about this.”
What is the significance that one of our central conceptual tools for organizing our perceptions, space and time, is "not the right way of going about this"? It would seem that this is trying to tell us that tools we use to organize our perceptions are not always the best way to organize observations writ large. This is a bit like what Planck was quoted as saying earlier in this thread-- our ability to observe is changing, when we do modern physics we rely more and more on supplemental apparatuses than the simple perceptions we use in our daily lives. The need for new mathematics appears with the ability to do new types of observations, and the organizational milieu that worked before is no longer the most elegant approach. First it was imaginary numbers that rose to the fore, now it may be strings or amplituhedrons.
We proceed in steps-- first we have new observations that stimulate new mathematical structures, then we spend a lot of time understanding our own mathematical structures (which tend to be more profound and more elegant than we realize when we first describe them), then we get all excited we have figured out how nature really works, then come the next generation of new observations that show us it ain't. I say it's time we recognize this cycle as the natural progress of science, and stop trying to make it what it never was.
Added: The role of observation does not mean that when a tree falls, we can be unclear about if it makes noise. Instead, that role is in giving meaning to the predicate, that "a tree falls." Asserting a falling tree already asserts all that goes with it, including noise, but the assertion itself is already an observational one. That is the part people often forget. The proof is that as yet we have no idea if there is any difference between saying "a tree falls" and "a tree is observed to fall." For the time being, we mean exactly the same thing by those two phrases, as we have no other meaning for any of those words.