Demystifier said:
Are you a mathematician? I mean, your comment above may be correct from the point of view of rigorous mathematical theory of probability, but it is certainly wrong from the practical physical point of view. In practice, the Born rule is tested experimentally by doing statistics on a large but finite ensemble of measurement outcomes.
No, I am a physicist. Same school as Tegmark actually. Like so many other physicists I work with financial modelling. That is probably why I have strong opinions about uncertainty and the nature of probabilities. I am exposed to a lot of uncertainty in a very fundamental sense every day. I don't think I am wrong, and my view really does not have much to do with rigour in mathematics - it is something that has grown over the years, starting from a very similar position to yours. It isn't limited to uncertainty in QM either. It is just a fact of life, as I see it.
With regards to physics, If you derive the Born rule from statistical inference, then sure, the fact that you can only do a finite number of experiments is important and that limits your knowledge. But if you derive the Born rule by means of mathematical deduction from first principles, then I don't see how you can argue that the conclusions are not valid just because in real life you can only do a limited number of experiments. You could argue against general relativity the same way - there is an unlimited number of non-linear equations that could explain any finite set of observations, and general relativity is just a very complex theory that may be correct from the point of view of rigorous mathematics, but so what?
Demystifier said:
What I want to understand as a physicist, is why the Born rule describes well (not perfect, of course) a large but finite ensemble of measurement outcomes.
That is because you get something close to the limit behavior with very high probability if you do a large number of independent trials. That is a trivial fact. (I know that is not what you are meaning to ask, but I seem to have trouble to understand what you are really after.)
Demystifier said:
So far, I don't see how to apply your arguments on finite ensembles.
I don't apply them to finite ensembles. (I am not the one who keep bringing finite ensembles up.

)
The only way to limit ourselves to finite ensembles is to view physics in MWI as superdeterministic with a finite number of branches. Then we could arbitrarily assign probabilities to each branching event and have a theory that would describe everything (although not a very pretty theory).
As soon as we want to have a realistic theory that could describe all experiments that could conceivably be performed, then we need an
infinite set of events that we have to assign probabilities to. Furthermore, in QM there is no set of (disjoint) atomic events that we can combine to produce any possible measurement (whether in an inifinitesimal sense or not). This gives constraints on how to construct a probability measure.
Essentially, a probability measure in the MWI would be a function that takes a state and a projection as arguments and produces a probability. That function has to work for any state and any orthonormal basis of Hilbert space (this makes your P' measure ill-defined.). It must sum to unity for any state when you sum over all the basis vectors. If you make a basis transformation it must still sum to unity. In order for it to be compatible with QM it would also have to generate a 0 probability if and only if the Born probability is 0. (Furthermore, in MWI it must conserve probability for branches, whatever a branch is.)
You argue that there can only be a finite number of trials in any realistic experiment, therefore we don't have to worry about limit behavior. But the sequence of experiments (where only the cumulative average result is recorded) is a Cauchy sequence and Hilbert space is complete, so the limit is a state in Hilbert space too. Therefore, any probability measure that is a universal law of physics must be applicable to the limit as well as to any finite ensemble of experiments (yes, I know this isn't rigorous).
I just want to make one more point. Once we have the wave equation and initial state in MWI, any externally imposed postulates of probability make no difference whatsoever to how the universe actually evolves. The inhabitants in a universe according to MWI are blissfully ignorant of any probability postulates an outside observer might make, and any probability postulates do not influence their actual experiences or perceptions of uncertainty in the slightest. The Born rule postulate in CI has meaning only because of wave function collapse. If MWI is a correct decription of the universe, the Born rule must follow from the wave function. In a correct axiomatic system for MWI, any Born rule postulate must be redundant. Consequently a proof that the Born rule can not be derived from the wave function should be fatal to MWI.
But to summarise, my argument essentially goes as follows:
1. In MWI, the future of the universe is exactly determined by the wave equation.
2. From the point of view of an observer with memory in a universe according to MWI, there is uncertainty about how any future version of the observer will remember its past and perceive its present.
3. Uncertainty can be described by the axioms of probability theory (this is a leap of faith).
4. There is a unique probability measure that is compatible with the wave function. (At least one such compatible probability measure exists - the Born rule. It is possible that you might have to make additional assumptions in order to rule all other probability measures out, but in my mind at least, it is clear that you can derive the Born rule from a small set of axioms, whatever those axioms may be. As Dmtry67 pointed out, there are a number of theorems that actually prove you can derive the Born rule from first principles, and at least some of those theorems seem to be very similar to my conjecture.)
I am actually not clear about which one of these points it is we are debating, or if there is something else that I am missing.