I understand what Fredrik said, and I sort of agree, but there are still some points that I would like to add.
Fredrik said:
Probabilities are numbers assigned by probability measures. They are never defined as degrees of belief.
Probability theory can be defined in different ways.
The axiomatic way of Kolmogorov, or as rational reasoning - an extension of deductive logic, for example as lined out by ET Jaynes and Cox.
ET Jaynes, describes a rational system for reasoning. And then DEFINES a notion of "degree of belief" that is REPRESENTED by a real number [0,1].
Then, using several plausability postulates, that you require from any rational inference system, the same mathematical formalism as the kolmogorov axioms are infered. This is a MUCH deeper view that the axiomatic way. So you have two formal systems, one with probability measures, one with degrees of belief, but the mathematics is the same. But the way the axioms are inferred is different.
Fredrik said:
We certainly can't test them by comparing the predicted probabilities with our beliefs.
If you take this view seriously, probabilites are not predicted nor falsified like you suggest - I agree. Instead the probabilites are understood not as statements of nature, but as interaction tools, in a learning system. The IMPORTANT part is not to falsify a probability, the importatnt part is how the probability are updated in the event of new evidence; thus conforming to rational belief.
If you discuss this, I agree that one can argue that relative frequences can be verified by experiments, but subjective probabilities can't. But that isn't the rigt way to think about the subjective probabilities.
The focus shifts from descriptive to a inferencial. The focus is not to corroborate or falsify a prior; that is meaningless. The focus is to improve and revise it rationally.
This is analogous to the deeper view of what a theory is; a description of nature that is either wrong or corroborated - or an interaction tool for LEARNING about nature.
One can certainly ask which focus is more fundamental - eternal descriptions of nature in terms of eternal laws, or optimal inferencees about nature. Also note that degree of belief is just a methapor and doesn't necessarily refer to human beleif!
On the contrary can it be defined in terms of counting historical evidence, but the counting and representation of counters states are inherently observer dependent. I personally think that this is a much more sensible view than resorting to the fictive ensembles or limits.
/Fredrik