Dale said:
The OP is asking about a countably infinite set with uniform probability. This is a contradiction. Others have already answered about a countably infinite set with non-uniform probability. I have answered about an uncountably infinite set with uniform probability.
Let's take a closer look at this.
I would say that measure theory has an abstract mathematical definition of probability that does not define a physically realisable process in this case. I would put this in the same category as the Banach-Tarski paradox:
https://en.wikipedia.org/wiki/Banach–Tarski_paradox
You could also look up the proof that there exists an unmeasurable subset of ##\mathbb R##. That set, I suggest, does not correspond to any physical object.
There are many examples of an uncountable infinite set or an uncountable process that are well-defined mathematically, but do not correspond to any physical set or process. And, in fact, the Gambler's Ruin is an example of a countable mathematical process that is physically impossible: namely, how to dispose of an infinite number of coins in finite time.
The uniform distribution on ##[0,1]## is probably the simplest and the most contentious. It looks innocent and many people claim (without really thinking about it), that you can choose a real number between ##0## and ##1## from this distribution. However, when they conclude that "something impossible can happen" this ought to make them stop and think more deeply about the relationship between mathematics and experiments: i.e. what it is physically possible to do.
If you assume elementary particles are point particles and that classical mechanics (and not QM) applies, then you can assert that a point particle must be precisely at a specific location, one of uncountable many, and may remain at rest at that point. That is clear. It's still not possible to describe an arbitrary point with infinite precision, but you could claim that your classical particle has chosen for you a point out of uncountably many in an interval.
But, elementary particles are quantum mechanical and cannot be pinned down, even theoretically. It's not possible to appeal to the notion that the particle "must be somewhere".
You can, of course, still claim that spacetime has uncountably many points. If we allow that to be in doubt, and say that there are no uncountable sets in nature, then there is no possibility of physically choosing from an uncountable set. For the purpose of this discussion, therefore, we have to assume that spacetime is uncountable.
The problem is then how to choose an arbitrary point in spacetime, without reference to physical particles, with their inherent uncertainties?
The only idea I can see in this thread is to pick a particle (or large set of particles, such as a dart, or ink spot on paper) and ignore QM. That doesn't cut it for me.
The last try, IMO, is to somehow map some portion of spacetime to another and appeal to the fixed-point mapping theorem to pick out one of the uncountably many points. But, it feels like the transition from pure mathematics to a real physical scenario will remain problematic, even in this case.