Probability basics - Heads or Tails thought experiment.

In summary: This means that if you wait long enough, you will eventually return to your starting point. However, the number of steps required for this to happen is unpredictable and can vary greatly. This is because, even though the expected value for a random walk is its origin, its variance is infinite, so the further you go, every point becomes more and more alike and can eventually be billions of steps away from the origin, which is still considered "close" in terms of a large number of steps. So, while it is possible for the walker to return to its starting point, it is not guaranteed and can take a very long time.
  • #1
Izhaki
18
0
Right,

This is very confusing for myself, I'm pretty sure it will be so for everyone else.

My question is really related to quantum theory, but I find it most appropriate to spell it out here as it's more of a maths question on the basics of probability.

Here my experiment:

I stand at a point a throw a coin.
If it's heads, I take a step to the right; tails I take a step to the left.
The throw of the coin is completely random, and my steps are precisely the same distance to left and right.
My time axis is 'throws', so after 10 throws t = 10.

Now it doesn't takes a genius to know that probability has it that I'll be close to my origin point most of the time.

But also, if I'm to run this experiment indefinitely, there will come a point where I will be million steps to the left (same way monkeys will type Shakespeare). Say the time when this happened was M.

Can I not tell that if I run the experiment M more times (so at time 2M), I'll back around my origin point again?

But as my chance to go left or right are equal, that makes no sense whatsoever. Because when I'm million steps to the left of my origin, I still have a similar chance going million steps to the right or left. Yet given I started from my original origin point, at any time my mean should be that origin point.

In other words - when I get heads I 'owe' probability a tail. But that's nonsense, as the chance for heads or tails is equal in every throw.

So what am I getting wrong?

Thanks in advance.
 
Last edited:
Physics news on Phys.org
  • #2
You have described the 1D Drunkards Walk problem - go look it up. Over time you will more likely wander away from the start point. The intuitive idea that the equal probabilities will keep you close by is simply incorrect.

Basically - once you have taken a step to the right (say) then, by the argument you used, the remaining tosses should keep you close to that point rather than the origin. See the problem?

Very balanced outcomes like HTTHTHHTHTTHHT that keep you close to the start are quite unlikely and quite long runs are more common than you'd guess. In fact it is possible to tell the difference between a sheet of actual coin tosses and a sheet of made-up coin tosses this way - the actual one will have more long runs on heads or tails.
 
  • #3
One interesting fact about random walk. In one or two dimensions the probability that eventually you will return to the origin is one. For higher dimensions it is less.
 
  • #4
That is interesting - so if a 1d random walk starts at position x, then, over a long time, it returns to position x? But if it got to x via a random walk from the origin then it will end up at the origin and not x ... how does it know where it started out?

Or is it more that the long runs of heads are as likely as long runs on tails so, given sufficient time, the walk will eventually return to it's starting point. But that does not sound so interesting... after all, given sufficient time surely the walker will end up and any nominated point?

These things can be good fun to simulate.
I first ran into this problem when I was 13 and trying to program a trs80 to run a snail race ... which I had modeled as a 2d random walk I know now. I spent ages trying to work out how long it would take for the "snails" to exit the circle with different parameters.
 
  • #5
Izhaki said:
Now it doesn't takes a genius to know that probability has it that I'll be close to my origin point most of the time.

Well, here you have to define "close" but the fact is that the more steps you take the more likely to be "further" and "further" away from the origin.

Izhaki said:
But also, if I'm to run this experiment indefinitely, there will come a point where I will be million steps to the left (same way monkeys will type Shakespeare). Say the time when this happened was M.

Can I not tell that if I run the experiment M more times (so at time 2M), I'll back around my origin point again?

What you can tell is that in the long run #tails/#heads ~ 1, but, for example, 1.trillion.tails / 1.trillion.minus.100.thousand.heads will be also close to one, but yet, you will find yourself 100 thousand steps away from the origin. The thing is that 100 thousands steps is "close" compare to the 1 trillion steps.

The expected value for a random walk is its origin, but its variance is infinite, so the further you go every point becomes more and more alike and that "closeness" can be eventually of billions of steps away from the origin which is still very close compare to a large number of steps.

So I think if you redefine your concept of "close" you will get it. :smile:
 
Last edited:
  • #6
Simon Bridge said:
That is interesting - so if a 1d random walk starts at position x, then, over a long time, it returns to position x? But if it got to x via a random walk from the origin then it will end up at the origin and not x ... how does it know where it started out?

Every point will be hit infinitely often.
 

1. What is the concept of probability?

Probability is the measure of the likelihood that an event will occur. It is expressed as a number between 0 and 1, with 0 representing impossibility and 1 representing certainty.

2. What is the "Heads or Tails thought experiment"?

The "Heads or Tails thought experiment" is a theoretical scenario used to illustrate the concept of probability. It involves flipping a coin and predicting whether it will land on heads or tails.

3. How is probability calculated in the "Heads or Tails thought experiment"?

In this thought experiment, the probability of getting heads or tails is equal, since there are only two possible outcomes. Therefore, the probability of getting heads is 1/2 or 50%, and the probability of getting tails is also 1/2 or 50%.

4. What is the difference between theoretical probability and experimental probability?

Theoretical probability is based on mathematical calculations and assumes that all outcomes are equally likely. Experimental probability is based on actual data collected from experiments or observations, and may vary from the theoretical probability.

5. How does the concept of probability apply to real-life situations?

In real-life situations, probability is used to make predictions and informed decisions. It can be used in fields such as finance, weather forecasting, and sports to calculate the likelihood of certain outcomes and make informed choices.

Similar threads

  • Set Theory, Logic, Probability, Statistics
2
Replies
57
Views
1K
  • Set Theory, Logic, Probability, Statistics
4
Replies
126
Views
6K
  • Set Theory, Logic, Probability, Statistics
Replies
16
Views
1K
  • Set Theory, Logic, Probability, Statistics
2
Replies
45
Views
3K
  • Set Theory, Logic, Probability, Statistics
Replies
3
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
5
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
9
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
18
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
11
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
4
Views
1K
Back
Top