Toss coin probabilities (Bino vs Gauss approx)

  • Context: Graduate 
  • Thread starter Thread starter ChrisVer
  • Start date Start date
  • Tags Tags
    Gauss Probabilities
Click For Summary
SUMMARY

The discussion centers on the discrepancy between binomial and Gaussian approximations for the probability of obtaining between 3 and 6 heads in 10 coin tosses. The binomial probability calculated is 0.7734375, while the Gaussian approximation yields 0.633505. The primary reason for this difference is that the parameters np and n(1-p) are both equal to 5, which is not sufficiently large for the Gaussian approximation to be accurate. The continuity correction is also noted as an important factor in improving the approximation, resulting in a corrected probability of approximately 0.7717.

PREREQUISITES
  • Understanding of binomial distribution and its probability formula.
  • Familiarity with Gaussian distribution and its approximation techniques.
  • Knowledge of continuity correction in probability calculations.
  • Basic proficiency in numerical methods for probability calculations.
NEXT STEPS
  • Explore the implications of the Central Limit Theorem on binomial distributions.
  • Learn about continuity correction in Gaussian approximations.
  • Investigate the conditions under which Gaussian approximations are valid.
  • Practice using online calculators for binomial and normal distributions.
USEFUL FOR

Statisticians, data scientists, and students studying probability theory who are interested in understanding the differences between binomial and Gaussian approximations in probability calculations.

ChrisVer
Science Advisor
Messages
3,372
Reaction score
465
Hi, I calculated the probability to this scenario:
getting between 3 and 6 Heads after tossing a coin for n=10 trials...

The binomial probability for this is:
P(3 \le k \le 6) = \sum_{k=3}^6 Bi(k;p,n)= \sum_{k=3}^6 \frac{n!}{k!(n-k)!} p^k (1-p)^{n-k} =\sum_{k=3}^6 \frac{10!}{k!(10-k)!} (0.5)^{10} = 0.7734375

Whereas for the Gaussian approximation to the binomial:
G(x) = \frac{1}{\sqrt{2 \pi n p (1-p) }} \exp\Big( - \frac{ (x-np)^2}{2np(1-p)} \Big)

I get:
P(3 \le x \le 6) = \int_3^6 dx~ G(x) = ... = 0.633505

My question is why are the two probabilities so off from each other? Is it because n cannot be considered as "large" ? I think when extracting the Gauss approximation, the additional higher orders go as \frac{1}{n}= 0.1 but that's for the gaussian distribution ##G## and not the integral of it.
Any feedback?
 
Physics news on Phys.org
Simon Bridge said:
n=10 p=0.5 gives [np, n(1-p)] = [5,5] and you really want them both bigger than 5.

So the difference is mainly due to the fact that np= n(1-p)=5 is not large enoguh? So Gauss can go a bit off in its predictions (here ~10%)...

The strange thing is that this is the only rule the approximation break, whereas the other two rules give:
\Big| \frac{1}{\sqrt{n}} \Big( \sqrt{\frac{q}{p}} -\sqrt{\frac{p}{q}} \Big) \Big| = 0 <0.3
and
np \pm 3 \sqrt{npq} \in [0.26 , 9.74 ] which is in [0,n=10]...

Simon Bridge said:
There are online calculators that will help you check your answers.
i.e. http://stattrek.com/online-calculator/normal.aspx

For the calculations I try to build my own source codes just for a practice :smile: (or check with the formulas in wolframalpha), and so far my numerical methods work fine.
 
You are forgetting the continuity correction: $$ P(3 \le x \le 6) \approx \int_{2.5}^{6.5} G(x)~dx \approx 0.7717 $$
 

Similar threads

  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 29 ·
Replies
29
Views
4K
  • · Replies 14 ·
Replies
14
Views
6K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 10 ·
Replies
10
Views
3K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 0 ·
Replies
0
Views
2K
  • · Replies 6 ·
Replies
6
Views
4K