How can we prove the tail bound for a standard Gaussian random variable?

  • Context: Undergrad 
  • Thread starter Thread starter Euge
  • Start date Start date
  • Tags Tags
    2017
Click For Summary
SUMMARY

The discussion centers on proving the tail bound for a standard Gaussian random variable, specifically demonstrating that $\Bbb P(\lvert Z\rvert \ge z) = O[\exp(-z^2/2)]$ as $z \to \infty$. The problem was correctly solved by user johng, who provided a detailed solution. The discussion emphasizes the importance of understanding the asymptotic behavior of Gaussian distributions in probability theory.

PREREQUISITES
  • Understanding of standard Gaussian random variables
  • Familiarity with asymptotic notation, specifically Big O notation
  • Knowledge of probability theory and tail bounds
  • Basic calculus, particularly limits and exponential functions
NEXT STEPS
  • Study the properties of Gaussian distributions and their applications in statistics
  • Learn about asymptotic analysis in probability theory
  • Explore advanced topics in probability, such as concentration inequalities
  • Investigate the implications of tail bounds in statistical inference
USEFUL FOR

Mathematicians, statisticians, and students of probability theory seeking to deepen their understanding of Gaussian distributions and their tail behaviors.

Euge
Gold Member
MHB
POTW Director
Messages
2,072
Reaction score
245
Here is this week's POTW:

-----
Suppose $Z$ is a standard Gaussian random variable. Prove $\Bbb P(\lvert Z\rvert \ge z) = O[\exp(-z^2/2)]$ as $z\to \infty$.-----

Remember to read the http://www.mathhelpboards.com/showthread.php?772-Problem-of-the-Week-%28POTW%29-Procedure-and-Guidelines to find out how to http://www.mathhelpboards.com/forms.php?do=form&fid=2!
 
Physics news on Phys.org
This week's problem was answered correctly by johng. You can read his solution below.

Let $d=1/\sqrt{2\pi}$. Then
$$P(|Z|\geq z)=d\int_{-\infty}^{-z}e^{-x^2/2}dx+d\int_{z}^{\infty}e^{-x^2/2}dx=1-2d\int_{0}^{z}e^{-x^2/2}dx$$
Then
$$\lim_{z\to\infty}{P(|Z|\geq z)\over e^{-z^2/2}}$$
is an indeterminate form 0/0. L'hopital's rule applies and this limit is then
$$\lim_{z\to\infty}{-2de^{-z^2/2}\over -ze^{-z^2/2}}=\lim_{z\to\infty}{2d\over z}=0$$

So definitely then
$$P(|Z|\geq z)=O(e^{-z^2/2})$$

Here is my solution as well.

By symmetry, $$P(\lvert Z\rvert \ge z) = \frac{2}{\sqrt{2\pi}}\int_z^\infty \exp\left(-\frac{x^2}{2}\right)\, dx$$

For all $z > 2/\sqrt{2\pi}$, the right-hand side of the above equation is no greater than

$$\int_z^\infty x\exp\left(-\frac{x^2}{2}\right)\, dx = \exp\left(-\frac{z^2}{2}\right)$$

Hence, $P(\lvert Z \rvert \ge z) = O[\exp(-z^2/2)]$ as $z\to \infty$.
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K