MHB How can we prove the tail bound for a standard Gaussian random variable?

  • Thread starter Thread starter Euge
  • Start date Start date
  • Tags Tags
    2017
Click For Summary
The discussion focuses on proving the tail bound for a standard Gaussian random variable, specifically showing that the probability of the absolute value of Z being greater than or equal to z behaves as O[exp(-z^2/2)] as z approaches infinity. The problem was part of the weekly Problem of the Week (POTW) and was correctly solved by a user named johng. Another participant also shared their solution, contributing to the overall understanding of the topic. The thread emphasizes the importance of mathematical rigor in proving probabilistic bounds. This discussion highlights key techniques in probability theory related to Gaussian distributions.
Euge
Gold Member
MHB
POTW Director
Messages
2,072
Reaction score
245
Here is this week's POTW:

-----
Suppose $Z$ is a standard Gaussian random variable. Prove $\Bbb P(\lvert Z\rvert \ge z) = O[\exp(-z^2/2)]$ as $z\to \infty$.-----

Remember to read the http://www.mathhelpboards.com/showthread.php?772-Problem-of-the-Week-%28POTW%29-Procedure-and-Guidelines to find out how to http://www.mathhelpboards.com/forms.php?do=form&fid=2!
 
Physics news on Phys.org
This week's problem was answered correctly by johng. You can read his solution below.

Let $d=1/\sqrt{2\pi}$. Then
$$P(|Z|\geq z)=d\int_{-\infty}^{-z}e^{-x^2/2}dx+d\int_{z}^{\infty}e^{-x^2/2}dx=1-2d\int_{0}^{z}e^{-x^2/2}dx$$
Then
$$\lim_{z\to\infty}{P(|Z|\geq z)\over e^{-z^2/2}}$$
is an indeterminate form 0/0. L'hopital's rule applies and this limit is then
$$\lim_{z\to\infty}{-2de^{-z^2/2}\over -ze^{-z^2/2}}=\lim_{z\to\infty}{2d\over z}=0$$

So definitely then
$$P(|Z|\geq z)=O(e^{-z^2/2})$$

Here is my solution as well.

By symmetry, $$P(\lvert Z\rvert \ge z) = \frac{2}{\sqrt{2\pi}}\int_z^\infty \exp\left(-\frac{x^2}{2}\right)\, dx$$

For all $z > 2/\sqrt{2\pi}$, the right-hand side of the above equation is no greater than

$$\int_z^\infty x\exp\left(-\frac{x^2}{2}\right)\, dx = \exp\left(-\frac{z^2}{2}\right)$$

Hence, $P(\lvert Z \rvert \ge z) = O[\exp(-z^2/2)]$ as $z\to \infty$.