Proving $\lg^2 n=o(2^{\sqrt{2 \lg n}})$ and $2^{2^{n+1}}=\omega(2^{2^n})$

  • Context: MHB 
  • Thread starter Thread starter evinda
  • Start date Start date
Click For Summary
SUMMARY

This discussion focuses on proving the asymptotic relationships $\lg^2 n = o(2^{\sqrt{2 \lg n}})$ and $2^{2^{n+1}} = \omega(2^{2^n})$. Participants clarify that to prove these statements, one must demonstrate that for every constant $c > 0$, there exists an $n_0 \geq 1$ such that the inequalities hold for all $n \geq n_0$. The conversation emphasizes the importance of correctly framing the proof and selecting appropriate values for $n_0$ based on the value of $c$.

PREREQUISITES
  • Understanding of asymptotic notation, specifically small-o and big-omega.
  • Familiarity with logarithmic functions and their properties.
  • Knowledge of limits and their application in asymptotic analysis.
  • Basic skills in mathematical proof techniques, particularly in establishing inequalities.
NEXT STEPS
  • Study the definitions and properties of small-o and big-omega notation in detail.
  • Learn how to apply logarithmic identities in asymptotic proofs.
  • Explore limit theorems, particularly L'Hôpital's Rule, for analyzing growth rates.
  • Practice constructing rigorous mathematical proofs involving inequalities and asymptotic behavior.
USEFUL FOR

Mathematicians, computer scientists, and students engaged in theoretical computer science or algorithm analysis who are looking to deepen their understanding of asymptotic notation and proof techniques.

  • #31
evinda said:
$$2 \lg y< \epsilon( \lg c+ \sqrt{2} \sqrt{y}) \Rightarrow 2 \lg (\lg n)< \epsilon( \lg c+ \sqrt{2} \sqrt{\lg n}) \Rightarrow \lg (\lg^2 n)< \epsilon (\lg c+ \sqrt{2} \sqrt{\lg n})$$

Do we pick now $\epsilon=1$ ? (Thinking)

Sounds good. (Sweating)
 
Technology news on Phys.org
  • #32
I like Serena said:
Sounds good. (Sweating)

Then , after picking $\epsilon=1$, have we shown that $\lg^2 n=o(2^{\sqrt{2 \lg n}})$ ? (Thinking)
 
  • #33
evinda said:
Then , after picking $\epsilon=1$, have we shown that $\lg^2 n=o(2^{\sqrt{2 \lg n}})$ ? (Thinking)

Suppose you check the condition for this to be true.
Is it (always) satisfied with what you have? (Wondering)
 
  • #34
I like Serena said:
Suppose you check the condition for this to be true.
Is it (always) satisfied with what you have? (Wondering)

We want to show that $\lg^2 n=o(2^{\sqrt{2 \lg n}})$, so, that:
$$\forall c>0, \exists n_0 \text{ such that } \forall n \geq n_0: \lg (\lg^2 n)< \lg c+ \sqrt{2} \sqrt{n}$$We have shown that $\exists n_0$ such that $\forall n \geq n_0$:

$$\lg (\lg^2 n)< \lg c+ \sqrt{2} \sqrt{ \lg n}$$

But, we haven't shown that the relation stands $ \forall c>0$, or am I wrong? (Thinking)
 
  • #35
evinda said:
We want to show that $\lg^2 n=o(2^{\sqrt{2 \lg n}})$, so, that:
$$\forall c>0, \exists n_0 \text{ such that } \forall n \geq n_0: \lg (\lg^2 n)< \lg c+ \sqrt{2} \sqrt{n}$$We have shown that $\exists n_0$ such that $\forall n \geq n_0$:

$$\lg (\lg^2 n)< \lg c+ \sqrt{2} \sqrt{ \lg n}$$

But, we haven't shown that the relation stands $ \forall c>0$, or am I wrong? (Thinking)

You are wrong. (Shake)
For every $c>0$ the same reasoning stands. (Nod)
 
  • #36
I like Serena said:
Suppose you check the condition for this to be true.
Is it (always) satisfied with what you have? (Wondering)

Is it not always satisfied? (Thinking)
 
  • #37
Could you give me a hint what might be wrong? (Thinking)
 
  • #38
evinda said:
Is it not always satisfied? (Thinking)

evinda said:
Could you give me a hint what might be wrong? (Thinking)

I have lost track of what was going on in this thread.
Can you restate what you're trying to proof and what you have found? (Wondering)
 
  • #39
I like Serena said:
I have lost track of what was going on in this thread.
Can you restate what you're trying to proof and what you have found? (Wondering)

We want to prove that $\lg^2 n=o(2^{\sqrt{2 \lg n}})$, so we want to prove that: $\forall c>0, \exists n_0$, such that $\forall n \geq n_0: \lg^2 n< c \cdot 2^{\sqrt{2 \lg n}}$

$\lg^2 n< c \cdot 2^{\sqrt{2 \lg n}} \Rightarrow \lg{ \lg^2 n}<\lg{(c \cdot 2^{\sqrt{2 \lg n}})}=\lg c+\lg{2^{\sqrt{2 \lg n}}}=\lg c+ \sqrt{2 \lg n} \\ \Rightarrow \lg {\lg^2 n}< \lg c+ \sqrt{2} \sqrt{\lg n}$

We set $y=\lg n$.

$$\lg{ \lg^2 n}<\lg c+ \sqrt{2} \sqrt{\lg n} \Rightarrow \lg{ y^2}< \lg c+ \sqrt{2} \sqrt{y} \Rightarrow 2 \lg y< \lg c+ \sqrt{2} \sqrt{y}$$

$$\lim_{y \to +\infty} \frac{2 \lg{ y}}{\lg c+ \sqrt{2} \sqrt{y}}=\lim_{y \to +\infty} \frac{\frac{2}{y}}{ \frac{1}{ \sqrt{2} \sqrt{y}}}=\lim_{y \to +\infty} \frac{2 \sqrt{2} \sqrt{y}}{y}=lim_{y \to +\infty} \frac{2 \sqrt{2}}{\sqrt{y}}=0$$

What can I say about the limit, now that we have $y$ and not $n$ ? (Thinking)
 
  • #40
evinda said:
We set $y=\lg n$.

$$\lg{ \lg^2 n}<\lg c+ \sqrt{2} \sqrt{\lg n} \Rightarrow \lg{ y^2}< \lg c+ \sqrt{2} \sqrt{y} \Rightarrow 2 \lg y< \lg c+ \sqrt{2} \sqrt{y}$$

$$\lim_{y \to +\infty} \frac{2 \lg{ y}}{\lg c+ \sqrt{2} \sqrt{y}}=\lim_{y \to +\infty} \frac{\frac{2}{y}}{ \frac{1}{ \sqrt{2} \sqrt{y}}}=\lim_{y \to +\infty} \frac{2 \sqrt{2} \sqrt{y}}{y}=lim_{y \to +\infty} \frac{2 \sqrt{2}}{\sqrt{y}}=0$$

What can I say about the limit, now that we have $y$ and not $n$ ? (Thinking)

We can back substitute $y=\lg n$ to find:
$$\lim_{n \to +\infty} \frac{2 \lg( \lg n)}{\lg c+ \sqrt{2} \sqrt{\lg n}}=0$$

Next is writing out what this means in terms of $\epsilon$ and $n_0$. (Wasntme)
 
  • #41
I like Serena said:
We can back substitute $y=\lg n$ to find:
$$\lim_{n \to +\infty} \frac{2 \lg( \lg n)}{\lg c+ \sqrt{2} \sqrt{\lg n}}=0$$

Next is writing out what this means in terms of $\epsilon$ and $n_0$. (Wasntme)

So, could we say it like that? (Thinking)

$$\lim_{y \to +\infty} \frac{2 \lg y}{\lg c+ \sqrt{2} \sqrt{y}}=0 \Rightarrow \lim_{n \to +\infty} \frac{2 \lg {\lg n}}{\lg c+ \sqrt{2} \sqrt{\lg n}}=0$$

That means that $\forall \epsilon>0, \exists n_0$, such that $\forall n \geq n_0$:

$$2 \lg {(\lg n)}< \epsilon (\lg c+ \sqrt{2} \sqrt{\lg n}) \Rightarrow \lg{\lg^2 n}< \epsilon(\lg c+ \sqrt{2 \lg n})$$
 
  • #42
evinda said:
So, could we say it like that? (Thinking)

$$\lim_{y \to +\infty} \frac{2 \lg y}{\lg c+ \sqrt{2} \sqrt{y}}=0 \Rightarrow \lim_{n \to +\infty} \frac{2 \lg {\lg n}}{\lg c+ \sqrt{2} \sqrt{\lg n}}=0$$

That means that $\forall \epsilon>0, \exists n_0$, such that $\forall n \geq n_0$:

$$2 \lg {(\lg n)}< \epsilon (\lg c+ \sqrt{2} \sqrt{\lg n}) \Rightarrow \lg{\lg^2 n}< \epsilon(\lg c+ \sqrt{2 \lg n})$$

Yes, but with a slight correction. (Wait)

It means that $\forall \epsilon>0, \exists n_0$, such that $\forall n \geq n_0$:
$$\left|\frac{2 \lg {(\lg n)}}{\lg c+ \sqrt{2} \sqrt{\lg n}}\right|< \epsilon
\Rightarrow 2 \lg {(\lg n)}< \epsilon |\lg c+ \sqrt{2} \sqrt{\lg n}|
\Rightarrow \lg{\lg^2 n}< \epsilon|\lg c+ \sqrt{2 \lg n}|$$

The distinction with absolute sign is necessary because $\lg c$ can be negative.
 
  • #43
I like Serena said:
Yes, but with a slight correction. (Wait)

It means that $\forall \epsilon>0, \exists n_0$, such that $\forall n \geq n_0$:
$$\left|\frac{2 \lg {(\lg n)}}{\lg c+ \sqrt{2} \sqrt{\lg n}}\right|< \epsilon
\Rightarrow 2 \lg {(\lg n)}< \epsilon |\lg c+ \sqrt{2} \sqrt{\lg n}|
\Rightarrow \lg{\lg^2 n}< \epsilon|\lg c+ \sqrt{2 \lg n}|$$

The distinction with absolute sign is necessary because $\lg c$ can be negative.

A ok! (Nod) But, could we continue now? (Thinking)
 
  • #44
evinda said:
A ok! (Nod) But, could we continue now? (Thinking)

Didn't we already do that? :confused:
What do you think comes next? (Wondering)
 
  • #45
I like Serena said:
Didn't we already do that? :confused:
What do you think comes next? (Wondering)

We set $\epsilon=1$ and then we have that $\exists n_0 \geq 0$, such that $\forall n \geq n_0$: $\lg{ \lg^2 n}< |\lg c+ \sqrt{2 \lg n}|$.

Do we have to continue like that?

$\lg{ \lg^2 n}< |\lg c+ \sqrt{2 \lg n}| \Rightarrow \lg c+\sqrt{2 \lg n}> \lg {\lg^2 n} \text{ or } \lg c+ \sqrt{2 \lg n}< - \lg{ \lg^2 n} $

And can we conclude from that, that $\exists n_0$ such that $\forall n \geq n_0$:
$$\lg{ \lg^2 n }< \lg c+ \sqrt{2 \lg n}$$

?
(Thinking)
 
  • #46
evinda said:
We set $\epsilon=1$ and then we have that $\exists n_0 \geq 0$, such that $\forall n \geq n_0$: $\lg{ \lg^2 n}< |\lg c+ \sqrt{2 \lg n}|$.

If we pick $n_0$ large enough (we can introduce $n_1$ if you want), then $\lg c+ \sqrt{2 \lg n} >0$.
It follows that then:
$$\lg{ \lg^2 n}< \lg c+ \sqrt{2 \lg n}$$
(Wasntme)
 
  • #47
I like Serena said:
If we pick $n_0$ large enough (we can introduce $n_1$ if you want), then $\lg c+ \sqrt{2 \lg n} >0$.
It follows that then:
$$\lg{ \lg^2 n}< \lg c+ \sqrt{2 \lg n}$$
(Wasntme)

So, can we say it like that? (Thinking)

We set $\epsilon=1$ and then we have that $\exists n_0 \geq 0$, such that $\forall n \geq n_0$: $\lg{ \lg^2 n}< |\lg c+ \sqrt{2 \lg n}|$.

We pick a large enough $n_1$, such that $\lg c+ \sqrt{2 \lg n}>0, \forall n \geq n_1$.

Now, we pick $n_2=\max \{ n_1, n_0 \}$ and we have that:

$\forall n \geq n_2: \lg{ \lg^2 n}< \lg c+ \sqrt{2 \lg n}$.
 
  • #48
evinda said:
So, can we say it like that? (Thinking)

We set $\epsilon=1$ and then we have that $\exists n_0 \geq 0$, such that $\forall n \geq n_0$: $\lg{ \lg^2 n}< |\lg c+ \sqrt{2 \lg n}|$.

We pick a large enough $n_1$, such that $\lg c+ \sqrt{2 \lg n}>0, \forall n \geq n_1$.

Now, we pick $n_2=\max \{ n_1, n_0 \}$ and we have that:

$\forall n \geq n_2: \lg{ \lg^2 n}< \lg c+ \sqrt{2 \lg n}$.

Yes we can! (Nod)
 
  • #49
I like Serena said:
Yes we can! (Nod)

So, we have shown now that $\lg^2 n=o(2^{\sqrt{2 \lg n}})$, right? (Smile)
 
  • #50
evinda said:
So, we have shown now that $\lg^2 n=o(2^{\sqrt{2 \lg n}})$, right? (Smile)

Yep! (Nod)
 
  • #51
I like Serena said:
Yep! (Nod)

According to the definition, it is $f(n)=o(g(n))$, if $\forall c>0, \exists n_0 \geq 0$ such that $\forall n \geq n_0$:
$$0 \leq f(n)<c g(n)$$

So, do I have to say also at the beginning, that $\lg^2 n \geq 0, \forall n \geq 0$ ? (Thinking)
 
  • #52
evinda said:
According to the definition, it is $f(n)=o(g(n))$, if $\forall c>0, \exists n_0 \geq 0$ such that $\forall n \geq n_0$:
$$0 \leq f(n)<c g(n)$$

So, do I have to say also at the beginning, that $\lg^2 n \geq 0, \forall n \geq 0$ ? (Thinking)

Well... that's not true is it? (Wondering)
You'll need a larger lower bound.
 
  • #53
I like Serena said:
Well... that's not true is it? (Wondering)
You'll need a larger lower bound.

Is it $\lg^2 n \geq 0, \forall n \geq 1$ ? (Thinking)
 
  • #54
evinda said:
Is it $\lg^2 n \geq 0, \forall n \geq 1$ ? (Thinking)

That's better. (Mmm)
 
  • #55
I like Serena said:
That's better. (Mmm)

So, at the end of the exercise, can we take $n_2=\max \{ n_0,n_1,1\}$ ? (Thinking)
 
  • #56
evinda said:
So, at the end of the exercise, can we take $n_2=\max \{ n_0,n_1,1\}$ ? (Thinking)

I guess so yes. (Smile)
 
  • #57
When we have the definition:

Let $f,g$ asymptotically positive functions. We say that $f=\omega(g)$ if $\forall c>0 \exists n_0=n_0(c) \in \mathbb{N}: \forall n \geq n_0$:

$$0 \leq c g(n)< f(n)$$

do we include $0$ at the values that $n_0$ can take or not? (Thinking)
 
  • #58
evinda said:
When we have the definition:

Let $f,g$ asymptotically positive functions. We say that $f=\omega(g)$ if $\forall c>0 \exists n_0=n_0(c) \in \mathbb{N}: \forall n \geq n_0$:

$$0 \leq c g(n)< f(n)$$

do we include $0$ at the values that $n_0$ can take or not? (Thinking)

We "pick" $n_0$ ourselves, so we are free to include 0 or not.
Generally, we pick $n_0$ a big as we need to, and there is little point in considering to make it 0. (Mmm)
 
  • #59
I like Serena said:
We "pick" $n_0$ ourselves, so we are free to include 0 or not.
Generally, we pick $n_0$ a big as we need to, and there is little point in considering to make it 0. (Mmm)

A ok! (Nod) In order that $2^{2^{n+1}}=\omega(2^{2^n})$, it should be:
$$2^{2^{n+1}}> c \cdot 2^{2^n} \geq 0$$

Do I have to say at the beginning that $c \cdot 2^{2^n} \geq 0, \forall n \geq 0$ ? (Thinking)
 
  • #60
evinda said:
A ok! (Nod) In order that $2^{2^{n+1}}=\omega(2^{2^n})$, it should be:
$$2^{2^{n+1}}> c \cdot 2^{2^n} \geq 0$$

Do I have to say at the beginning that $c \cdot 2^{2^n} \geq 0, \forall n \geq 0$ ? (Thinking)

In your definition you have the condition that "f,g asymptotically are positive functions".
That makes what you're suggesting to say sort of redundant.
Although you may indeed want to indicate that you can apply your definition of the $\omega$ symbol. (Nerd)Actually, the definition as wikipedia gives it, is more general since the functions do not have to be positive.
Instead it is required that $c |g(n)| \le |f(n)|$. (Wasntme)
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 15 ·
Replies
15
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 17 ·
Replies
17
Views
2K
  • · Replies 10 ·
Replies
10
Views
3K