Why can we not apply the theorem?

  • Context: MHB 
  • Thread starter Thread starter evinda
  • Start date Start date
  • Tags Tags
    Apply Theorem
Click For Summary

Discussion Overview

The discussion revolves around the application of the master theorem to the recurrence relation $T(n)=4T \left ( \frac{n}{2}\right )+n^2 \log_2{(\log_2 n)}$. Participants explore whether the master theorem can be applied and how to demonstrate that its preconditions are not satisfied. The conversation includes technical reasoning and attempts to clarify the conditions under which the theorem is applicable.

Discussion Character

  • Technical explanation
  • Mathematical reasoning
  • Debate/contested

Main Points Raised

  • Some participants suggest that the master theorem cannot be applied and propose showing that the preconditions of its cases are not satisfied.
  • There is discussion about the specific forms of $f(n)$ that need to be evaluated against the conditions of the master theorem.
  • One participant notes that $f(n)=\Theta(n^2 \log_2(\log_2 n))$ and argues that it does not satisfy $f(n)=O(n^c)$ for $c < 2$.
  • Another participant questions whether it is sufficient to state that $f(n) \neq \Theta(n^2)$ and discusses how to prove this explicitly.
  • Participants explore the implications of assuming $f(n)=\Omega(n^c)$ for $c > 2$ and how that leads to contradictions.
  • There is a suggestion that the second case of the master theorem may be more general than initially thought, referencing external sources.
  • Some participants express uncertainty about the implications of their findings and seek clarification on specific inequalities and limits.

Areas of Agreement / Disagreement

Participants do not reach a consensus on the application of the master theorem, with multiple competing views on how to demonstrate that its conditions are not satisfied. There is ongoing debate about the specifics of the proofs and the implications of the inequalities discussed.

Contextual Notes

Participants express uncertainty regarding the assumptions needed for the application of the master theorem and the specific forms of $f(n)$ that must be evaluated. There are unresolved mathematical steps in the proofs being discussed, particularly concerning limits and inequalities.

evinda
Gold Member
MHB
Messages
3,741
Reaction score
0
Hi! (Wave)

Find an exact asymptotic solution of the recurrence relation $T(n)=4T \left ( \frac{n}{2}\right )+n^2 \log_2{(\log_2 n)}$, using the master theorem or show that the master theorem cannot be applied.

In this case, the master theorem cannot be applied, right? (Thinking)

But, how could we show it? (Thinking)
 
Physics news on Phys.org
evinda said:
Hi! (Wave)

Find an exact asymptotic solution of the recurrence relation $T(n)=4T \left ( \frac{n}{2}\right )+n^2 \log_2{(\log_2 n)}$, using the master theorem or show that the master theorem cannot be applied.

In this case, the master theorem cannot be applied, right? (Thinking)

But, how could we show it? (Thinking)

Hey! (Smile)

How about showing that the preconditions of each of the possible cases are not satisfied? (Thinking)
 
I like Serena said:
Hey! (Smile)

How about showing that the preconditions of each of the possible cases are not satisfied? (Thinking)

So, do I have to show that none of these relations stand? (Thinking)

  • $f(n)=O(n^{\log_b a- \epsilon})$
  • $f(n)=\Theta(n^{\log_b a})$
  • $f(n)=\Omega(n^{\log_b a+ \epsilon}) \text{ and } \exists c<1 \text{ such that: } a f \left ( \frac{n}{b}\right ) \leq c f(n)$
 
Last edited:
If so, how could I do this? (Thinking)
 
evinda said:
So, do I have to show that none of these relations stand? (Thinking)

  • $f(n)=O(n^{\log_b a- \epsilon})$
  • $f(n_=\Theta(n^{\log_b a})$
  • $f(n)=\Omega(n^{\log_b a+ \epsilon}) \text{ and } \exists c<1 \text{ such that: } a f \left ( \frac{n}{b}\right ) \leq c f(n)$

That looks about right, although I think the second should be:
$$f(n)=\Theta(n^{\log_b a} \log^k n)\text{ with }k \ge 0$$

evinda said:
If so, how could I do this? (Thinking)

Let's start with the first.
We know that $\log_b a=\log_2 4 = 2$.
Since $f(n)=\Theta(n^2\log_2(\log_2 n))$, it follows that $f(n)\ne O(n^c)$ with $c < 2$.
 
I like Serena said:
That looks about right, although I think the second should be:
$$f(n)=\Theta(n^{\log_b a} \log^k n)\text{ with }k \ge 0$$

Isn't it $f(n)=n^{\log_b a}$, from which it follows that $T(n)=\Theta(n^{\log_b a} \lg n)$ ? (Thinking)

I like Serena said:
Let's start with the first.
We know that $\log_b a=\log_2 4 = 2$.
Since $f(n)=\Theta(n^2\log_2(\log_2 n))$, it follows that $f(n)\ne O(n^c)$ with $c < 2$.

So, can we just say that it follows that $f(n)\ne O(n^c)$ with $c < 2$, or do we have to explain it further? (Thinking)
 
evinda said:
Isn't it $f(n)=n^{\log_b a}$, from which it follows that $T(n)=\Theta(n^{\log_b a} \lg n)$ ? (Thinking)

For what it is worth, wikipedia gives a more general second case. :confused:
So, can we just say that it follows that $f(n)\ne O(n^c)$ with $c < 2$, or do we have to explain it further? (Thinking)

I believe so.
It is possible to prove it explicitly, but I consider that overdone. (Wasntme)
 
I like Serena said:
For what it is worth, wikipedia gives a more general second case. :confused:

In my notes, at the the second case, it is $f(n)=\Theta(n^{\log_b a})$.. (Wasntme)
I like Serena said:
I believe so.
It is possible to prove it explicitly, but I consider that overdone. (Wasntme)

So, in order to reject the second case, could we say it like that? (Thinking)

Since $f(n)=\Theta(n^2 \log_2{ \log_2 n})$, it follows that
$f(n) \neq \Theta(n^2)$.

Also, what could we say about the third case? :confused:

How could we prove it explicitly? (Thinking)
 
evinda said:
So, in order to reject the second case, could we say it like that? (Thinking)

Since $f(n)=\Theta(n^2 \log_2{ \log_2 n})$, it follows that
$f(n) \neq \Theta(n^2)$.

Actually, we can phrase it slightly sharper and say:

Since $f(n)=n^2 \log_2{ \log_2 n}$, it follows that $f(n) \neq \Theta(n^2)$. (Nerd)
How could we prove it explicitly? (Thinking)

Suppose $n^2\log_2(\log_2 n) = O(n^c)$ with $c<2$.

Then that means that $\exists M >0, \exists n_0$ such that $\forall n \ge n_0$: $n^2\log_2(\log_2 n) < Mn^2$.
This implies $\forall n \ge n_0: \log_2(\log_2 n) < M$, which is a contradiction.

Therefore $n^2\log_2(\log_2 n) \ne O(n^c)$ with $c<2$. (Coffee)
Also, what could we say about the third case? :confused:

Give it a try? (Thinking)
 
  • #10
I like Serena said:
Actually, we can phrase it slightly sharper and say:

Since $f(n)=n^2 \log_2{ \log_2 n}$, it follows that $f(n) \neq \Theta(n^2)$. (Nerd)

And could we prove it like that? (Thinking)

We suppose that $f(n)=\Theta(n^2)$.

Then, $f(n)=\Omega(n^2)$ and $f(n)=O(n^2)$.

$f(n)=O(n^2)$ means that $\exists M>0, n_0 \geq 0$ such that $\forall n \geq n_0$:

$$f(n) \leq Mn^2 \Rightarrow n^2 \log_2{(\log_2 n)} \leq Mn^2 \Rightarrow \log_2{(\log_2 n)} \leq M, \text{ that is a contradiction.}$$
I like Serena said:
Suppose $n^2\log_2(\log_2 n) = O(n^c)$ with $c<2$.

Then that means that $\exists M >0, \exists n_0$ such that $\forall n \ge n_0$: $n^2\log_2(\log_2 n) < Mn^2$.
This implies $\forall n \ge n_0: M > \log_2(\log_2 n)$, which is a contradiction.

Therefore $n^2\log_2(\log_2 n) \ne O(n^c)$ with $c<2$. (Coffee)

Do we have this inequality: $n^2\log_2(\log_2 n) < Mn^2$, since from the definition, we have that $\exists M >0, \exists n_0$ such that $\forall n \ge n_0$: $n^2\log_2(\log_2 n) \leq M n^c$ and $c<2 \Rightarrow n^c<n^2$, so
$M n^c<M n^2$ ? (Thinking)

Also, is this: $\forall n \ge n_0: M > \log_2(\log_2 n)$ a contradiction, since we found a restriction for $n$, or am I wrong? (Worried)

I like Serena said:
Give it a try? (Thinking)

Could we do it like that? (Thinking)

Since $f(n)=\Theta(n^2 \log_2{(\log_2 n)})$, it follows that $f(n) \neq \Omega(n^c),c>2$.

Suppose $n^2 \log_2{(\log_2 n)}=\Omega(n^c), c>2$.

Then, that means that $\exists M>0, n_0 \geq 0$, such that $\forall n \geq n_0$:

$$n^2 \log_2{(\log_2 n)} > Mn^3 \Rightarrow \log_2{(\log_2 n)}>Mn$$

Is it right so far? How could we continue? (Thinking)
 
  • #11
evinda said:
And could we prove it like that? (Thinking)

We suppose that $f(n)=\Theta(n^2)$.

Then, $f(n)=\Omega(n^2)$ and $f(n)=O(n^2)$.

$f(n)=O(n^2)$ means that $\exists M>0, n_0 \geq 0$ such that $\forall n \geq n_0$:

$$f(n) \leq Mn^2 \Rightarrow n^2 \log_2{(\log_2 n)} \leq Mn^2 \Rightarrow \log_2{(\log_2 n)} \leq M, \text{ that is a contradiction.}$$

Yep! (Nod)
Do we have this inequality: $n^2\log_2(\log_2 n) < Mn^2$, since from the definition, we have that $\exists M >0, \exists n_0$ such that $\forall n \ge n_0$: $n^2\log_2(\log_2 n) \leq M n^c$ and $c<2 \Rightarrow n^c<n^2$, so
$M n^c<M n^2$ ? (Thinking)

Also, is this: $\forall n \ge n_0: M > \log_2(\log_2 n)$ a contradiction, since we found a restriction for $n$, or am I wrong? (Worried)

Yes on both counts.
Sharp! (Speechless)
Could we do it like that? (Thinking)

Since $f(n)=\Theta(n^2 \log_2{(\log_2 n)})$, it follows that $f(n) \neq \Omega(n^c),c>2$.

Suppose $n^2 \log_2{(\log_2 n)}=\Omega(n^c), c>2$.

Then, that means that $\exists M>0, n_0 \geq 0$, such that $\forall n \geq n_0$:

$$n^2 \log_2{(\log_2 n)} > Mn^3 \Rightarrow \log_2{(\log_2 n)}>Mn$$

Is it right so far? How could we continue? (Thinking)

That is too strong.
We can't require a lower bound of $n^3$.
For instance $n^{2.5}$ might be a lower bound. (Worried)It should be:

Then, that means that $\exists M>0, n_0 \geq 0$, such that $\forall n \geq n_0$:
$$n^2 \log_2{(\log_2 n)} > Mn^c \Rightarrow \log_2{(\log_2 n)}>Mn^{c-2}$$To continue, what is:
$$\lim_{n\to \infty} \frac{n^2 \log_2{(\log_2 n)}}{n^{c-2}}$$
(Wondering)
 
  • #12
I like Serena said:
That is too strong.
We can't require a lower bound of $n^3$.
For instance $n^{2.5}$ might be a lower bound. (Worried)It should be:

Then, that means that $\exists M>0, n_0 \geq 0$, such that $\forall n \geq n_0$:
$$n^2 \log_2{(\log_2 n)} > Mn^c \Rightarrow \log_2{(\log_2 n)}>Mn^{c-2}$$To continue, what is:
$$\lim_{n\to \infty} \frac{n^2 \log_2{(\log_2 n)}}{n^{c-2}}$$
(Wondering)

So, is it like that? (Thinking)

We suppose that $n^2 \log_2{(\log_2 n)}=\Omega(n^c), c>2$.
Then, that means that $\exists M>0, n_0 \geq 0$ such that $\forall n \geq n_0:$
$$n^2 \log_2{\log_2 n} \geq Mn^c \Rightarrow Mn^{c-2} \leq \log_2{\log_2 n}$$

$$\lim_{n \to +\infty} \frac{\log_2{\log_2 n}}{n^{c-2} } =\lim_{n \to +\infty} \frac{\frac{1}{n \cdot \log_2 n}}{(c-2) n^{c-3}}=\lim_{n \to +\infty} \frac{1}{(c-2)n^{c-2} \log_2{n} }=0$$

From this, we conclude that $\log_2{\log_2 n}=o(n^{c-2})$, so:

$$\forall N>0, \exists n_0 \text{ such that } \forall n \geq n_0: $$

$$\log_2{\log_2 n}<N n^{c-2}$$

Therefore, we cannot find a $M$, such that:

$$n^2 \log_2{\log_2 n} \geq Mn^c \Rightarrow Mn^{c-2} \leq \log_2{\log_2 n}$$

and, so we conclude that $f(n) \neq \Omega(n^c)$.Or have I done something wrong? (Thinking)
 
  • #13
evinda said:
So, is it like that? (Thinking)

We suppose that $n^2 \log_2{(\log_2 n)}=\Omega(n^c), c>2$.
Then, that means that $\exists M>0, n_0 \geq 0$ such that $\forall n \geq n_0:$
$$n^2 \log_2{\log_2 n} \geq Mn^c \Rightarrow Mn^{c-2} \leq \log_2{\log_2 n}$$

$$\lim_{n \to +\infty} \frac{\log_2{\log_2 n}}{n^{c-2} } =\lim_{n \to +\infty} \frac{\frac{1}{n \cdot \log_2 n}}{(c-2) n^{c-3}}=\lim_{n \to +\infty} \frac{1}{(c-2)n^{c-2} \log_2{n} }=0$$

From this, we conclude that $\log_2{\log_2 n}=o(n^{c-2})$, so:

$$\forall N>0, \exists n_0 \text{ such that } \forall n \geq n_0: $$

$$\log_2{\log_2 n}<N n^{c-2}$$

Therefore, we cannot find a $M$, such that:

$$n^2 \log_2{\log_2 n} \geq Mn^c \Rightarrow Mn^{c-2} \leq \log_2{\log_2 n}$$

and, so we conclude that $f(n) \neq \Omega(n^c)$.Or have I done something wrong? (Thinking)

Looks good to me! (Nod)
 
  • #14
I like Serena said:
Looks good to me! (Nod)

Great! Thank you mery much! (Party)
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 15 ·
Replies
15
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 4 ·
Replies
4
Views
1K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K