Understanding Asymptotic Notation (Big Oh & Little Oh)

  • Context: Graduate 
  • Thread starter Thread starter Rasalhague
  • Start date Start date
  • Tags Tags
    Notation
Join the discussion
Ask a follow-up here, or get your own question answered by working scientists, mathematicians and engineers — people, not an autocomplete.
Real named experts · corrections over time · the nuance an AI answer skips
2 replies · 3K views
Rasalhague
Messages
1,383
Reaction score
2
Have I got the following definitions right. That's to say, do they express the idea behind "big oh" and "little oh" notation, using essentially the same symbols as are traditionally used. Is the syntax unambiguous? Are there any more assumptions I need to state?

Let [itex]f,g:S \subseteq \mathbb{R} \mapsto \mathbb{R}[/itex]. Let [itex]x, x_0 \in \mathbb{R}[/itex].

[tex]O(g,x_0) := \left \{ f \; | \; \pmb{\exists} \varepsilon > 0 \exists \delta > 0 \forall x(|x-x_0| < \delta \Rightarrow \right |f(x)| \leq \varepsilon \cdot |g(x)| )\}[/tex]

[tex]o(g,x_0) := \left \{ f \; | \; \pmb{\forall} \varepsilon > 0 \exists \delta > 0 \forall x(|x-x_0| < \delta \Rightarrow \right |f(x)| \leq \varepsilon \cdot |g(x)| )\}[/tex]

These first two expressions differ from each other only in the first quantifier.

[tex]O(g,\infty) := \left \{ f \; | \; \pmb{\exists} \varepsilon > 0 \exists \delta > 0 \forall x(\pmb{x >} \delta \Rightarrow \right |f(x)| \leq \varepsilon \cdot |g(x)| )\}[/tex]

[tex]o(g,\infty) := \left \{ f \; | \; \pmb{\forall} \varepsilon > 0 \exists \delta > 0 \forall x(\pmb{x >} \delta \Rightarrow \right |f(x)| \leq \varepsilon \cdot |g(x)| )\}[/tex]

This second pair of expressions differ from first pair in that [itex]|x-x_0| < \delta[/itex] has become [itex]x > \delta[/itex].

Let [itex]O(g,-\infty)[/itex] and [itex]o(g,-\infty)[/itex] be defined by modifying the second pair in the obvious way, that is, by reversing the inequalities:

[tex]O(g,-\infty) := \left \{ f \; | \; \pmb{\exists} \varepsilon < 0 \exists \delta < 0 \forall x(x < \delta \Rightarrow \right |f(x)| \geq \varepsilon \cdot |g(x)| )\}[/tex]

[tex]o(g,-\infty) := \left \{ f \; | \; \pmb{\forall} \varepsilon < 0 \exists \delta < 0 \forall x(x < \delta \Rightarrow \right |f(x)| \geq \varepsilon \cdot |g(x)| )\}[/tex]

Regarding syntax, I've assumed that every existential quantifier, [itex]\exists[/itex], falls within the scope of all preceding universal quantifiers, [itex]\forall[/itex], and vice-versa, when they belong to the same string of quantifiers. For this reason, I've simply written [itex]\delta[/itex] where some authors write [itex]\delta(\epsilon)[/itex]. Is this assumption correct? Can anyone recommend a thorough introduction to mathematical logic (first order logic) that gives the rules for constructing symbolic expressions.
 
Last edited:
Physics news on Phys.org
I think I need to change the final epsilon in each of the final pair of expressions, the one which multiplies |g(x)|, to the absolute value of epsilon. And I think that should be "by reversing all but the final inequality in each", rather than "by reversing the inequalities", shouldn't it? So the final two inequalities of the final pair of expressions should be less-than-or-equals.
 
Rasalhague said:
Regarding syntax, I've assumed that every existential quantifier falls within the scope of all preceding universal quantifiers and vice-versa, when they belong to the same string of quantifiers. For this reason, I've simply written delta where some authors write delta(epsilon). Is this assumption correct? Can anyone recommend a thorough introduction to mathematical logic (first order logic) that gives the rules for constructing symbolic expressions.

Correct. The rules for quantifiers are given in Loomis & Sternberg, Advanced Calculus, at the beginning of Chapter 1, online here at Sternberg's website:

http://www.math.harvard.edu/people/SternbergShlomo.html