Understanding Asymptotic Notation (Big Oh & Little Oh)

  • Thread starter Thread starter Rasalhague
  • Start date Start date
  • Tags Tags
    Notation
Click For Summary
SUMMARY

This discussion clarifies the definitions and syntax of asymptotic notation, specifically Big O and little o notation, using precise mathematical expressions. The definitions provided for O(g,x0) and o(g,x0) are confirmed as correct, highlighting the distinction between existential and universal quantifiers. Additionally, the discussion addresses the syntax of quantifiers and recommends Loomis & Sternberg's "Advanced Calculus" as a resource for understanding the rules of constructing symbolic expressions in mathematical logic.

PREREQUISITES
  • Understanding of asymptotic notation, specifically Big O and little o notation.
  • Familiarity with mathematical logic and quantifiers (existential and universal).
  • Basic knowledge of calculus and real analysis.
  • Ability to interpret mathematical expressions and notation.
NEXT STEPS
  • Study the definitions and properties of asymptotic notation in detail.
  • Learn about quantifiers in mathematical logic, focusing on existential and universal quantifiers.
  • Read Loomis & Sternberg's "Advanced Calculus" for a comprehensive understanding of symbolic expressions.
  • Explore additional resources on mathematical logic to solidify foundational knowledge.
USEFUL FOR

Mathematicians, computer scientists, and students in advanced calculus or algorithm analysis who seek to deepen their understanding of asymptotic notation and mathematical logic.

Rasalhague
Messages
1,383
Reaction score
2
Have I got the following definitions right. That's to say, do they express the idea behind "big oh" and "little oh" notation, using essentially the same symbols as are traditionally used. Is the syntax unambiguous? Are there any more assumptions I need to state?

Let f,g:S \subseteq \mathbb{R} \mapsto \mathbb{R}. Let x, x_0 \in \mathbb{R}.

O(g,x_0) := \left \{ f \; | \; \pmb{\exists} \varepsilon > 0 \exists \delta > 0 \forall x(|x-x_0| < \delta \Rightarrow \right |f(x)| \leq \varepsilon \cdot |g(x)| )\}

o(g,x_0) := \left \{ f \; | \; \pmb{\forall} \varepsilon > 0 \exists \delta > 0 \forall x(|x-x_0| < \delta \Rightarrow \right |f(x)| \leq \varepsilon \cdot |g(x)| )\}

These first two expressions differ from each other only in the first quantifier.

O(g,\infty) := \left \{ f \; | \; \pmb{\exists} \varepsilon > 0 \exists \delta > 0 \forall x(\pmb{x >} \delta \Rightarrow \right |f(x)| \leq \varepsilon \cdot |g(x)| )\}

o(g,\infty) := \left \{ f \; | \; \pmb{\forall} \varepsilon > 0 \exists \delta > 0 \forall x(\pmb{x >} \delta \Rightarrow \right |f(x)| \leq \varepsilon \cdot |g(x)| )\}

This second pair of expressions differ from first pair in that |x-x_0| < \delta has become x > \delta.

Let O(g,-\infty) and o(g,-\infty) be defined by modifying the second pair in the obvious way, that is, by reversing the inequalities:

O(g,-\infty) := \left \{ f \; | \; \pmb{\exists} \varepsilon < 0 \exists \delta < 0 \forall x(x < \delta \Rightarrow \right |f(x)| \geq \varepsilon \cdot |g(x)| )\}

o(g,-\infty) := \left \{ f \; | \; \pmb{\forall} \varepsilon < 0 \exists \delta < 0 \forall x(x < \delta \Rightarrow \right |f(x)| \geq \varepsilon \cdot |g(x)| )\}

Regarding syntax, I've assumed that every existential quantifier, \exists, falls within the scope of all preceding universal quantifiers, \forall, and vice-versa, when they belong to the same string of quantifiers. For this reason, I've simply written \delta where some authors write \delta(\epsilon). Is this assumption correct? Can anyone recommend a thorough introduction to mathematical logic (first order logic) that gives the rules for constructing symbolic expressions.
 
Last edited:
Physics news on Phys.org
I think I need to change the final epsilon in each of the final pair of expressions, the one which multiplies |g(x)|, to the absolute value of epsilon. And I think that should be "by reversing all but the final inequality in each", rather than "by reversing the inequalities", shouldn't it? So the final two inequalities of the final pair of expressions should be less-than-or-equals.
 
Rasalhague said:
Regarding syntax, I've assumed that every existential quantifier falls within the scope of all preceding universal quantifiers and vice-versa, when they belong to the same string of quantifiers. For this reason, I've simply written delta where some authors write delta(epsilon). Is this assumption correct? Can anyone recommend a thorough introduction to mathematical logic (first order logic) that gives the rules for constructing symbolic expressions.

Correct. The rules for quantifiers are given in Loomis & Sternberg, Advanced Calculus, at the beginning of Chapter 1, online here at Sternberg's website:

http://www.math.harvard.edu/people/SternbergShlomo.html
 
Relativistic Momentum, Mass, and Energy Momentum and mass (...), the classic equations for conserving momentum and energy are not adequate for the analysis of high-speed collisions. (...) The momentum of a particle moving with velocity ##v## is given by $$p=\cfrac{mv}{\sqrt{1-(v^2/c^2)}}\qquad{R-10}$$ ENERGY In relativistic mechanics, as in classic mechanics, the net force on a particle is equal to the time rate of change of the momentum of the particle. Considering one-dimensional...

Similar threads

  • · Replies 11 ·
Replies
11
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 24 ·
Replies
24
Views
4K