Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Inner Products?

  1. Feb 26, 2014 #1
    Hi all, I am having trouble understanding inner products. Specifically, using inner products to find the angle between two vectors. Our lecturer has given an example, as follows;

    (u,v)= 4u1v1 + u1v2 + u2v1 + u2v2, where u=(1,0) v=(0,1)




    Surely the angle between the two vectors is ∏/2? I can't understand why it is ∏/3.
  2. jcsd
  3. Feb 26, 2014 #2


    User Avatar
    Homework Helper

    An abstract vector space only has notions of "parallel" and "not parallel"; it doesn't have a notion of "angle between" or "magnitude" unless you put an inner product on that space.

    If [itex]\langle \cdot, \cdot \rangle[/itex] is an inner product, then [itex]\|v\| = \sqrt{\langle v, v \rangle}[/itex] defines the magnitude of a vector, and
    \cos \theta = \frac{\langle u,v \rangle}{\|u\|\|v\|}
    defines the angle [itex]\theta \in [0, \frac12 \pi][/itex] between [itex]u[/itex] and [itex]v[/itex]. Different inner products on the same space may give different magnitudes for, and different angles between, the same vectors.

    The Euclidean inner product on [itex]\mathbb{R}^2[/itex] is the dot product, [itex](x_1,y_1) \cdot (x_2, y_2) = x_1 x_2 + y_1 y_2[/itex], with [itex]\|(x,y)\| = \sqrt{x^2 + y^2}[/itex], consistent with Pythagoras. With respect to that inner product [itex](1,0)[/itex] and [itex](0,1)[/itex] are indeed orthogonal and of unit length.

    However, your inner product is not the Euclidean inner product, but is instead
    \langle u,v \rangle = 4u_1v_1 + u_1v_2 + u_2v_1 + u_2v_2
    so [itex]\|u\| = \sqrt{4u_1^2 + 2u_1u_2 + u_2^2}[/itex]. Thus in your example,
    [tex]\langle (1,0), (0,1) \rangle = 1[/tex] and
    [tex]\|(1,0)\| = 2[/tex] and
    [tex]\|(0,1)\| = 1[/tex] so
    \frac{\langle (1,0), (0,1) \rangle}{\|(1,0)\|\|(0,1)\|} = \frac{1}{2}
    so [itex]\theta = \pi/3[/itex].
  4. Feb 27, 2014 #3


    User Avatar
    Staff Emeritus
    Science Advisor
    Gold Member

    Every inner product satisfies the Cauchy-Schwartz inequality ##\left|\langle u,v\rangle\right|\leq \|u\|\|v\|##, where the norm notation on the right is defined by ##\|x\|=\sqrt{\langle x,x\rangle}##. This means that when we're dealing with an inner product space over ##\mathbb R## (rather than ##\mathbb C##), we have
    $$-1\leq\frac{\langle u,v\rangle}{\|u\|\|v\|}\leq 1,$$ for all u,v. This enables us to define the angle θ between u and v as in pasmith's post, i.e. by
    $$\cos\theta =\frac{\langle u,v\rangle}{\|u\|\|v\|}.$$ This is how the idea of angles between vectors are generalized from ##\mathbb R^2## with the standard inner product, to arbitrary inner product spaces over ##\mathbb R##.
  5. Feb 27, 2014 #4
    Ok, so what is meant by the angle 'with respect to the inner product'? Is it one of those things you must just accept is true, as I am having trouble visualising what is going on. Thanks for your responses.
  6. Feb 27, 2014 #5


    User Avatar
    Science Advisor
    Homework Helper

    Hi Cameron95! Welcome to PF! :smile:
    The line y = 0 is orthogonal to the line x = -4y, as you can see by checking that the inner product of (a,0) and (b, -4b) is always zero.

    So you could say that the angle between them is 90°

    On that view, you have to adjust all the other angles to get them to fit!

    (personally, i don't find the concept of the angle helpful :redface:)
  7. Feb 27, 2014 #6


    User Avatar
    Science Advisor
    Homework Helper
    Gold Member

    You seemed to accept that the "length" of these vectors with the new inner product was not the regular length, so why the problem over angle?

    It's not accepting it as "true", it's accepting it as "defined that way". If you have a different inner product, then you can still define "length" and "angle" in terms of this inner product, but these are not the same as the regular length and angle.

    As you go further in maths, you will find many generalisations such as this. For example, you can define an inner product on sets of functions and treat these like vectors. This leads to the concept of "length" of functions and "distance" and "angle" between" functions.
  8. Feb 27, 2014 #7
    Thank you all for your help; I think it's slightly clearer now!
  9. Feb 28, 2014 #8


    User Avatar
    Staff Emeritus
    Science Advisor
    Gold Member

    That is exactly the question that my post answered.

    It's just a definition, so there's nothing that you need to "accept as true", except that this is what the word "angle" means to a mathematician.

    I'll try again. Forget about vector spaces for a second, and think about what you know about geometry in a plane (triangles and stuff). The law of cosines implies that the angle θ between two vectors x and y in ##\mathbb R^2## satisfies the equality ##x\cdot y=|x||y|\cos\theta##. This is a theorem, not a definition.

    Now let's think about vector spaces. What if the elements of the vector space are e.g. matrices or functions? What is the angle between
    ##\begin{pmatrix}1 & 0\\ 0 & 1\end{pmatrix}## and ##\begin{pmatrix}1 & 0\\ 0 & -1\end{pmatrix}##? What is the angle between two polynomials? Such questions don't make sense as long as there's no definition of "angle" that can be used to answer these questions. So the question is, is there something, anything, that can be calculated from two arbitrary vectors x and y that somehow "deserves" to be called "the angle between x and y"?

    The answer starts with the following observations:

    * For all ##x,y\in\mathbb R^2##, we have ##x\cdot y=|x||y|\cos\theta##, where ##\theta## is the angle between x and y.
    * The dot product on ##\mathbb R^2## is an inner product.
    * The absolute value on ##\mathbb R^2## is a norm, and for all ##x\in\mathbb R^2##, we have ##|x|=\sqrt{x\cdot x}##.
    * Let V be an arbitrary inner product space over ##\mathbb R##. The Cauchy-Schwarz inequality implies that for all ##x,y\in V##, we have $$-1\leq \frac{\langle x,y\rangle}{\|x\|\|y\|} \leq 1,$$ where ##\|x\|## is defined as ##\sqrt{\langle x,x\rangle}##. This means that there's a unique real number θ such that
    $$\cos\theta=\frac{\langle x,y\rangle}{\|x\|\|y\|}.$$ The first observation tells us that when the inner product space is ##\mathbb R^2## with the standard inner product, this number is the angle between the vectors. So if we're dealing with some inner product space where there is no concept of angle yet, why not just call this number "the angle between x and y"?

    The only claim that you have to "accept as true" is that mathematicians have chosen to do this.
    Last edited: Feb 28, 2014
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook