Inner Products?

  • Thread starter Cameron95
  • Start date
  • #1
8
0

Main Question or Discussion Point

Hi all, I am having trouble understanding inner products. Specifically, using inner products to find the angle between two vectors. Our lecturer has given an example, as follows;

(u,v)= 4u1v1 + u1v2 + u2v1 + u2v2, where u=(1,0) v=(0,1)

(u,v)=|u|.|v|cosθ

1=(√4)cosθ

θ=∏/3

Surely the angle between the two vectors is ∏/2? I can't understand why it is ∏/3.
 

Answers and Replies

  • #2
pasmith
Homework Helper
1,748
420
Hi all, I am having trouble understanding inner products. Specifically, using inner products to find the angle between two vectors. Our lecturer has given an example, as follows;

(u,v)= 4u1v1 + u1v2 + u2v1 + u2v2, where u=(1,0) v=(0,1)

(u,v)=|u|.|v|cosθ

1=(√4)cosθ

θ=∏/3

Surely the angle between the two vectors is ∏/2? I can't understand why it is ∏/3.
An abstract vector space only has notions of "parallel" and "not parallel"; it doesn't have a notion of "angle between" or "magnitude" unless you put an inner product on that space.

If [itex]\langle \cdot, \cdot \rangle[/itex] is an inner product, then [itex]\|v\| = \sqrt{\langle v, v \rangle}[/itex] defines the magnitude of a vector, and
[tex]
\cos \theta = \frac{\langle u,v \rangle}{\|u\|\|v\|}
[/tex]
defines the angle [itex]\theta \in [0, \frac12 \pi][/itex] between [itex]u[/itex] and [itex]v[/itex]. Different inner products on the same space may give different magnitudes for, and different angles between, the same vectors.

The Euclidean inner product on [itex]\mathbb{R}^2[/itex] is the dot product, [itex](x_1,y_1) \cdot (x_2, y_2) = x_1 x_2 + y_1 y_2[/itex], with [itex]\|(x,y)\| = \sqrt{x^2 + y^2}[/itex], consistent with Pythagoras. With respect to that inner product [itex](1,0)[/itex] and [itex](0,1)[/itex] are indeed orthogonal and of unit length.

However, your inner product is not the Euclidean inner product, but is instead
[tex]
\langle u,v \rangle = 4u_1v_1 + u_1v_2 + u_2v_1 + u_2v_2
[/tex]
so [itex]\|u\| = \sqrt{4u_1^2 + 2u_1u_2 + u_2^2}[/itex]. Thus in your example,
[tex]\langle (1,0), (0,1) \rangle = 1[/tex] and
[tex]\|(1,0)\| = 2[/tex] and
[tex]\|(0,1)\| = 1[/tex] so
[tex]
\frac{\langle (1,0), (0,1) \rangle}{\|(1,0)\|\|(0,1)\|} = \frac{1}{2}
[/tex]
so [itex]\theta = \pi/3[/itex].
 
  • #3
Fredrik
Staff Emeritus
Science Advisor
Gold Member
10,851
407
Every inner product satisfies the Cauchy-Schwartz inequality ##\left|\langle u,v\rangle\right|\leq \|u\|\|v\|##, where the norm notation on the right is defined by ##\|x\|=\sqrt{\langle x,x\rangle}##. This means that when we're dealing with an inner product space over ##\mathbb R## (rather than ##\mathbb C##), we have
$$-1\leq\frac{\langle u,v\rangle}{\|u\|\|v\|}\leq 1,$$ for all u,v. This enables us to define the angle θ between u and v as in pasmith's post, i.e. by
$$\cos\theta =\frac{\langle u,v\rangle}{\|u\|\|v\|}.$$ This is how the idea of angles between vectors are generalized from ##\mathbb R^2## with the standard inner product, to arbitrary inner product spaces over ##\mathbb R##.
 
  • #4
8
0
Ok, so what is meant by the angle 'with respect to the inner product'? Is it one of those things you must just accept is true, as I am having trouble visualising what is going on. Thanks for your responses.
 
  • #5
tiny-tim
Science Advisor
Homework Helper
25,832
251
Hi Cameron95! Welcome to PF! :smile:
Ok, so what is meant by the angle 'with respect to the inner product'? … I am having trouble visualising what is going on.
The line y = 0 is orthogonal to the line x = -4y, as you can see by checking that the inner product of (a,0) and (b, -4b) is always zero.

So you could say that the angle between them is 90°

On that view, you have to adjust all the other angles to get them to fit!

(personally, i don't find the concept of the angle helpful :redface:)
 
  • #6
PeroK
Science Advisor
Homework Helper
Insights Author
Gold Member
13,407
5,929
Ok, so what is meant by the angle 'with respect to the inner product'? Is it one of those things you must just accept is true, as I am having trouble visualising what is going on. Thanks for your responses.
You seemed to accept that the "length" of these vectors with the new inner product was not the regular length, so why the problem over angle?

It's not accepting it as "true", it's accepting it as "defined that way". If you have a different inner product, then you can still define "length" and "angle" in terms of this inner product, but these are not the same as the regular length and angle.

As you go further in maths, you will find many generalisations such as this. For example, you can define an inner product on sets of functions and treat these like vectors. This leads to the concept of "length" of functions and "distance" and "angle" between" functions.
 
  • #7
8
0
Thank you all for your help; I think it's slightly clearer now!
 
  • #8
Fredrik
Staff Emeritus
Science Advisor
Gold Member
10,851
407
Ok, so what is meant by the angle 'with respect to the inner product'?
That is exactly the question that my post answered.

Is it one of those things you must just accept is true, as I am having trouble visualising what is going on. Thanks for your responses.
It's just a definition, so there's nothing that you need to "accept as true", except that this is what the word "angle" means to a mathematician.

I'll try again. Forget about vector spaces for a second, and think about what you know about geometry in a plane (triangles and stuff). The law of cosines implies that the angle θ between two vectors x and y in ##\mathbb R^2## satisfies the equality ##x\cdot y=|x||y|\cos\theta##. This is a theorem, not a definition.

Now let's think about vector spaces. What if the elements of the vector space are e.g. matrices or functions? What is the angle between
##\begin{pmatrix}1 & 0\\ 0 & 1\end{pmatrix}## and ##\begin{pmatrix}1 & 0\\ 0 & -1\end{pmatrix}##? What is the angle between two polynomials? Such questions don't make sense as long as there's no definition of "angle" that can be used to answer these questions. So the question is, is there something, anything, that can be calculated from two arbitrary vectors x and y that somehow "deserves" to be called "the angle between x and y"?

The answer starts with the following observations:

* For all ##x,y\in\mathbb R^2##, we have ##x\cdot y=|x||y|\cos\theta##, where ##\theta## is the angle between x and y.
* The dot product on ##\mathbb R^2## is an inner product.
* The absolute value on ##\mathbb R^2## is a norm, and for all ##x\in\mathbb R^2##, we have ##|x|=\sqrt{x\cdot x}##.
* Let V be an arbitrary inner product space over ##\mathbb R##. The Cauchy-Schwarz inequality implies that for all ##x,y\in V##, we have $$-1\leq \frac{\langle x,y\rangle}{\|x\|\|y\|} \leq 1,$$ where ##\|x\|## is defined as ##\sqrt{\langle x,x\rangle}##. This means that there's a unique real number θ such that
$$\cos\theta=\frac{\langle x,y\rangle}{\|x\|\|y\|}.$$ The first observation tells us that when the inner product space is ##\mathbb R^2## with the standard inner product, this number is the angle between the vectors. So if we're dealing with some inner product space where there is no concept of angle yet, why not just call this number "the angle between x and y"?

The only claim that you have to "accept as true" is that mathematicians have chosen to do this.
 
Last edited:

Related Threads on Inner Products?

  • Last Post
Replies
2
Views
1K
  • Last Post
Replies
10
Views
3K
  • Last Post
Replies
5
Views
2K
  • Last Post
Replies
3
Views
2K
  • Last Post
Replies
4
Views
714
  • Last Post
Replies
1
Views
3K
  • Last Post
Replies
4
Views
2K
  • Last Post
Replies
2
Views
8K
  • Last Post
Replies
2
Views
5K
  • Last Post
Replies
2
Views
1K
Top