Pointwise-product (meaning?)

[mnb96]

Given two real vectors in $$(u_1,\ldots,u_n)$$ and $$(v_1,\ldots,v_n)$$, does the pointwise-product (elementwise-product) $$(u_1v_1,\ldots,u_nv_n)$$ have a geometrical meaning? or can it at least be expressed as a combination of other known products (e.g. outer-product, contraction, and so on...)?

 

[yyat]

The problem is that this product depends on the choice of orthonormal basis, so it does not have a well defined geometric meaning. To illustrate:

The vectors (1,0) and (0,1) have pointwise product (0,0), but rotate them 45° and you get $$(1/\sqrt{2},1/\sqrt{2})$$ and $$(-1/\sqrt{2},1/\sqrt{2})$$ which have pointwise product (-1/2,1/2) and this is not the vector (0,0) rotated 45°.

The scalar product and cross product on the other hand are preserved under rotations.

 

[John Creighto]

Given two real vectors in $$(u_1,\ldots,u_n)$$ and $$(v_1,\ldots,v_n)$$, does the pointwise-product (elementwise-product) $$(u_1v_1,\ldots,u_nv_n)$$ have a geometrical meaning? or can it at least be expressed as a combination of other known products (e.g. outer-product, contraction, and so on...)?

I'll make one up :). You could consider it as a scaling of the axis. Of course that would be equivalent to taking one vector and forming a matrix with it's elements on the diagonal and then right multiplying the other element by this matrix.

To make this invariant under rotation, remember that If

A is our transformation which is equivalent to the element wise product.

and U is a rotation.

Then if:
X'=UX
A'=U A(U^-1)

Then

AX is equivalent to A'X'

 

[mnb96]

what about this...?

I found a simple way to make the pointwise-product equivalent to a sum of 2-blades (a concept from geometric algebra), but unfortunately it only works when n=2 :(
Let's pretend that the two vectors $$\textbf{a}=(a_1,a_2)$$ and $$\textbf{b}=(b_1,b_2)$$ are actually:

$$\textbf{a}=a_{1} \textbf{e}_1 +a_{2}\textbf{e}_{2}$$

$$\textbf{b}=b_{1} \textbf{e}_3 +b_{2}\textbf{e}_{4}$$

Let's define these two other auxiliary vectors:

$$\widehat{\textbf{a}}=a_{1} \textbf{e}_1 - a_{2}\textbf{e}_{2}$$

$$\widehat{\textbf{b}}=b_{1} \textbf{e}_3 - b_{2}\textbf{e}_{4}$$

(it actually looks like complex conjugation). Now if we take the following sum of outer-products (wedge-product) we get what we wanted:

$$\frac{1}{2}(\textbf{a} \wedge \textbf{b} + \widehat{\textbf{a}} \wedge \widehat{\textbf{b}}) = a_1b_1(\textbf{e1}\wedge \textbf{e3}) + a_2b_2(\textbf{e2}\wedge \textbf{e4})$$

So we got that in two dimensions, the pointwise-product can be expressed as a sum of two certain 2-blades, which IS indeed a 2-blade representing a plane in 4 dimensions.

The big question is: can this process be generalized to n-dimensions?

 

[matt grime]

In order for that to be a genuine geometric notion, you need to show that it is invariant under change of basis, for example. Then there is the issue of what it means. Your original idea was as a map

$$V\times V \to V$$

now you have a map

$$V\times V ---> \wedge^2 (V)$$

which in general is not isomorphic to V.

What you describe originally, is a perfectly well defined algebraic construction: it is the direct product of your underlying field F (be it R, C, Q etc) with itself n times (n the dimension of the vector space) viewed as a ring.

 

[mnb96]

First of all, thanks to all the persons who showed interest in this post.

for matt grime:
I guess (at least, I hope) I understand your remarks. Thanks for pointing out that what I did was a direct product.

Unfortunately I don't fully get why the fact of having a map $$V\times V \rightarrow \wedge^2 (V)$$ should prevent the product from having a geometric meaning.

Moreover, could you be more specific when you say that one must check if the product is invariant under a change of basis? (Note: the vectors $$\textbf{e}_i$$ can be anything as long as they are not parallel).

And finally, I'm not yet able to figure out whether it's possible or not to extend that operation to n-dimensions.

Thanks in advance!

 

[matt grime]

I didn't say it didn't have a geometric meaning (you might want to look up algebraic geometry).

I said that the second map you wrote down is fundamentally different from the first one as the image spaces is the second exterior power, not the original vector space, as you wrote originally. "Wedge two" of a two dimensional space is one dimensional, so I don't know why you think you have a plane in 4 dimensions. (I don't know what blades are, so it is entirely possible I'm misunderstanding you.)

 

[mnb96]

you are absolutely right when you say that the image space formed by that operation is not anymore the original vector space but something else; it was essentially a dirty trick to make things work as I wanted. However, I myself have still doubts on the correctness of that.
In fact, in order to make it work I had to make use of two extra dimensions:

$$\textbf{a}=a_{1} \textbf{e}_1 +a_{2}\textbf{e}_{2}=(a_1, a_2, 0, 0)$$

$$\textbf{b}=b_{1} \textbf{e}_3 +b_{2}\textbf{e}_{4}=(0, 0, b_1, b_2)$$

Taking a wedge product would yield a 2-blade in a 4-dimensional space $$\wedge^2 (R^4)$$: that's why I was talking of a plane in a 4D space as a geometric interpretation. I agree that the space $$\wedge^2 (R^4)$$ has dimensionality 6.

The term k-blade was introduced by Hestenes, a pioneer of geometric-algebra. You can create a k-blade by "wedging" k non parallel n-vectors, and it is possible to show that such a product can be interpreted geometrically as a subspace of dimensionality k with magnitude and orientation.

--

I hope I clarified the misunderstandings and corrected the imprecise statements.
Perhaps it is also good to formulate better my original question:

given an "array" of real numbers, if we assume that it was created by pointwise multiplication of two other (unknown) "arrays", can we give a geometrical interpretation to such objects?
In fact, I have a space whose elements are all created by pointwise multiplication of element-pairs of another space. What I wish to find is a correct metric to compute a "distance" between such elements.

 

[matt grime]

Taking a wedge product would yield a 2-blade in a 4-dimensional space $$\wedge^2 (R^4)$$: that's why I was talking of a plane in a 4D space as a geometric interpretation. I agree that the space $$\wedge^2 (R^4)$$ has dimensionality 6.

Umm, you say correctly that $wedge^2(R^4)$ is 6 dimensional, but also talk of something living in R^4. You're confusing me.

 

[mnb96]

Ok...I admit I was wrong. I am sorry for confusing you. The truth is that I'm new to geometric algebra and my weak knowledge often leads me to such pesky mistakes. Let's forget about the four dimensions.

I think the correct statement is that a 2-blade in $$\wedge^2 (R^4)$$ has a geometrical interpretation of a subspace of dimensionality 2, living in a 6D space.

Similarly a 2-blade in $$\wedge^2 (R^3)$$ would represent an oriented plane (with some magnitude) in 3D

Hopefully I am not wrong this time

 

[matt grime]

I think I've got the basics of blades now.

They are bases for something (what I might want to call Grassman space, perhaps).

But when you say that u/\v is a 2 blade and spans a 2-dimensional subspace it is a 2-d subspace of what we've been calling V, the vector space you first thought of.

Geometric algebra makes the set of k-dimensional subspaces of an n-dimensional space into an n choose k dimensional subspace (the wedge-k space). So, in fact

a 2-blade in $\wedge^2 (R^4)$ has a geometrical interpretation of a subspace of dimensionality 2

inside R^4: the blade u/\v represents the subspace spanned by u and v.

 

[mnb96]

This is ironic, but now it's me the one who is confused :)
I just thought that when you wedge two vectors $$u,v \in R^4$$ you get an entity $$(u\wedge v) \in \wedge^2(R^4)$$ which lives in a space having $$\left( \begin{array}{c} 4 & 2 \\ \end{array} \right)$$ dimensions (6).

I guess I am missing a small hint to figure out why it's actually a subspace of a 4D space.

Btw, coming back to the original question do you think the approach I was following could lead anywhere?

 

[matt grime]

This is ironic, but now it's me the one who is confused :)
I just thought that when you wedge two vectors $$u,v \in R^4$$ you get an entity $$(u\wedge v) \in \wedge^2(R^4)$$ which lives in a space having $$\left( \begin{array}{c} 4 & 2 \\ \end{array} \right)$$ dimensions (6).

Yes, that is true, but that 6-dimensional space parametrizes the (algebra of) two dimensional subspaces of R^4. The wedge of two (non-parallel) vectors is a (non-zero) vector in the exterior product, but it corresponds to a plane in R^4 - the plane spanned by the two vectors you wedged together.

Btw, coming back to the original question do you think the approach I was following could lead anywhere?

No, for the reason given in the very first reply by yatt: the product you describe depends on a choice of basis. I.e. it is not well defined: if you compose two elements and assign a meaning to it, and then I do the same we will get different answers depending on how we chose to represent the vectors.

 

[yyat]

I found a simple way to make the pointwise-product equivalent to a sum of 2-blades (a concept from geometric algebra), but unfortunately it only works when n=2 :(
Let's pretend that the two vectors $$\textbf{a}=(a_1,a_2)$$ and $$\textbf{b}=(b_1,b_2)$$ are actually:

$$\textbf{a}=a_{1} \textbf{e}_1 +a_{2}\textbf{e}_{2}$$

$$\textbf{b}=b_{1} \textbf{e}_3 +b_{2}\textbf{e}_{4}$$

Let's define these two other auxiliary vectors:

$$\widehat{\textbf{a}}=a_{1} \textbf{e}_1 - a_{2}\textbf{e}_{2}$$

$$\widehat{\textbf{b}}=b_{1} \textbf{e}_3 - b_{2}\textbf{e}_{4}$$

(it actually looks like complex conjugation). Now if we take the following sum of outer-products (wedge-product) we get what we wanted:

$$\frac{1}{2}(\textbf{a} \wedge \textbf{b} + \widehat{\textbf{a}} \wedge \widehat{\textbf{b}}) = a_1b_1(\textbf{e1}\wedge \textbf{e3}) + a_2b_2(\textbf{e2}\wedge \textbf{e4})$$

So we got that in two dimensions, the pointwise-product can be expressed as a sum of two certain 2-blades, which IS indeed a 2-blade representing a plane in 4 dimensions.

The big question is: can this process be generalized to n-dimensions?

This is still not invariant under change of basis, which a slight variant of the argument I used before shows.

Edit: as matt grime just remarked...

 

[mnb96]

Ok, so you say that it is not possible to assign a general geometric meaning to the pointwise product because it depends on the choice of the basis in which we express the two vectors.

Well, let's put a restriction then: what if we agree that the vectors are expressed in the canonical basis? Is there any possibility to assign a meaning to this product at least for a chosen basis?

 

[matt grime]

Well, let's put a restriction then: what if we agree that the vectors are expressed in the canonical basis? Is there any possibility to assign a meaning to this product at least for a chosen basis?

Trivially, yes. You're using the identification of V with the diagonal matrices in End(V) - which depends on a choice of basis - and then multiplying by a matrix which is a geometric operation.

But, at the risk of being Rusmfeldian, is it a meaningful meaning? Find an application for it, and then you'll have an answer. I don't see one, really - the basis dependence is a complete killer.

There is a meaning for the point-wise product of matrices, but I can't remember what it is. Something in functional analysis maybe.

 

[mnb96]

ok, thanks a lot for your help. It has been very useful and appreciated.
Essentially my problem is that I have a a vector space of (discrete finite) functions, which are basically vectors in $$R^n$$.

All these vectors (function) undergo an operation which contains a pointwise-product.
The operation consists in taking a vector u, finding its own corresponding $$\hat{u}$$ and then taking the pointwise product $$u \bullet \hat{u}$$.

(The operation ^ is essentially a mirroring of the function around the y-axis).

My question was: how do I compare the distance of the element which I created in such a way? That's why I was trying to find a meaning for the pointwise product

 

[mnb96]

I have to resume this thread since a possible solution occurred to me yesterday.
Let's define the following very simple admissible coordinate-transformation pair:

$$\mathcal{T}: \bar{x_i} = ln(x_i)$$

$$\mathcal{T}^{-1}: x_i = e^{\bar{x_i}}$$

If we consider two vectors $$\mathbf{a} = (a_1,\ldots,a_n)$$ and $$\mathbf{b} = (b_1,\ldots,b_n)$$ we have that:

$$(a_{1}b_{1},\ldots,a_{n}b_{n}) =: \mathbf{a} \bullet \mathbf{b} = \mathcal{T}^{-1}(\mathcal{T}\mathbf{a} + \mathcal{T}\mathbf{b})$$

In this sense, pointwise product between two vectors whose components are in $$\mathcal{R}^{+}$$, is equivalent to performing vector-addition onto their transformed counterparts, and then transforming back the result.

Does this sound correct?
Could it be generalized in order to handle also vectors with zero or negative components (by using complex numbers)?

 

[matt grime]

I can't see any way in which that is 'admissible' given that you can't apply T to the origin. Also, since T isn't remotely linear, then just because you've done something that makes use of component wise addition in some array doesn't imply anything useful about the original vector space.

So, you've just made a quite natural construction (the product of rings) into a very unnatural one only defined on a subset of the original space (and, no it can never be extended to any vector with any component zero since 0 is an essential singularity of log).

 

[mnb96]

Ok, I admit I misused the term 'admissible'.
However let's try to make things clearer:

1) Let's restrict our discussion to only vectors with positive (nonzero) components.
2) Let's put the same restriction to the functions which define the transformation $$\mathcal{T}$$. In other words we consider only those transformation-functions in the domain $$(0,+\infty)$$
3) With this restriction the Jacobian of $$\mathcal{T}$$ is never 0 in the domain $$(0,+\infty)$$. Moreover, the functions are smooth, so they do have an inverse, which are trivially given by the transformation $$\mathcal{T}^{-1}$$. We have a one-to-one mapping.
4) Performing pointwise multiplication between vectors with positive components, must be indeed equivalent to performing vector-addition between their mapped counterparts.

Was I wrong in any of those step?I agree with you that the transformations are not linear, that the result is trivial, natural and maybe of little interest, but I still think it is correct.
And this would answer (partly) my question, by which I essentially wanted to know if there was ANY kind of geometry behind the pointwise-multiplication. Well, apparently there is, but only under certain restrictions.

I fully understand that things that do not generalize, and are just particular cases do not appeal the mathematician who is primarily interested in exploring abstract concepts.
However I can say that vectors with strictly positive values are still very useful in practice. One example that comes to my mind are images: which are represented commonly by array of positive values.

Thanks again for your interest in this thread. Your posts are always extremely helpful!

 

[matt grime]

And this would answer (partly) my question, by which I essentially wanted to know if there was ANY kind of geometry behind the pointwise-multiplication. Well, apparently there is, but only under certain restrictions.

But what is geometric about what you did? You've used the well known isomorphism between groups R^+ under multiplication and R under addition, and extended it to the n-fold product of these groups.

 

[mnb96]

It's good that you made that question.
I was just thinking that if we have a pair of invertible transformations (in this case under a certain domain!), these can define a system of curvilinear coordinates.

For example when you are in two dimension, if you restrict your domain to the (strictly) positive quadrant (x>0, y>0) and apply the transformation $$\mathcal{T}$$ to any vector, what you would get is another vector which lies in the "distorted" space.

The distorted 2D space in this case would be what is usually called Log-Log Chart and it would look like this: http://upload.wikimedia.org/wikipedia/commons/c/cd/600px-LogLogScale.png

It is possible that I am wrong. But if I am correct, then pointwise multiplication of two vectors in the positive (hyper)quadrant, is equivalent to (pointwise) vector-addition in the Log-Log-Log-Log-...-Log (hyper)Chart :)

Does this make sense to you?