Descent directions on manifolds

[Kreizhn]

Hey,

I'm trying to do some optimization on a manifold. In particular, the manifold is $\mathfrak U(N)$, the NxN unitary matrices.

Now currently, I'm looking at "descent directions" on the manifold. That is, let $f: \mathfrak U(N) \to \mathbb R$ be a function that we want to minimize, $p \in \mathfrak U(N)$ a point and $X \in T_p \mathfrak U(n)$ a point in the tangent manifold at p. If $\gamma: \mathbb R\to \mathfrak U(N)$ is a curve with $\gamma(0) = p, \dot \gamma (0) = X$ then the geodesic emanating from p in the direction X is $\gamma_X(t) = \exp_p[tX]$. This geodesic is a descent direction if
$$\dot \gamma_X(0)f = \left.\frac d{dt} f(\gamma_X(t))\right|_{t=0} < 0$$

My question is: does the magnitude of $\dot\gamma(0)f$ mean anything? For example, say that for a fixed p and two different $X_1,X_2 \in T_p\mathfrak U(N)$ I get that
$$\dot \gamma_{X_1}(0) f = -85, \qquad \dot \gamma_{X_2}(0)f = -4$$
These are both descent directions, but is one a "better" descent direction than the other? That is, does $X_1$ result in a decrease in f faster than $X_2$? Or are the numbers fairly meaningless?

The above numbers are not far from actual values taken. The problem is that the direction of steepest descent (the negative of the Riemannian gradient) gives a value of -7. This would lead me to believe that the numbers are fairly useless, and only the sign is important. Any insight would be useful.

 

[arkajad]

You are searching for "directions". To compare the effectiveness of choosing one direction rather than other you should first normalize your vectors $$X_1,X_2$$.

 

[BruceG]

Also you're only going to get a local decent rate - decent rate will change as you move away from p.