Help with Gradient-related concepts

[Ryuzaki]

I'm trying to understand the concept of a Gradient vector, and it seems I'm having trouble visualizing certain stuff. So, I was hoping if someone could resolve some of the questions I'm having on my mind.

Okay, so I'm considering a real-valued function z = f(x,y) which is smooth, i.e., its partial derivatives with respect to x and y exist and are continuous. Let k be a real number in the range of f and let \mathbf v be a unit vector in ℝ², which is tangent to the level curve f(x,y) = k.

Now, I am told to understand that the rate of change of f in the direction of \mathbf v is 0, i.e., D_vf = 0. And the explanation for it, in almost all of the sources I've seen is, that it's because \mathbf v is a tangent vector to this curve.

1. Can anyone tell me how \mathbf v being simply a tangent vector implies this?

2. Is this concept simply extended to the case of a function in three variables, by level surfaces and tangent planes? In this case, wouldn't there be an infinite number of tangent vectors, and thus an infinite number of gradient vectors (since the gradient vector is perpendicular to the tangent vector, i.e., normal to the surface). Can anyone point out any sources that help in visualizing this?

Thank you!

 

[WannabeNewton]

We might as well do it for functions of $n$ variables since the argument is the exact same; note that the argument I'm giving here is not exactly rigorous but hopefully it is satisfying enough. Let $f:\mathbb{R}^{n}\rightarrow \mathbb{R}$ be a smooth scalar field and let $M = f^{-1}(c), c\in f(\mathbb{R}^{n})$ be a level set of $f$. Let $p\in M$ and $v$ be any vector tangent to $M$ at $p$, and choose a smooth curve $\gamma :(-\epsilon,\epsilon)\rightarrow M$ with $\gamma(0) = p, \dot{\gamma}(0) = v$. Note that $f(\gamma(t)) = c = \text{const.}$ identically, since the image of the curve lies in the level set, so $\frac{\mathrm{d} }{\mathrm{d} t}(f(\gamma(t)))|_{t=0} = \nabla f(\gamma(0))\cdot \dot{\gamma}(0) = \nabla f(p)\cdot v = 0$ where I have used the chain rule in the very first step. Since the chosen point and tangent vector were entirely arbitrary, $\nabla f$ will be perpendicular to all vectors tangent to $M$ at each point of $M$.

 

[Ryuzaki]

Thank you, WannabeNewton! I think I understand it now.

 

[WannabeNewton]

Thank you, WannabeNewton! I think I understand it now.

Let me know if you have more questions. Also, work it out specifically for the case where $f(x,y,z) = x^2 + y^2 + z^2$ i.e. when the level sets are spheres, $x^2 + y^2 + z^2 = k$. Take the gradient and hopefully you can picture the outward (outward from the origin) radial vector field that results and see how it is perpendicular to all the spheres centered at the origin with different radii given by different values of $k$.