Proving Convexity of a Function with Directional Derivative

  • Thread starter Thread starter stanley.st
  • Start date Start date
stanley.st
Messages
30
Reaction score
0
I'm reading book and there's proposition with convex function

Function f is convex if and only if for all x,y
(*)\quad f(x)-f(y)\ge\nabla f(y)^T(x-y)

It's proven in this way: From definition of convexity

f(\lambda x+(1-\lambda)x)\le \lambda f(x)+(1-\lambda)f(y)

we have

\frac{f(y+\lambda(x-y))-f(y)}{\lambda}\le f(x)-f(y)

Setting \lambda\to0 we have (*).

-------------------------------------------------

My problem is in last sentece. I understand formula on left-hand side as directional derivative. But in definition of directional derivative is needed to (x-y) be an unit vector. It is not. So it is not a directional derivative. If I define

\lambda:=\frac{\mu}{\Vert x-y\Vert}

I have directional derivative on left hand side

\frac{f(y+\mu\frac{(x-y)}{\Vert x-y\Vert})-f(y)}{\mu}\le\frac{f(x)-f(y)}{\Vert x-y\Vert}

But in this way I don't obtain result (*) but I obtain this

\nabla f(y)^T(x-y)\le\frac{f(x)-f(y)}{\Vert x-y\Vert}
 
Physics news on Phys.org
Back
Top