Under what conditions on the constants a and b does the second derivative test guarantee that the function
g(x,y,z)=ax^2+2axz+by^2-2byz+z^2
has a local maximum at (0,0,0)? a local minimum at (0,0,0)?
well, i used the Hessian matrix to compute the eigenvalues to set them above zero. but...