The nature of critical points of a function

**tammyl** · October 1st 2012, 05:38 AM

Can anyone help with determining the nature of the critical points for the function:

f(x,y) = x^3 - x + y^2 - 2xy?

By using the first partial derivatives and setting them to zero, I determined the critical points to be f(1,1) and f(-1/3,-1/3).

To determine the nature of these critical points I calculated the second partial deratives and the discriminant to find that f(1,1) is a local minimum which appears to agree with the 3d plot for the function.

However my problem is at f(-1/3,-1/3), the determinant is less than 0 which implies a saddlepoint, but I believe that it should be a local maximum from looking a the plot.

Can anyone assist me is seeing the error of my ways? Any suggestions would be greatly appreciated.

**johnsomeone** · October 1st 2012, 07:33 AM

First I'll recap your work (since I have to do it anyway), then I'll explain the issue:

$\frac{\partial f}{\partial x} = 3x^2 -1 - 2y. \ \frac{\partial^2 f}{\partial x^2} = 6x. \ \frac{\partial^2 f}{\partial x \partial y} = -2.$

$\frac{\partial f}{\partial y} = 2y - 2x. \ \frac{\partial^2 f}{\partial y \partial x} = -2. \ \frac{\partial^2 f}{\partial y ^2} = 2.$

Stationary points are where $\frac{\partial f}{\partial x} = 0$ and $\frac{\partial f}{\partial y} = 0$ , so where $3x^2 -1 - 2y = 0$ and $2y - 2x = 0$ .

The 2nd equation gives $y = x$ , so $3x^2 - 2x - 1= 0$ , so

$x \( = y ) = \frac{-(-2) \pm \sqrt{(-2)^2 - 4(3)(-1)}}{2(3)} = \frac{2 \pm \sqrt{16}}{6} = \{1, -1/3\}$ .

The Hessian is

$H(f) = \left(\begin{matrix} \frac{\partial^2 f}{\partial x^2} & \frac{\partial^2 f}{\partial x \partial y} \\ \frac{\partial^2 f}{\partial y \partial x} & \frac{\partial^2 f}{\partial y ^2} \end{matrix}\right) = \left(\begin{matrix} 6x & -2 \\ -2 & 2 \end{matrix}\right)$ .

So $Det(H(f)) = 12x - 4$ , which is only 0 when x = 1/3. Thus both of those stationary points are non-degenerate.

Now the question, for each of the two stationary points (1, 1, -1) and (-1/3, -1/3, 5/27), is if H(f) positive definite (local min), negative definite(local max), or indefinite(saddle point)?

!!This is *not* entirely knowable by looking at the sign of the determinant of the Hessian. Ex: $\left(\begin{matrix} -1& 0 \\ 0 & -1 \end{matrix}\right)$ has determinant 1, but is negative definite!

Local max/min/saddle for f at a critical point are about the eigenvalues of the Hessian, not its deternimant. All positive means local min, all negative means local max, and mixed (some positive, some negative) means saddle point. None are zero, since "non-degenerate stationary point iff Hessian has non-zero determinant iff it has no zero eigenvalues."

In the special case of a 2x2 matrix, since there are only two eigenvalues (counting multiplicity), and neither of them is zero, and the determinant is their product, if the determinant is positive, then either they're both positive or both negative. If the determinant is negative, then one is positive and the other is negative.

Thus *only* in the special case of a 2x2 matrix, you can say this:

If f has a nondegenerate stationary point p, and Det(H(f)) < 0 at p, then p is a saddle point of f, and if Det(H(f)) > 0 at p, then p is either a local maximum or local minimum.

Remember, that's *only* in the special case of a 2x2 matrix. In higher dimensions, the first part (Det(H(f)) < 0 implies saddle point) generalizes to even dimensions, and the second part (Det(H(f)) > 0 implies it's either a local max or a local min) simply fails in general.

(Note: real symmetric matricies always have all real eigenvalues (counting mutliplicity)).

OK, so for this problem, need to examine the eignvalue for H(f) at (1, 1, -1) and (-1/3, -1/3, 5/27).

$H(f)|_{(-1/3, -1/3, 5/27)}= \left(\begin{matrix} 6(-1/3) & -2 \\ -2 & 2 \end{matrix}\right)= \left(\begin{matrix} -2 & -2 \\ -2 & 2 \end{matrix}\right)= -2\left(\begin{matrix} 1 & 1 \\ 1 & -1\end{matrix}\right)$ .

Get characteristic polynomial first, then eigenvalues:

$det\left( \ \left(\begin{matrix} 1 & 1 \\ 1 & -1\end{matrix}\right) - \lambda \left(\begin{matrix} 1 & 0 \\ 0 & 1\end{matrix}\right) \ \right) = det\left( \ \left(\begin{matrix} 1-\lambda & 1 \\ 1 & -1-\lambda \end{matrix}\right) \ \right)$

$= (1-\lambda)(-1-\lambda) - (1)(1) = -(1-\lambda)(1+\lambda) - 1 = -(1-\lambda^2) -1 = \lambda^2-2$ .

Thus the eigenvalues of H(f) at (-1/3, -1/3, 5/27) are $\pm \sqrt{2}$ .

Therefore f has a saddle point at (-1/3, -1/3, 5/27).

Now for (1, 1, -1): $H(f)|_{(1, 1, -1)}= \left(\begin{matrix} 6(1) & -2 \\ -2 & 2 \end{matrix}\right)= 2 \left(\begin{matrix} 3 & -1 \\ -1 & 1 \end{matrix}\right)$ . You get:

$det\left( \ \left(\begin{matrix} 3 & -1 \\ -1 & 1\end{matrix}\right) - \lambda \left(\begin{matrix} 1 & 0 \\ 0 & 1\end{matrix}\right) \ \right) = det\left( \ \left(\begin{matrix} 3-\lambda & -1 \\ -1 & 1-\lambda \end{matrix}\right) \ \right)$

$= (3-\lambda)(1-\lambda) - (-1)(-1) = (\lambda^2 - 4 \lambda + 3) - (1) = \lambda^2 - 4 \lambda + 2$

$= \lambda^2 - 4 \lambda + 4 - 2 = (\lambda - 2)^2 - 2$ .

Thus the eigenvalues of H(f) at (1, 1, -1) are $2 \pm \sqrt{2}$ , which are both positive, making H(f) positive definite there.

Therefore f has a local minimum at (1, 1, -1).

**tammyl** · October 1st 2012, 12:56 PM

Thank you very much johnsomeone!!

That has made it clearer. I appreciate the time taken to set up this answer.

**hollywood** · October 2nd 2012, 01:00 AM

Nicely done, johnsomeone.

- Hollywood

Thread: The nature of critical points of a function

LinkBack

Thread Tools

Display

The nature of critical points of a function

Re: The nature of critical points of a function

Re: The nature of critical points of a function

Re: The nature of critical points of a function

Similar Math Help Forum Discussions

Critical points of function #2

critical points of a function

Critical points of a function

Critical Points- Does this function not have any?

Critical points of a function

Search Tags