=2x^4-4x^2y^2+5y^4)
so
\vec{i}+ (-8x^2y+ 20y^3)\vec{j})
. At any max or min in the interior of the set we must have
= 8x(x- y)(x+ y)= 0)
so one of x= 0, x=y, x=-y must be true. Also
= 4y(\sqrt{5}y- \sqrt{2}x)(\sqrt{5}y+ \sqrt{2}x)= 0)
so one of y= 0,

, or

must be true.
If x= 0, only y= 0 satisfies the other equations. If y= x again we have only x= y= 0. I don't see how x= -1/2, y= -1/5 satisfy those equations. I find only x= y= 0.
On the boundary,
= x^4+ y^4= 80)
,

so we must have
\vec{i}+ (-8x^2y+ 20y^3)\vec{j}= \lambda(4x^3\vec{i}+ 4y^3\vec{j})
or
)
and
)
.
It's never necessary to find

since that is not relevant to the solution. Instead, eliminate

by
dividing one equation by the other:
(x+ y)}{(\sqrt{5}y- \sqrt{2}x)(\sqrt{5}y- \sqrt{2}x)}= \frac{x^2}{y^2})
.
That, together with

gives two equations to solve for x and y.