fsubx is the partial derivative of f with respect to x. So take y as a constant in the f(x,y) expression before differentiating.
Similarly, fsuby is the partial derivative with respect to y. Now you will treat x as a constant.
Finally, fxx is the second partial derivative. Just follow the procedure above a second time, with y held constant again.
Hope that helps,