You don't want to solve . You want to start by solving (such solutions will, of course, also satisfy ). From the Jordan Normal form, it looks like you should be able to find two independent solutions, call them and . Those correspond to the two " "s on the diagonal with "0" above them. Then look for "generalized eigenvectors" that satisfy and (those will also satisfy ).