Apparently, steady state vector is an eigenvector of the matrix with eigenvalue 1. I.e., if a matrix is , then . Therefore, , where is the identity matrix (with 1's on the diagonal and 0 everywhere else).

In your case,

So we get an equation , or . Besides, and are probabilities, so .

However, if you have not covered this topic, it is probably instructor's oversight. It's possible that he/she prepared the plan with homeworks in advance but has not had time to cover this in class. It's better to contact your instructor and ask what to do.

Another thing is, this is not really a problem for this subforum. Since this is about Markov chains, you should post it to something like probability theory section.