The eigenvalues of are . Using the definition of eigenvector, you'll find that necessarily and . Now, using it is easy to prove that for some .
Consider a Markov chain { } with states and transition matrix
Let be a vector such that
where and
Let and satisfy
, where .
Let be such that . Show that can be written as
for some constant
I get:
, therefore
However I cannot see how to make