Consider a Markov chain { } with states and transition matrix

Let be a vector such that

where and

Let and satisfy

, where .

Let be such that . Show that can be written as

for some constant

I get:

, therefore

However I cannot see how to make