Hello, in relation to Markov chains, could you please clarify the following equations:

In particular, could you please expand on why the first line is equal. Surely from http://latex.codecogs.com/gif.latex?...5Comega%20%29], along with the first equation, this implies that:

I just don't see why they are all equal. Please could you provide some intuition on this. Thanks