Hello, in relation to Markov chains, could you please clarify the following equations:
In particular, could you please expand on why the first line is equal. Surely from , along with the first equation, this implies that:
I just don't see why they are all equal. Please could you provide some intuition on this. Thanks