Hi, I don't really understand Markov, so what i did with this question was just follow an example from my lecture notes.. Anyways the question is:

Show the following MC is irreducible:

$\displaystyle

\begin{bmatrix}1/2 & 0 & 0 & \cdots & \cdots & 0 \\ 1/2 & 0 & 1 & \cdots & \cdots & 0 \\ 0 &

1/2 & 1/2 \cdots & \cdots \\ \vdots & \vdots & \vdots & \vdots & \vdots & \vdots \\ 0 & \cdots

& \cdots & 1/2 & 0 & 1 \\ 0 & \cdots & \cdots & \cdots & 0 & 1/2 \end{bmatrix}

$

so this is my guess: