In a Markov process, is it possible to transition from one non-absorbing state to another non-absorbing state ?
but at the same time I think, if there is a non-zero transition rate... so I guess in a Markov process, it is definitely possible to transition from one NON-absorbing state to another NON-absorbing state , right ?
$\displaystyle \left[\begin{array}{cc}0.4&0.6\\0.5&0.5\end{array}\right]$
this is an example of a simple markov process where you can go from state 1 to state 2 and from state 2 to state 1. Both the states are non-absorbing. So..