I'm stuck on this problem...
how can you determine whether or not a stationary distribution exists for an infinite markov chain.
the markov chain I have is irreducible and aperiodic, which I'm sure is enough to say that an s.d. exists for a finite chain.
but I'm unsure if these conditions are sufficient for an infinite chain.
can anyone help?