Thread: Markov Chain: Transient and aperiodic states question

Hi,

I have some questions about the periodicity of the states in a Markov Chain,

1. Can a state be aperiodic and transient? If so, is there an easy example to see this.

2. If a markov Chain is aperiodic, would that imply that a Markov Chain is recurrent?

Thanks in advance.

It is very difficult to study Markov chain topic. Not many good reference textbooks to study Markov chain.

I use Markov Chains and Stochastic Stability to study. This is good reference textbook.

Do you have any other good Markov Chains related textbooks recommend?

Regards,

Andy

Thanks Andy,

I am currently taking an Introduction to Operations Research class, and the textbook we are using is Introduction to Operations Research 8th Ed by Hillier Lieberman, so there is not much about Markov Chains in this book, just a few chapters.

thanks for your share. I also taking the Operations Research, but I use the textbook

Optimization in Operations Research, 1st Edition

Good luck

Andy ^_^

by the way, the textbooks online bookstore

cocomartini.com

is quite good. 100% Brand new and 50% off discount prices.

^_^

Thanks again for sharing! I can't believe how pricey textbooks can be..