Results 1 to 6 of 6

Math Help - Markov Chain: Transient and aperiodic states question

  1. #1
    Member
    Joined
    Mar 2008
    From
    Acolman, Mexico
    Posts
    118

    Markov Chain: Transient and aperiodic states question

    Hi,

    I have some questions about the periodicity of the states in a Markov Chain,

    1. Can a state be aperiodic and transient? If so, is there an easy example to see this.

    2. If a markov Chain is aperiodic, would that imply that a Markov Chain is recurrent?

    Thanks in advance.
    Follow Math Help Forum on Facebook and Google+

  2. #2
    Banned
    Joined
    Jan 2008
    Posts
    13

    Study Markov Chains

    It is very difficult to study Markov chain topic. Not many good reference textbooks to study Markov chain.

    I use Markov Chains and Stochastic Stability to study. This is good reference textbook.

    Do you have any other good Markov Chains related textbooks recommend?

    Regards,

    Andy
    Follow Math Help Forum on Facebook and Google+

  3. #3
    Member
    Joined
    Mar 2008
    From
    Acolman, Mexico
    Posts
    118
    Thanks Andy,

    I am currently taking an Introduction to Operations Research class, and the textbook we are using is Introduction to Operations Research 8th Ed by Hillier Lieberman, so there is not much about Markov Chains in this book, just a few chapters.
    Follow Math Help Forum on Facebook and Google+

  4. #4
    Banned
    Joined
    Jan 2008
    Posts
    13
    thanks for your share. I also taking the Operations Research, but I use the textbook

    Optimization in Operations Research, 1st Edition

    Good luck

    Andy ^_^
    Follow Math Help Forum on Facebook and Google+

  5. #5
    Banned
    Joined
    Jan 2008
    Posts
    13
    by the way, the textbooks online bookstore

    cocomartini.com

    is quite good. 100% Brand new and 50% off discount prices.

    ^_^
    Follow Math Help Forum on Facebook and Google+

  6. #6
    Member
    Joined
    Mar 2008
    From
    Acolman, Mexico
    Posts
    118
    Thanks again for sharing! I can't believe how pricey textbooks can be..
    Follow Math Help Forum on Facebook and Google+

Similar Math Help Forum Discussions

  1. Markov chain (prove period aperiodic)
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: October 21st 2011, 09:07 AM
  2. Markov Chains + Transient States Proof - Help
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: November 7th 2010, 08:40 AM
  3. When is an Irreducible Markov Chain is transient
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: May 11th 2010, 04:20 AM
  4. How to test if a finite Markov chain is aperiodic?
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: August 26th 2009, 07:28 AM
  5. Markov Chain: Transient & Aperiodic
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: March 9th 2008, 04:54 AM

Search Tags


/mathhelpforum @mathhelpforum