It took me a moment to figure out that you were talking about a stochastic matrix/probability matrix (the more common names in my experience).

Anyways, Wikipedia has every little detail you could ever want to know about them, and Dr. Math some really good example problems that should make their practical use a lot clearer than the very general terms of the Wikipedia article.