Let be a discrete random variable whose set of possible values is . Let the probability mass function of be given by , and suppose we are interested in calculating .

In some cases, why are Markov Chains better for estimating as opposed to Monte-Carlo simulations? If we wanted to calculate there would not be any need to use simulation at all, right?