LinkBack URL
About LinkBacksHi,
I'd be rather grateful if anyone could help me with this? Thanks
I don't know how to do this by using conditional expectations. My method would be to use the theory of Markov processes.
The transition matrix for this process is, where the (i,j)-element gives the transition probability from room j to room i. If
is the 5x5 submatrix obtained by deleting the final row and column, then
. The inverse of
is the so-called fundamental matrix of the process,
.
According to the theory of absorbing Markov systems (see here, for example), the (i,j)-entry in the fundamental matrix gives the expected duration of being in state i, having started in state j. So if the mouse starts in room 1, then (reading off the numbers in the first column of the fundamental matrix) it can expect to spend a total of 6 minutes in each of rooms 1 and 2, 2 minutes in each of rooms 3 and 5, and 3 minutes in room 4, before disappearing into the fatal room 6. That gives it a total expected life of 6+6+2+3+2 = 19 minutes. (That is much longer than I would have guessed – I hope I haven't got the arithmetic wrong.)
  |
