(a) Show that, if there are more than one state, and p ii = 1 for some...

Question:

(a) Show that, if there are more than one state, and pii = 1 for some i, then the chain is reducible.

(b) Give an example of a reducible chain for which all transition probabilities are less than one.

(c) Show that in order to specify the classes of a chain, we do not need to know particular values of transition probabilities but only which of them are not equal to zero. Why does it not contradict the statement?

Fantastic news! We've Found the answer you've been seeking!

Step by Step Answer:

Related Book For  book-img-for-question
Question Posted: