Question: 3.3. Let {V(t) } be the two state Markov chain whose transition probabilities are given by (3.14a-d). Suppose that the initial distribution is (1 -

3.3. Let {V(t) } be the two state Markov chain whose transition probabilities are given by (3.14a-d). Suppose that the initial distribution is

(1 - ir, 7r). That is, assume that Pr { V(0) = 0) = 1 - rr and Pr(V(0) = I) = nr. For 0 < s < t, show that E[V(s)V(t)] = 1r - arPa(t - s), whence Cov[V(s), V(t)] = 1r(1 - 7r)e-(°+'3' ` '

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Probability And Stochastic Modeling Questions!