4. Consider a Markov process with transition matrix. State 1 State 2 State 1 0 7...

Transcribed Image Text:

4. Consider a Markov process with transition matrix. State 1 State 2 State 1 0 7 State 2 (a) What do the entries and 0 represent? (b) If the system is in state 1 initially, what is the probability that it will be in state 1 at the next observation? (c) If the system has a 50% chance of being in state 1 initially, what is the probability that it will be in state 2 at the next observation? 4. Consider a Markov process with transition matrix. State 1 State 2 State 1 0 7 State 2 (a) What do the entries and 0 represent? (b) If the system is in state 1 initially, what is the probability that it will be in state 1 at the next observation? (c) If the system has a 50% chance of being in state 1 initially, what is the probability that it will be in state 2 at the next observation?