Question: A small computer lab has 2 terminals. The number of students working in this lab is recorded at the end of every hour. A computer

A small computer lab has 2 terminals. The number of students working in this lab is recorded at the end of every hour. A computer assistant notices the following pattern: If there are 0 or 1 students in a lab, then the number of students in 1 hour has a 50-50% chance to increase by 1 or remain unchanged.If there are 2 students in a lab, then the number of students in 1 hour has a 50-50% chance to decrease by 1 or remain unchanged.

(a) Write the transition probability matrix for this Markov chain.

(b) Is this a regular Markov chain? Justify your answer.

(c) Suppose there is nobody in the lab at 7 am. What is the probability of nobody working in the lab at 10 am? can someone explain this?

Step by Step Solution

3.40 Rating (153 Votes )

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock

Lets address each part of the question regarding the Markov chain breaking down the problem into specific steps for clarity a Transition Probability M... View full answer

blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Physics Questions!