# Question

Consider the finite queue variation of the M/G/1 model, where K is the maximum number of customers allowed in the system. For n = 1, 2, . . . , let the random variable Xn be the number of customers in the system at the moment tn when the nth customer has just finished being served. (Do not count the departing customer.) The times {t1, t2, . . .} are called regeneration points. Furthermore, {Xn} (n = 1, 2, . . .) is a discrete time Markov chain and is known as an embedded Markov chain. Embedded Markov chains are useful for studying the properties of continuous time stochastic processes such as for an M/G/1 model.

Now consider the particular special case where K = 4, the service time of successive customers is a fixed constant, say, 10 minutes, and the mean arrival rate is 1 every 50 minutes. Therefore, {Xn} is an embedded Markov chain with states 0, 1, 2, 3. (Because there are never more than 4 customers in the system, there can never be more than 3 in the system at a regeneration point.) Because the system is observed at successive departures, Xn can never decrease by more than 1. Furthermore, the probabilities of transitions that result in increases in Xn are obtained directly from the Poisson distribution.

(a) Find the one-step transition matrix for the embedded Markov chain.

(b) Use the corresponding routine in the Markov chains area of your IOR Tutorial to find the steady-state probabilities for the number of customers in the system at regeneration points.

(c) Compute the expected number of customers in the system at regeneration points, and compare it to the value of L for the M/D/1 model (with K = ∞) in Sec. 17.7.

Now consider the particular special case where K = 4, the service time of successive customers is a fixed constant, say, 10 minutes, and the mean arrival rate is 1 every 50 minutes. Therefore, {Xn} is an embedded Markov chain with states 0, 1, 2, 3. (Because there are never more than 4 customers in the system, there can never be more than 3 in the system at a regeneration point.) Because the system is observed at successive departures, Xn can never decrease by more than 1. Furthermore, the probabilities of transitions that result in increases in Xn are obtained directly from the Poisson distribution.

(a) Find the one-step transition matrix for the embedded Markov chain.

(b) Use the corresponding routine in the Markov chains area of your IOR Tutorial to find the steady-state probabilities for the number of customers in the system at regeneration points.

(c) Compute the expected number of customers in the system at regeneration points, and compare it to the value of L for the M/D/1 model (with K = ∞) in Sec. 17.7.

## Answer to relevant Questions

Southeast Airlines is a small commuter airline serving primarily the state of Florida. Their ticket counter at a certain airport is staffed by a single ticket agent. There are two separate lines—one for first-class ...Reconsider the County Hospital emergency room problem as analyzed in Sec. 17.8. Suppose that the definitions of the three categories of patients are tightened somewhat in order to move marginal cases into a lower category. ...Consider a Jackson network with three service facilities having the parameter values shown below. T (a) Find the total arrival rate at each of the facilities. Suppose that a queueing system has two servers, an exponential interarrival time distribution with a mean of 2 hours, and an exponential service-time distribution with a mean of 2 hours for each server. Furthermore, a ...Consider the birth-and-death process with all μn = 2 (n = 1, 2, . . .), λ0 = 3, λ1 = 2, λ2 = 1, and λn = 0 for n = 3, 4, . . . . (a) Display the rate diagram. (b) Calculate P0, P1, P2, P3, and Pn for n = 4, 5, . . . ...Post your question

0