please help with question 2.16 based ont the example 2.4 as in the pictures

2.16. Consider the inventory system of Example 2.4. Compute the occupancy matrix M(52). Using this, compute the expected number of weeks that Computers- R-Us starts with a full inventory (i.e., five PCs) during a year given that it started the first week of the year with an inventory of five PCs.Example 2.4. (Inventory System). Computers-R-Us stocks a wide variety of PCs for retail sale. It is open for business Monday through Friday 8:00 a.m. to 5:00 p.m. It uses the following operating policy to control the inventory of PCs. At 5:00 p.m. Friday, the store clerk checks to see how many PCs are still in stock. If the number is less than two, then he orders enough PCs to bring the total in stock up to five at the beginning of the business day Monday. If the number in stock is two or more, no action is taken. The demand for the PCs during the week is a Poisson random variable with mean 3. Any demand that cannot be immediately satisfied is lost. Develop a stochastic model of the inventory of the PCs at Computers-R-Us. Let X, be the number of PCs in stock at Computers-R-Us at 8:00 a.m. Monday of the nth week. Let D, be the number of PCs demanded during the ath week. Then the number of PCs left in the store at the end of the week is max(X, - D,, 0). If Xn - Dn 2 2, then there are two or more PCs left in the store at 5:00 p.m. Friday of the wth week. Hence no more PCs will be ordered that weekend, and we will have Xn+1 = Xn - D . On the other hand, if X, - D, 0} is a DTMC. We have, for j = 2,3, 4 and i = j, j + 1, ....5, P(X,+1 = j[Xn = i, Xx-1, . . . .Xo) = P(X, - Dn = j\\Xn = 1, Xx-1, . ... Xo) = P(i - Dn = j\\X, = i, Xx-1, . . ., Xo) = P(D, = i - j). Similarly, P(X,+1 = 5[X, = i) = P(X, - Dn i -1) for i = 2, 3, 4. Using the fact that Dn is a P(3) random variable, we get Table 2.1. Using the data in this table, we can compute the transition probability matrix of the DTMC {X,, n > 0} as follows: .0498 0 0 .9502 P = .1494 .0498 0 .8008 2240 .1494 .0498 .5768 (2.10) .2240 .2240 .1494 .4026. Note the entry for ps,5. The inventory can move from 5 to 5 if the demand is either 0 or at least 4. Hence we have Ps,5 = P(D, = 0) + P(D, > 4)