At each second, a laptop computer's wireless LAN card reports the state of the radio channel

to an access point. The channel may be poor, fair, or excellent. In the poor state, the next state is equally

likely to be poor or fair, and impossible to be excellent. In the fair state, there is a probability 0.7 that the

next state will be unchanged from the previous state, a probability 0.2 that the next state will be poor, and

a probability 0.1 that the next state will be excellent. When the channel is excellent, the next state will be

excellent with probability 0.8 and be fair with probability 0.2.