Hello, I'm working on a problem for my stochastic processes class and struggling to move forward. I wrote a transition matrix, but I'm worried that it's incorrect, and therefore I'm having trouble figuring out how to approach the rest of the problem. Any help is greatly appreciated. Thank you!

1. A traveler travels among four cities {1, 2, 3, 4} every day. When the traveler is in city i, with probability 0