Problem 3 Consider the Markov chain on nonnegative integers that does the following: from any site...

Transcribed Image Text:

Problem 3 Consider the Markov chain on nonnegative integers that does the following: from any site x 0 it jumps to x +1 with probability p and to 0 with probability 1 p. Is this chain transient? Null recurrent? Positive recurrent? You need to prove whatever you claim. Problem 3 Consider the Markov chain on nonnegative integers that does the following: from any site x 0 it jumps to x +1 with probability p and to 0 with probability 1 p. Is this chain transient? Null recurrent? Positive recurrent? You need to prove whatever you claim.