Question: Consider p E (0, 1) and a simple walk (Y,),20 on Z with transition matrix P ifm = n + 1 Pnm = 1-p ifm

 Consider p E (0, 1) and a simple walk (Y,),20 on

Z with transition matrix P ifm = n + 1 Pnm =

Consider p E (0, 1) and a simple walk (Y,),20 on Z with transition matrix P ifm = n + 1 Pnm = 1-p ifm =n- 1 0 otherwise. Let us set Ho = inf{n 2 0 : Y, = 0} be the hitting time of the value a by the chain. a) Show that almost surely, lim In = 2p - 1. 1-00 n b) Let us consider f(y) = Py(Ho , f(1) # {0, 1}. 3/ Show that f (y) = pf(y + 1) + (1 -p)f(y - 1), Vy 2 1

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!