Question: Consider a nonsymmetric random walk onZ, where we start at the origin, and at each time step we either move right one unit with probabilityp >1/2 or left with probability 1-p.
(a) Model this as a Markov chain. What is the transition matrix?
(b) Determine whether the origin is recurrent or transient.