Consider the Markov chain with the state-transition diagram shown in Figure 12.22.
a. List the transient states, the recurrent states, and the periodic states.
b. Identify the members of each chain of recurrent states.
c. Give the transition probability matrix of the process.
d. Given that the process starts in state 1, either determine the numerical value of the probability that the process is in state 8 after an infinitely large number of transitions or explain why this quantity does not exist.
