Assignment:
1. Classify the MC with the following transition matrix
Find the asymptotic and/or stationary state probability vector, if it exists.
2. Consider a dice game in which, at each round, the player throws as many dice as the sum of the outcomes of the previous roll. Assume that the game begins throwing six dice.
a) Determine whether or not the process that counts the number of dice rolled at each round is Markovian.
b) Determine whether or not the process that counts the number of six at each round is Markovian. Justify your claims.