Lecture 10: Examples of Discrete Time Markov Chain