Transition (or stochastic) matrix of the Markov chain is a matrix used to describe it over a finite state
space S. If the probability of moving from i to j in one time step is Pij, the transition matrix P
is given by using Pij as the i row and j column element, e.g.,
