EECS Publication

Computing Steady State Distributions Without Cancellation

Michael D. Vose

The steady state distribution of a Markov chain is represented such that no cancellation occurs. The resulting form is applied to determine the behavior of the steady state distribution of a Markov chain as its transition probabilities decay exponentially. This situation arises naturally when considering Markov chains converging to a dynamical system.