Markov Chain

a memoryless walk finds its stationary share

Plate XV
StateA
Steps0
Max |emp − π|

The next state depends only on the present one. Heavier arcs are likelier hops; the bars show how the long-run visit share approaches the stationary distribution π. After A. Markov, 1906