Search All of the Math Forum:
Views expressed in these public forums are not endorsed by
Drexel University or The Math Forum.


Paul
Posts:
26
Registered:
1/3/11


Markov equilibrium
Posted:
Apr 22, 2013 6:23 PM


Some, but not all, Markov processes have a steadystate distribution (probability for being in each of the states). If the probability distribution for the current state equals the steadystate distribution, so will the distribution after the next transition (and any future transitions). In some cases you reach steadystate after a finite number of transitions. (Contrary to the current zombie craze, once you're dead, your probability of staying dead hovers around 1.0.) Sometimes you approach steadystate asymptotically. Sometimes there is no steadystate.
Paul



