Markov System Simulation

Here is a little on-line Javascript simulation of a 4-state (or smaller) Markov process. It shows the state transitions graphically, records the number (and relative frequency) of hits at each state, and also counts the number of steps to absorption when an absorbing state is encountered.

To run the simulation, just enter the probabilities in the transition matrix (use the tab key to switch from cell to cell; you can enter the probabilities in integer, decimal, or fraction form), edit the remaining settings if you like, and press "Run."

Note: To simulate a Markov system with fewer than 4 states, fill in the the top left portion of the transition matrix and leave the rest blank. For instance, to simulate a 2-state process, use the top left 2 2 portion of the matrix.

(We leave it to you to check that the entries in each row add up to 1. If they do not, upredictable things may happen.. As for the speed, that depends on how fast you want the simulation to run. Experiment with it. Fractional settings are permiitted.)

State Transition Matrix

State Transition Diagram

TO
1234
F
R
O
M
1
2
3
4

Iterations:  Start State:  Speed:(1-10).

   




Results

State 1 HitsState 2 HitsState 3 HitsState 4 Hits
State 1 Prob.State 2 Prob.State 3 Prob.State 4 Prob.

Absorption Occured in Step #:


Matrix Computation Tool

Topic Summary for Markov Processes

Return to Main Page

Finite Mathematics Applied to the Real World

Calculus Applied to the Real World

Finite Mathematics & Calculus Applied to the Real World

Last Updated:January, 2002
Copyright © 1998 StefanWaner and Steven R. Costenoble