Research Article Open Access

REPRESENTING MARKOV CHAINS WITH TRANSITION DIAGRAMS

Farida Kachapova1
  • 1 Auckland University of Technology, New Zealand

Abstract

Stochastic processes have many useful applications and are taught in several university programmes. Students often encounter difficulties in learning stochastic processes and Markov chains, in particular. In this article we describe a teaching strategy that uses transition diagrams to represent a Markov chain and to re-define properties of its states in simple terms of directed graphs. This strategy utilises the students’ intuition and makes the learning of complex concepts about Markov chains faster and easier. The method is illustrated by worked examples. The described strategy helps students to master properties of finite Markov chains, so they have a solid basis for the study of infinite Markov chains and other stochastic processes.

Journal of Mathematics and Statistics
Volume 9 No. 3, 2013, 149-154

DOI: https://doi.org/10.3844/jmssp.2013.149.154

Submitted On: 1 May 2013 Published On: 17 May 2013

How to Cite: Kachapova, F. (2013). REPRESENTING MARKOV CHAINS WITH TRANSITION DIAGRAMS. Journal of Mathematics and Statistics, 9(3), 149-154. https://doi.org/10.3844/jmssp.2013.149.154

  • 1,088 Views
  • 7,597 Downloads
  • 4 Citations

Download

Keywords

  • Transition Diagram
  • Transition Matrix
  • Markov Chain
  • First Passage Time
  • Persistent State
  • Transient State
  • Periodic State
  • Inter-Communicating States