3. Markov Processes

Learning outcomes
  • I can describe simple Markov processes.
  • I can interpret transition diagrams.
  • I can calculate transition probabilities.
  • I can model simple stochastic systems.
  • I can apply Markov models to practical situations.