A random or stochastic method for describing a sequence of possible events where the probability of each event depends only on the state attained in the previous event. A Markov chain is the simplest form of a Markov model. Markov models are used in reinforcement learning and other machine learning approaches.
Menu
