A Markov chain is a stochastic model for a sequence of states in which the probability of the next state depends only on the current state. This memoryless property makes Markov chains useful for modeling random processes, transitions, and sequential systems.
A stochastic model describing a sequence of possible events in which the probability of each event depends only on the state attained in the previous event.