The Markov property is the condition that the next state of a process depends only on the current state and action, not on the full history of prior states. It enables simplified modeling of sequential decision problems and underlies Markov chains and Markov decision processes.
A property of certain environments, where state
transitions are entirely determined by information implicit in the
current state and the agent's action.