Markov Chain
سلسلة ماركوف
Definition
A random process that moves between states with probabilities that depend only on the current state.
Definition
A Markov chain is a stochastic process in which the next state depends only on the current state, described by a transition matrix and possibly converging to a stationary distribution.
Academic explanation
\(P(X_{t+1}\mid X_t,\dots,X_1)=P(X_{t+1}\mid X_t)\).
