Markov Chain

سلسلة ماركوف

Definition

A random process that moves between states with probabilities that depend only on the current state.

Definition

A Markov chain is a stochastic process in which the next state depends only on the current state, described by a transition matrix and possibly converging to a stationary distribution.

Academic explanation

\(P(X_{t+1}\mid X_t,\dots,X_1)=P(X_{t+1}\mid X_t)\).

Learn and review

Suggested terms to learn next