Markov Decision Process

عملية قرار ماركوف

Abbreviation: MDP

Definition

A mathematical framework for sequential decision-making: states, actions, transition probabilities and rewards, where the future depends only on the current state.

Definition

A Markov decision process formalises sequential decision making with states, actions, transition probabilities and rewards under the Markov property.

Mathematical equations

V^*(s)=\max_a\sum_{s'}P(s'\mid s,a)\left[R(s,a,s')+\gamma V^*(s')\right]

Learn and review

Suggested terms to learn next