** Next:** Properties of the transition
** Up:** Calculating the Return Value
** Previous:** Existence of a unique

##

Example:

(Consider the MDP in figure
5.1)

For a policy ,
which picks *a*_{11} in
*S*_{1} and *a*_{21} in *S*_{2} we compute the following values:

Or in matrix notation:

Solutions are,

*Yishay Mansour*

*1999-11-24*