next up previous
Next: Probabilities Transition Matrix Up: Introduction: Discounted Infinite Horizon Previous: Introduction: Discounted Infinite Horizon

   
Notation

$\vec{v}:S\Rightarrow R$ $\Vert\vec{v}\Vert _{\infty}=\max_{s \in S}\{\vert\vec{v}(s)\vert\}$ $H:S\times S\Rightarrow R$ $\Vert H\Vert=\max_{s \in S}\sum_{j\in S}\Vert H_(s,j)\Vert$ (If H is a probabilities matrix, $\Vert H\Vert=1$)

 

Yishay Mansour
1999-11-24