** Next:** Expectation of Reward
** Up:** Notation
** Previous:** Notation

###

Probabilities Transition Matrix

Usually the topic of discussion
will be a series of t steps, and the object of inquiry will be the
probability of making a transition from state *s* to state *j*
after *t* steps.

The transition matrix after *t* steps, starting
from state s, using policy
is:

*Yishay Mansour*

*1999-11-24*