Next: About this document ...
Up: TD( ) algorithm
Now we will show that "looking forward" and "looking
backward" schemes are equal (i.e. will give same results).
Equality of schemes using backward and forward
for the forward scheme
We will show that
We can rewrite
We have for the left side of the equation:
And for the right side:
So, we have :
We have for right side the same expression we have already for the
left side of the equation. This implies that both methods give
same updates at the end of the run.