tsaitea
- 19
- 0
- TL;DR
- In this post on the Return function is indexed by k?
Where did the k come from? I was expecting the index to be t.
Reinforcement Learning - Return Function
- Thread starter tsaitea
- Start date
-
- Tags
- Function
Join the discussion
Registration is free. Ask a follow-up in this thread, or start your own.
1 reply · 1K views
Where did the k come from? I was expecting the index to be t.
Discussion
- 13,831
- 16,662
##t## tells you the index of the first term you are summing over, so you can't sum over that. You need to sum over a new index, called a dummy index - they've chosen ##k##. Note that if you expand the sum, you will replace ##k## with 0 in the zeroth term, replace it with 1 in the first term, and so on - ##k## disappears when you expand the sum. If you'd summed over ##t##, ##t## would likewise be replaced and disappear when you expanded sum, which is not what you want.