Using the initial settings, how can the discounted reward of the center field be 1.1? The max reward the agent can get is 1.0 and then the goal is reached and the agent is reset.
Also, if changing the field below to R 1.0, I'd expect the discounted reward to be 10 instead of 9.9:

and here 50 instead of 49.90:
