added rt to tidy data + fixed some typos

Author: modirshanechi

IMRLExploration/HowTo.ipynb

@@ -93,7 +93,7 @@
     "\n",
     "- `states`: `states[i]` is a coarse grained sequence of states during episode `i` with all stochastic states put together as state `7` and all goal states put together as state `0`; trap state 7 and 8 are encoded as states `8` and `9`, respectively\n",
     "\n",
-    "- `images`: `images[i][:,t]` is a vector corresponding to the exact state at time step `t` during episode `i`. `images[i][1,t]` denotes whether the state is in the stochastic part (if equal to `1`), is a goal state (if equal to `2`) or is a normal state (if equal to `0`). For the normal states (states 1 to 8), `images[i][2,t]` corresponds to `states[i][t]`. For the goal state, `images[i][2,t]` denotes the value of the goal (`0` for 2CHF, `1` for 3CHF, and `2` for 4CHF). For the stochastic states, `images[i][2,t]` corresponds to the index of the stochastic state (between 0 to 49).\n",
+    "- `images`: `images[i][:,t]` is a vector corresponding to the exact state at time step `t` during episode `i`. `images[i][1,t]` denotes whether the state is in the stochastic part (if equal to `1`), is a goal state (if equal to `2`) or is a normal state (if equal to `0`). For the normal states (states 1 to 8), `images[i][2,t]` is equal to `states[i][t] - 1`. For the goal state, `images[i][2,t]` denotes the value of the goal (`0` for 2CHF, `1` for 3CHF, and `2` for 4CHF). For the stochastic states, `images[i][2,t]` corresponds to the index of the stochastic state (between 0 to 49).\n",
     "\n",
     "- `trial_time`: `trial_time[i]` is the sequence of real times of the start of each trial, during episode `i`\n",
     "\n",