Skip to content

Commit

Permalink
Merge pull request #395 from PierreCounathe/pierrecounathe/unit-2-fro…
Browse files Browse the repository at this point in the history
…zenlake-observation-space

Unit 2 Correct FrozenLake's observation space
  • Loading branch information
simoninithomas authored Sep 13, 2023
2 parents fae7b9e + a14476a commit 94c0a41
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion notebooks/unit2/unit2.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -429,7 +429,7 @@
"id": "2MXc15qFE0M9"
},
"source": [
"We see with `Observation Space Shape Discrete(16)` that the observation is an integer representing the **agent’s current position as current_row * nrows + current_col (where both the row and col start at 0)**.\n",
"We see with `Observation Space Shape Discrete(16)` that the observation is an integer representing the **agent’s current position as current_row * ncols + current_col (where both the row and col start at 0)**.\n",
"\n",
"For example, the goal position in the 4x4 map can be calculated as follows: 3 * 4 + 3 = 15. The number of possible observations is dependent on the size of the map. **For example, the 4x4 map has 16 possible observations.**\n",
"\n",
Expand Down
2 changes: 1 addition & 1 deletion units/en/unit2/hands-on.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -247,7 +247,7 @@ print("Observation Space", env.observation_space)
print("Sample observation", env.observation_space.sample()) # Get a random observation
```

We see with `Observation Space Shape Discrete(16)` that the observation is an integer representing the **agent’s current position as current_row * nrows + current_col (where both the row and col start at 0)**.
We see with `Observation Space Shape Discrete(16)` that the observation is an integer representing the **agent’s current position as current_row * ncols + current_col (where both the row and col start at 0)**.

For example, the goal position in the 4x4 map can be calculated as follows: 3 * 4 + 3 = 15. The number of possible observations is dependent on the size of the map. **For example, the 4x4 map has 16 possible observations.**

Expand Down

0 comments on commit 94c0a41

Please sign in to comment.