Skip to content

Commit

Permalink
Fix typos in docs FrozenLake_tuto.py (#757)
Browse files Browse the repository at this point in the history
  • Loading branch information
mmhamdy authored Oct 30, 2023
1 parent a93bbe4 commit 7dca683
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions docs/tutorials/training_agents/FrozenLake_tuto.py
Original file line number Diff line number Diff line change
Expand Up @@ -86,7 +86,7 @@ class Params(NamedTuple):
# Set the seed
rng = np.random.default_rng(params.seed)

# Create the figure folder if it doesn't exists
# Create the figure folder if it doesn't exist
params.savefig_folder.mkdir(parents=True, exist_ok=True)


Expand Down Expand Up @@ -529,7 +529,7 @@ def plot_steps_and_rewards(rewards_df, steps_df):
# whereas on the :math:`7 \times 7` map, the agent needs :math:`\sim 300`
# episodes, on the :math:`9 \times 9` map it needs :math:`\sim 800`
# episodes, and the :math:`11 \times 11` map, it needs :math:`\sim 1800`
# episodes to converge. Interestingely, the agent seems to be getting more
# episodes to converge. Interestingly, the agent seems to be getting more
# rewards on the :math:`9 \times 9` map than on the :math:`7 \times 7`
# map, which could mean it didn't reach an optimal policy on the
# :math:`7 \times 7` map.
Expand All @@ -554,12 +554,12 @@ def plot_steps_and_rewards(rewards_df, steps_df):
# References
# ----------
#
# - Code inspired from `Deep Reinforcement Learning
# - Code inspired by `Deep Reinforcement Learning
# Course <https://simoninithomas.github.io/Deep_reinforcement_learning_Course/>`__
# by Thomas Simonini (http://simoninithomas.com/)
# - `Dissecting Reinforcement
# Learning-Part.2 <https://mpatacchiola.github.io/blog/2017/01/15/dissecting-reinforcement-learning-2.html>`__
# - `Dadid Silver’s course <https://www.davidsilver.uk/teaching/>`__ in
# - `David Silver’s course <https://www.davidsilver.uk/teaching/>`__ in
# particular lesson 4 and lesson 5
# - `Q-learning article on
# Wikipedia <https://en.wikipedia.org/wiki/Q-learning>`__
Expand Down

0 comments on commit 7dca683

Please sign in to comment.