Skip to content

Commit

Permalink
Update vector_envs_tutorial.py (#1133)
Browse files Browse the repository at this point in the history
  • Loading branch information
Tc511 authored Aug 5, 2024
1 parent a576025 commit 4a85589
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/tutorials/gymnasium_basics/vector_envs_tutorial.py
Original file line number Diff line number Diff line change
Expand Up @@ -417,7 +417,7 @@ def update_parameters(
# For our training loop, we are using the `RecordEpisodeStatistics` wrapper to record the episode lengths and returns and we are also saving
# the losses and entropies to plot them after the agent finished training.
#
# You may notice that the don't reset the vectorized envs at the start of each episode like we would usually do.
# You may notice that we don't reset the vectorized envs at the start of each episode like we would usually do.
# This is because each environment resets automatically once the episode finishes (each environment takes a different number of timesteps to finish
# an episode because of the random seeds). As a result, we are also not collecting data in `episodes`, but rather just play a certain number of steps
# (`n_steps_per_update`) in each environment (as an example, this could mean that we play 20 timesteps to finish an episode and then
Expand Down

0 comments on commit 4a85589

Please sign in to comment.