update agilerl tutorials

[mikepratt1]

Description

Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.

Fixes # (issue), Depends on # (pull request)

Type of change

Please delete options that are not relevant.

• Bug fix (non-breaking change which fixes an issue)

Checklist:

• I have run the pre-commit checks with pre-commit run --all-files (see CONTRIBUTING.md instructions to set it up)
• I have run pytest -v and no errors are present.
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
• I solved any possible warnings that pytest -v has generated that are related to my code to the best of my knowledge.
• I have added tests that prove my fix is effective or that my feature works
• New and existing unit tests pass locally with my changes

[David-GERARD]

@nicku-a @mikepratt1 the CI testing workflows for agilerl are returning an error, can you look into it?

╭───────────────────── Traceback (most recent call last) ──────────────────────╮
│ /home/runner/work/PettingZoo/PettingZoo/tutorials/AgileRL/agilerl_dqn_curric │
│ ulum.py:19 in <module>                                                       │
│                                                                              │
│     16 from agilerl.components.replay_buffer import ReplayBuffer             │
│     17 from agilerl.hpo.mutation import Mutations                            │
│     18 from agilerl.hpo.tournament import TournamentSelection                │
│ ❱   19 from agilerl.utils.utils import create_population                     │
│     20 from tqdm import tqdm, trange                                         │
│     21                                                                       │
│     22 from pettingzoo.classic import connect_four_v3                        │
╰──────────────────────────────────────────────────────────────────────────────╯
ImportError: cannot import name 'create_population' from 'agilerl.utils.utils' 
(/opt/hostedtoolcache/Python/3.10.15/x64/lib/python3.10/site-packages/agilerl/ut
ils/utils.py)
Error: Process completed with exit code 1.

[nicku-a]

on it - just need to update the agilerl version in reqs

[David-GERARD]

SB3/connect_four must be removed as it is currently broken.

[David-GERARD]

I checked the new error logs, the workflows for python 3.10 and 3.11 failed because of a pygame version dependancy conflict between agilerl and PettingZoo 1.24.x. I have the same issue for another PR and I'm working on solving it.

Caution

However for the python 3.9 test of the agilerl tutorial, we have in the log:

Ignoring agilerl: markers 'python_version >= "3.10"' don't match your environment

which leads to a ModuleNotFoundError.

@mikepratt1 let me know if 'python_version >= "3.10"' is something you want to enforce, in which case we need to modify the CI to remove 3.9.