Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Question] make_vec() prevent reset behaviour from happening when enviroment returnes done = True #1265

Closed
BN7002 opened this issue Dec 1, 2024 · 1 comment
Closed

[Question] make_vec() prevent reset behaviour from happening when enviroment returnes done = True #1265

BN7002 opened this issue Dec 1, 2024 · 1 comment
Labels
question Further information is requested

Comments

@BN7002
Copy link

BN7002 commented Dec 1, 2024

Question

Hello, I am training a policy using gymnaiusm api with use of gymnasium.make_vec() set to sync mode but it is not aligned to being a sync mode. When my enviroment returnes done = True then the next step it will restart enviroment that returned that done = True.
So in this situation is there a way to prevent this behaviour?
@BN7002 BN7002 added the question Further information is requested label Dec 1, 2024
@pseudo-rnd-thoughts
Copy link
Member

Yes, we have merged #1227 that adds support for different autoreset modes and will be released in v1.1

@BN7002 BN7002 closed this as completed Dec 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@pseudo-rnd-thoughts @BN7002