Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

D3QN #3

Open
liwenshulws opened this issue Nov 6, 2023 · 6 comments
Open

D3QN #3

liwenshulws opened this issue Nov 6, 2023 · 6 comments

Comments

@liwenshulws
Copy link

Hello, I would like to ask where your code uses D3QN. I was confused when I saw TD3 in the train.py code, and would like to ask you what happened?Additionally, I am also confused about the use of dueling dqn in the paper.

@luoxi50
Copy link

luoxi50 commented Nov 17, 2023

@liwenshulws I have the same question. And have you run successfully?

@baixiaoer123
Copy link

2024-04-17 22:08:47, INFO: Skip_connection: True
2024-04-17 22:08:47, INFO: Number of layers: 1
2024-04-17 22:08:47, INFO: Similarity_func: concatenation
2024-04-17 22:08:47, INFO: Layerwise_graph: False
2024-04-17 22:08:47, INFO: Skip_connection: True
2024-04-17 22:08:47, INFO: Number of layers: 1
2024-04-17 22:08:47, INFO: TD3 action_dim is : 2
Traceback (most recent call last):
File "F:\SG-D3QN\crowd_nav\test.py", line 205, in
main(sys_args)
File "F:\SG-D3QN\crowd_nav\test.py", line 73, in main
policy.load_model(model_weights)
File "F:\SG-D3QN\crowd_nav\policy\TD3_rl.py", line 139, in load_model
checkpoint = torch.load(file)
File "D:\Anaconda\lib\site-packages\torch\serialization.py", line 594, in load
with _open_file_like(f, 'rb') as opened_file:
File "D:\Anaconda\lib\site-packages\torch\serialization.py", line 230, in _open_file_like
return _open_file(name_or_buffer, mode)
File "D:\Anaconda\lib\site-packages\torch\serialization.py", line 211, in init
super(_open_file, self).init(open(name, mode))
FileNotFoundError: [Errno 2] No such file or directory: 'data/output1/best_val.pth'

@baixiaoer123
Copy link

2024-04-17 22:11:01, INFO: Using device: cpu
2024-04-17 22:11:01, INFO: Loaded RL weights with best VAL
Traceback (most recent call last):
File "F:\SG-D3QN\crowd_nav\test.py", line 205, in
main(sys_args)
File "F:\SG-D3QN\crowd_nav\test.py", line 51, in main
spec.loader.exec_module(config)
File "", line 846, in exec_module
File "", line 982, in get_code
File "", line 1039, in get_data
FileNotFoundError: [Errno 2] No such file or directory: 'data/tsrl10rot/1/config.py'

@zhouzhiqian
Copy link
Member

Maybe there is a mistake in the repository. TD3.py is useless in this repository, which is built for our another work. Besides, dueling architecture is in the DQN file.

@zhouzhiqian
Copy link
Member

2024-04-17 22:11:01, INFO: Using device: cpu 2024-04-17 22:11:01, INFO: Loaded RL weights with best VAL Traceback (most recent call last): File "F:\SG-D3QN\crowd_nav\test.py", line 205, in main(sys_args) File "F:\SG-D3QN\crowd_nav\test.py", line 51, in main spec.loader.exec_module(config) File "", line 846, in exec_module File "", line 982, in get_code File "", line 1039, in get_data FileNotFoundError: [Errno 2] No such file or directory: 'data/tsrl10rot/1/config.py'

The solution is to set your configuration properly. The path tsrl10rot, which is created in my computer, does not exist in your computer.

@zhouzhiqian
Copy link
Member

@liwenshulws I have the same question. And have you run successfully?

Any other question?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants