Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue with the reproduced results #2

Open
xiaoen0 opened this issue Sep 18, 2024 · 1 comment
Open

Issue with the reproduced results #2

xiaoen0 opened this issue Sep 18, 2024 · 1 comment

Comments

@xiaoen0
Copy link

xiaoen0 commented Sep 18, 2024

Hello authors,

Thank you for your excellent work.

I followed the training hyperparameters described in Section V-B of your paper to reproduce the results. However, I found significant discrepancies in the PC, POM, and PSS results compared to those reported in your paper, although the OPD results are largely consistent.

Have I overlooked any details? Could you provide an explanation for this situation or offer some suggestions for reproducing these results?

Screenshot 2024-09-18 at 11 47 55
@xiaoen0
Copy link
Author

xiaoen0 commented Sep 19, 2024

I reproduced the experience again, and the results improved. Could you please clarify how many times the experiment was repeated to obtain the average results reported in the paper?
Screenshot 2024-09-19 at 19 47 44

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant