Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot reproduce the results of WikiCS dataset #5

Open
PatPathead opened this issue Jun 13, 2022 · 7 comments
Open

Cannot reproduce the results of WikiCS dataset #5

PatPathead opened this issue Jun 13, 2022 · 7 comments

Comments

@PatPathead
Copy link

Hi, thanks for reading this!

When I reproduce the results of WikiCS by the provided hyperparameters and code (nothing changed), I cannot reproduce the results shown in the paper, i.e., 78%+. I only can achieve 32%+ accuracy.

Do you have any hints on it? Is that caused by hyperparameter setting?

Thanks!

@PatPathead
Copy link
Author

The outputs in the final several lines
(T) | Epoch=2987, loss=8.6194
(T) | Epoch=2988, loss=8.6100
(T) | Epoch=2989, loss=8.6103
(T) | Epoch=2990, loss=8.6389
(T) | Epoch=2991, loss=8.6287
(T) | Epoch=2992, loss=8.6128
(T) | Epoch=2993, loss=8.6120
(T) | Epoch=2994, loss=8.6168
(T) | Epoch=2995, loss=8.6314
(T) | Epoch=2996, loss=8.6573
(T) | Epoch=2997, loss=8.6133
(T) | Epoch=2998, loss=8.6136
(T) | Epoch=2999, loss=8.6019
(T) | Epoch=3000, loss=8.6156
(E) | Epoch=3000, avg_acc = 0.32032665610313416
0.3205062344670296

@Linyxus
Copy link
Collaborator

Linyxus commented Jun 13, 2022

Thanks for your interest in our work! We'll check this soon.

@hcmdgh
Copy link

hcmdgh commented Jul 16, 2022

Hi, I also face the same problem.

@brysonwx
Copy link

Hi, I also meet with the same problem.

@FinchNie
Copy link

FinchNie commented Nov 4, 2022

same problem

@FinchNie
Copy link

FinchNie commented Nov 4, 2022

Using dataset ‘WikiCS(root=path)’ instead of 'WikiCS(root=path, transform=T.NormalizeFeatures())' can fix this problem.

@JiaLonghao1997
Copy link

Hi, I also meet with the same problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants