Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The comparisons are unfair due to the use of feature expansion. #4

Open
cszachary opened this issue Mar 9, 2022 · 2 comments
Open

Comments

@cszachary
Copy link

Hi,

I find the comparisons with baselines are unfair in unsupervised TU, since existing baselines for plain datasets only use one dimensional attribute (i.e., the attribute of all nodes is set as 1). Please see here (https://github.com/Shen-Lab/GraphCL/blob/1d43f79d7f33f8133f9d4b4b8254d8aaeb09a615/unsupervised_TU/gin.py#L47). Without the using of feature expansion, the performance of AutoGCL drops significantly.

@Somedaywilldo
Copy link
Owner

Hi, would you mind sharing your settings, are you using the default settings for both models, I'll double check.

@cszachary
Copy link
Author

Hi,

I use the default setting and run un_exp.sh. For attributed graph, I use their original features without feature expansion. For plain graph, I set their features as 1. The performance drops in difference scales on all the datasets (i.e., from 1% ~ 4%).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants