Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

accuracy mismatch and logger is empty #15

Open
Urheen opened this issue Apr 7, 2024 · 2 comments
Open

accuracy mismatch and logger is empty #15

Urheen opened this issue Apr 7, 2024 · 2 comments

Comments

@Urheen
Copy link

Urheen commented Apr 7, 2024

Hi authors:

after running cifar100_resnet18_k200.sh, I found that the results is 76.09%, but what reported in the paper is higher than it.

image

Furthermore, I found that the logger file "./outputs/cifar100/train_p_diff.log" is empy.
Could you please help with this issue?

Best

@1zeryu
Copy link
Collaborator

1zeryu commented Apr 8, 2024

The performance of generated models is related to your training data that is training using SGD.
Would you provide more details like original model performance? The SGD-trained model performance may be affected by many factors, i.e., random seed, GPU type, so the 76.09% maybe reasonable results.
The train_p_diff.log contains terminal output about experiment initialization and torch.distributed.nn. This does not affect the conduct of the experiment.
If still have any questions or concerns, feel free to contact us.

@Urheen
Copy link
Author

Urheen commented May 6, 2024

Hi,

You mentioned, "The train_p_diff.log contains terminal output about experiment initialization and torch.distributed.nn. This does not affect the conduct of the experiment."

However, after running your code, I found that the log file is empty. Everything is shown in the terminal but is not saved to the local log file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants