Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does the method work with other beta schedules? #5

Open
DianCh opened this issue Jul 8, 2024 · 1 comment
Open

Does the method work with other beta schedules? #5

DianCh opened this issue Jul 8, 2024 · 1 comment

Comments

@DianCh
Copy link

DianCh commented Jul 8, 2024

Hi authors, thank you for releasing this nice work. The paper's findings seemed to be based on the linear beta schedule, and I'm wondering if the method would also work with other beta schedules, like sigmoid or cosine?

@1zeryu
Copy link
Collaborator

1zeryu commented Jul 15, 2024

Thank you for your question, we try other beta schedules and report the results in section 3.3 cross-architecture robustness evaluation. Our method works on different beta schedule like 'linear', 'cosine', 'quadratic'.
If there are any other questions, feel free to contact us.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants