Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

有没有一些提速上的建议呢? #48

Open
zbtrs opened this issue Nov 16, 2023 · 1 comment
Open

有没有一些提速上的建议呢? #48

zbtrs opened this issue Nov 16, 2023 · 1 comment

Comments

@zbtrs
Copy link

zbtrs commented Nov 16, 2023

用了最新版本的代码,在A100服务器上从训lora到drag一张图大概要50秒的时间。如果想处理多个图片,速度显得有点慢了,有没有方法可以提速呢?

@Yujun-Shi
Copy link
Owner

Yujun-Shi commented Dec 8, 2023

hello,感谢关注我们的工作。目前我们update的代码,lora的训练会更快(用了batch size为4,lora training step为80,lora learning rate为5e-4)。
如果想继续显著提速的话,有一个方案就是增大latent_lr这个参数(比如改成0.02, 0.04)。因为我们的方法是通过优化latent来实现编辑的。所以如果增大learning rate就可以更快的把handle point拖拽到target。
但这样做的问题是,在个别情况下,最后的结果效果会差一些。因为增大learning rate会导致优化没有那么精细。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants