About the --auto-scale-lr option #1649
Unanswered
brotherhoon-code
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I don't exactly understand about
--auto-scale-lr
.If I have a batch size of 4096 trained in paper,
and my machine only supports a batch size of 64,
If I use this option, will the lr schedule adjustment be done after 64 steps (4096//64)?
If I want to use this,
Do I need to call --auto-scale-lr when calling train.py
from cmd in addition to what I define in config.py?
To summarize my question.
(Or does it run automatically if it's in config)
Beta Was this translation helpful? Give feedback.
All reactions