NVIDIA Megatron-LM Q-a Discussions
Q&A Discussions
Ask the community for help
-
You must be logged in to vote [QUESTION]Zarr-based strategies will not be registered because of missing packages
staleNo activity in 60 days on issue or PR -
You must be logged in to vote -
You must be logged in to vote [QUESTION] Is it expected to do grad norm on dense-optimizer and moe-optimizer respectively?
staleNo activity in 60 days on issue or PR -
You must be logged in to vote [QUESTION] how to profile bubble time in pipeline parallelism?
staleNo activity in 60 days on issue or PR -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote [QUESTION] Question about resume with distributed optimizer
staleNo activity in 60 days on issue or PR -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote
