Replies: 3 comments
-
|
nemo (using megatron-core) supports it https://github.com/NVIDIA/NeMo/blob/f005f1323eaf9a23ad6dc4bc326dc95bf0002e8d/examples/nlp/language_modeling/conf/megatron_gemma_config.yaml#L4 |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
also looking for example of gemma in megatron-lm |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
Marking as stale. No activity in 60 days. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Your question
Does Megatron has plan to support Gemma？
Beta Was this translation helpful? Give feedback.
All reactions