-
Notifications
You must be signed in to change notification settings - Fork 38
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
mT0-xxl finetuning #19
Comments
Hey there are some more details on mT0 fine-tuning here: #12 |
Thanks for reply! Will try mentioned config. |
Hey @Muennighoff , It's seems that I still can't get a couple of things. Would be very appreciate If you could give me a hand here.
|
There's a t5x ckpt here: https://huggingface.co/bigscience/mt0-t5x For 2. & 3., yes I think so |
This does appear to be XXL
…On Thu, May 18, 2023 at 5:02 AM Niklas Muennighoff ***@***.***> wrote:
There's a t5x ckpt here: https://huggingface.co/bigscience/mt0-t5x
I don't remember which size that model is though; I don't have the other
ones anymore, maybe @adarob <https://github.com/adarob> does
For 2. & 3., yes I think so
—
Reply to this email directly, view it on GitHub
<#19 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AAIJV2APKVDRBUQIFQ6JKQ3XGXQQZANCNFSM6AAAAAAYCE4Z34>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
Thanks a lot, guys! |
Hello!
Thanks a lot for your job! I'm using mT0-xxl for question answering task, however it performs with not so high quality I expected it to do. So I'm trying to finetune the model a little bit. If I understood correctly, first of all I should get checkpoint and gin file for the model I want to finetune. Could you please share with these?
And is it possible to finetune it with torch or tf is the only way?
The text was updated successfully, but these errors were encountered: