Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

is this still being worked on? #28

Open
CoffeeShifter opened this issue Jul 18, 2024 · 4 comments
Open

is this still being worked on? #28

CoffeeShifter opened this issue Jul 18, 2024 · 4 comments

Comments

@CoffeeShifter
Copy link

when can we expect updates?

@EthanC111
Copy link
Collaborator

Hi @CoffeeShifter , thank you for your interest! We have made several small updates: the demo and the multimodal inference inference script. We will be making new updates soon! Stay tuned!

@CoffeeShifter
Copy link
Author

This lack of (public) progress is frightening

@EthanC111
Copy link
Collaborator

Hi @CoffeeShifter thank you for your interest!
Indeed we encounter several technical issues (data mixing, qk norm weights allocation) while finetuning Chameleon on 7b and 34b model for multimodal data. We are trying our best to find the best training recipe at this moment. We will update the repo as soon as we find the recipe. Thank you!

@hectorcarrion
Copy link

Any updates?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants