Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add emu3 support to the transformers backend #3685

Open
mudler opened this issue Sep 28, 2024 · 2 comments
Open

Add emu3 support to the transformers backend #3685

mudler opened this issue Sep 28, 2024 · 2 comments
Labels
enhancement New feature or request roadmap

Comments

@mudler
Copy link
Owner

mudler commented Sep 28, 2024

Is your feature request related to a problem? Please describe.

https://github.com/baaivision/Emu3

Describe the solution you'd like

Describe alternatives you've considered

Additional context

@mudler mudler added enhancement New feature or request roadmap labels Sep 28, 2024
@siddimore
Copy link
Contributor

@mudler if you have some context to provide on the integration of this i could look into adding this

@mudler
Copy link
Owner Author

mudler commented Oct 2, 2024

@mudler if you have some context to provide on the integration of this i could look into adding this

that'd be great! As now emu3 seems to be working directly with transformers it would not need an entire backend from scratch, but actually adapting the existing transformers one to support how to run emu3 models (see https://github.com/baaivision/Emu3?tab=readme-ov-file#quickstart for example). The transformer backend is here https://github.com/mudler/LocalAI/tree/master/backend/python/transformers

@mudler mudler changed the title Add emu3 backend Add emu3 support to the transformers backend Oct 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request roadmap
Projects
None yet
Development

No branches or pull requests

2 participants