Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request to add MobileBert #50

Open
msahamed opened this issue May 8, 2020 · 0 comments
Open

Request to add MobileBert #50

msahamed opened this issue May 8, 2020 · 0 comments

Comments

@msahamed
Copy link

msahamed commented May 8, 2020

Request to add MobileBert

I would like to request to add MobileBert, since it is smaller and faster. The following texts are also a request from huggingface/transformers#4185:

New model addition
This issue is to request adding the MobileBERT model, which was recently released by Carnegie Mellon University, Google Research, and Google Brain.

Model description
MobileBERT is a more computationally-efficient model for achieving BERT-base level accuracy on a smartphone.

Open source status
The model implementation is available: https://github.com/google-research/google-research/tree/master/mobilebert

Model weights are available: uncased_L-24_H-128_B-512_A-4_F-4_OPT (MobileBERT Optimized Uncased English)

Authors: Zhiqing Sun, Hongkun Yu (@saberkun), Xiaodan Song, Renjie Liu, Yiming Yang, Denny Zhou

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant