Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

NER #1

Open
eltonteb opened this issue Mar 29, 2024 · 2 comments
Open

NER #1

eltonteb opened this issue Mar 29, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@eltonteb
Copy link

Facility for running Named Entity Recogition to automatically identify place entities
@rsimon rsimon added the enhancement New feature or request label Mar 29, 2024
@rsimon
Copy link
Member

rsimon commented Apr 4, 2024

This is a bigger lift, and won't fit this project round any more. But, in the spirit of building light & portable solutions: I wonder if it's worth looking into browser-based solutions with TensorFlow.js or Transformers.js at some point?

@rsimon
Copy link
Member

rsimon commented Apr 4, 2024 •
edited
Loading

FWIW: the results with Transformers.js are pretty good. However the model used in this case (BERT multilingual) is a 178MB download that the user would have to load into their browser on startup.

A smaller possible option to try could be this one: https://huggingface.co/dslim/distilbert-NER

Bildschirmfoto 2024-04-04 um 14 22 21

https://xenova.github.io/transformers.js/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@rsimon @eltonteb