Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Frequency Adjusted Adjacent Words #26

Open
drewwc opened this issue Mar 25, 2023 · 0 comments
Open

Frequency Adjusted Adjacent Words #26

drewwc opened this issue Mar 25, 2023 · 0 comments

Comments

@drewwc
Copy link

drewwc commented Mar 25, 2023

Hello, I love ngram type, and I've been using it for awhile now, but there is something that I think could help improve the words feature even more. Whenever you use the words feature, it doesn't give any importance (or at least not much) to adjacent words that have a higher frequency of occurrence whenever we use English. For example, whenever I choose a combination of 2 and a repetition of 1, uncommon or nonsensical combinations show up repeatedly, such as "a have" or "the be". This is a pretty big opportunity cost whenever you practice and could be fixed, but is exponentially costly the more words you explore, so a limit of the ten most commonly used words in English might be something to explore for this problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant