Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add regularisation selection utility #9

Open
yngvem opened this issue Feb 11, 2020 · 0 comments
Open

Add regularisation selection utility #9

yngvem opened this issue Feb 11, 2020 · 0 comments

Comments

@yngvem
Copy link
Owner

yngvem commented Feb 11, 2020

Selecting the regularisation coefficient can be difficult. It would therefore be useful for a utility that retrains many models (with warm start) and logs the regularisation coefficients as well as which groups are chosen with that regularisation coefficient.

There are two ways to accomplish this, one naive, simply doing a linear or logarithmic search on the group regularisation coefficient. The other approach I can think of is to start with a high regularisation and do a bisecting search for regularisation coefficients that lead to new groups being added and removed from the chosen variables. This latter approach is much more complex but may be implemented if there are interest (or if I have time to spare).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant