Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update BMS tests to assert correct model was found #7

Open
TheLemonPig opened this issue Jan 6, 2023 · 0 comments
Open

Update BMS tests to assert correct model was found #7

TheLemonPig opened this issue Jan 6, 2023 · 0 comments

Comments

@TheLemonPig
Copy link
Contributor

Currently BMS tests just confirm that the model runs. You can run tests on verbose to manually check to see if they match if you want. In order to add these asserts and have the tests reliably pass when they should will need to:

  • increase the number of epochs that BMS trains for in the tests (this will probably increase how long the tests take by a few minutes)
  • set a seed, because currently BMS does not seem to give the same output (although I thought this was the case in the past) - I guess the seed was accidentally removed at some point
@TheLemonPig TheLemonPig changed the title Update BMS to assert correct model was found Update BMS tests to assert correct model was found Jan 6, 2023
@hollandjg hollandjg transferred this issue from AutoResearch/autora Jun 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant