Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

More default experiments and sweeps #54

Open
2 tasks
alex404 opened this issue Oct 30, 2024 · 2 comments
Open
2 tasks

More default experiments and sweeps #54

alex404 opened this issue Oct 30, 2024 · 2 comments
Assignees
Labels
Enhancement Improve an existing feature Simulation Hypotheses/problems to be resolved with simulations

Comments

@alex404
Copy link
Contributor

alex404 commented Oct 30, 2024

Going to try and add a set of default */lindsey.yaml configs for sweeping through the Lindsey et al results. Beyond just having those results on hand, it'll serve the purpose of having a set of simulations that's meant to stable. In contrast, the more generic classification.yaml experiment will adapt to enhancements and features to the library.

  • Develop and add */lindsey.yaml files.
  • Bonus points: See if we can implement a "SOTA" (e.g. alexnet) network on the scaled+shifted data, to provide a better performance upper bound on the task.
@alex404 alex404 added Simulation Hypotheses/problems to be resolved with simulations Enhancement Improve an existing feature labels Oct 30, 2024
@alex404 alex404 self-assigned this Oct 30, 2024
@alex404 alex404 changed the title Lindsey sweep More default experiments/sweeps Oct 30, 2024
@alex404 alex404 changed the title More default experiments/sweeps More default experiments and sweeps Oct 30, 2024
@fabioseel
Copy link
Contributor

bold move to call alexnet state of the art :D
Maybe also a ResNet (or ConvNext as the modernized version), perhaps even pretrained would give a more realistic upper bound

@alex404
Copy link
Contributor Author

alex404 commented Nov 6, 2024

bold move to call alexnet state of the art

That's why I wrote "SOTA" not SOTA ;)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Enhancement Improve an existing feature Simulation Hypotheses/problems to be resolved with simulations
Projects
None yet
Development

No branches or pull requests

2 participants