Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Save copy of labeled data csv to output dir #222

Merged
merged 2 commits into from
Nov 19, 2024

Conversation

ksikka
Copy link
Collaborator

@ksikka ksikka commented Nov 18, 2024

Gives memory of what labeled datapoints were used to train the model, for use in future features.

Additional changes

  • Save files before training starts. This way they exist even if training prematurely dies.
  • Use resolve=True flag of OmegaConf.save which will resolve ${vars} to their strings in the saved config.

@ksikka ksikka marked this pull request as draft November 18, 2024 22:09
@ksikka ksikka force-pushed the detector_outputs_2 branch 2 times, most recently from 90a5674 to c4809b8 Compare November 18, 2024 23:01
@ksikka ksikka force-pushed the detector_outputs_2 branch from c4809b8 to 5f572e2 Compare November 18, 2024 23:01
@ksikka ksikka marked this pull request as ready for review November 18, 2024 23:02
@ksikka
Copy link
Collaborator Author

ksikka commented Nov 18, 2024

Depends on the "Fix is_file" commit from #221

@ksikka ksikka force-pushed the detector_outputs_2 branch from 5f572e2 to 2b28f96 Compare November 18, 2024 23:06
# take care of multiview case, where multiple csv files have been saved
preds_files = [
os.path.join(hydra_output_directory, path) for path in
os.listdir(hydra_output_directory) if path.endswith(".csv")
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reason for changing this was that path.endswith(".csv") was picking up the saved labeled csv files.

@themattinthehatt themattinthehatt merged commit 14ea627 into paninski-lab:main Nov 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants