Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automatically stream samples for sample-based inferences #62

Open
mhtess opened this issue Feb 7, 2019 · 0 comments
Open

Automatically stream samples for sample-based inferences #62

mhtess opened this issue Feb 7, 2019 · 0 comments

Comments

@mhtess
Copy link
Owner

mhtess commented Feb 7, 2019

Currently, the webppl team is investigating using callbacks to support streaming samples to disk. Once this pull request is merged, we should investigate defaulting to this option (with the additional onlyMAP: true option for inference methods) to incrementally stream the samples to file (e.g., when user is using MCMC, incrementalMH, SMC). We already write the samples to file, so this will just incrementalize the process and save lots of memory.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant