Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

In some circumstances, import loop stops #167

Open
targos opened this issue Oct 12, 2018 · 3 comments
Open

In some circumstances, import loop stops #167

targos opened this issue Oct 12, 2018 · 3 comments

Comments

@targos
Copy link
Member

targos commented Oct 12, 2018

I've seen two cases:

  • Import stops completely (no more logs)
  • Import continues but doesn't find files anymore (when to_process is not empty)
@targos
Copy link
Member Author

targos commented Nov 20, 2018

I think it's related to NAS storage restarting. We should try to reproduce that in a VM

@targos
Copy link
Member Author

targos commented Nov 23, 2018

I think we should do the import itself in a child process. This will have the interesting side-effect to not require a restart of the import process when the config is updated.

@targos
Copy link
Member Author

targos commented Nov 25, 2018

Other side-effect: if the import process crashes for some reason (for example running out of memory), we would be able to catch this and move the file to errored. Currently it tries to import it over and over

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant