Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

nexus-writer: finer grained separation of files in local directory #321

Open
DanNixon opened this issue Feb 26, 2025 · 0 comments
Open

nexus-writer: finer grained separation of files in local directory #321

DanNixon opened this issue Feb 26, 2025 · 0 comments
Assignees

Comments

@DanNixon
Copy link
Member

Problem this feature will solve

The nexus-writer should be able to handle the case where files cannot be copied to the archive directory.
Currently, it cannot cope with the situation where a copy fails.

Description of solution

  • Have two directories in the local directory: working and completed
  • working should only ever contain one file: the one currently being written
  • Any files in working on startup are assumed to be incomplete after a crash and are handled as they currently are
  • When a file is completed, it is first moved from working to completed, after this it can be attempted to be copied to the archive
  • Only after a successful copy should the file in completed be removed
  • nexus-writer should try on startup and periodically to move any files still in completed to the archive, the interval should be configurable
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Backlog
Development

No branches or pull requests

2 participants