Backup S3-compatible bucket using Rustic

[Wouter0100]

It would be really nice to, instead of a filesystem or stdin, backup a S3-compatible bucket using rustic.

I've tried various techniques (rclone mount for example) and then read that mount by rustic, but it's very inefficient in deciding what files are changed and results in a lot of API calls to S3. I think it should be able to do it more efficient.

[bebehei]

hey @Wouter0100 I'm having the same issue, I'm currently testing it with Hetzner S3 storeage and rustic 0.7.

You might want to look at #1044 and #1045.

Apparently the s3:... endpoint is canceled and opendal:s3 should be used. I'm currently testing this while writing this comment.

The docs right now are confusing, because there is no separate section in the docs, but "Other services using rclone" pointing into the direction of rclone, but not opendal.

[simonsan]

The docs right now are confusing, because there is no separate section in the docs, but "Other services using rclone" pointing into the direction of rclone, but not opendal.

That's right, I think that is missing, and I started to work on it in: rustic-rs/docs#90

[aawsome]

Note that we are talking about two things here: opendal providing access to the repository and opendal as a source to run backups on (which will then be stored in a repository, independent from how to access this).

For the first, most is implemented but docu and edge case handling needs improvement.
For the second, we don't have an implementation yet.

[Wouter0100]

Yes, my feature request was for the second part. Being able to backup a S3 bucket (for example, using opendal) towards a rustic repository somewhere.

[simonsan]

@bebehei the documentation is now live: https://rustic.cli.rs/docs/commands/init/services.html

Is that sufficient for you? If not, we would welcome a pull request against the docs. Cheers!

[bebehei]

I just had been successful adding a S3 repo into my storage. Thanks for fixing this so fast!

Docs seem to be very fine. There is a copy-pastable example and link to the reference. Thats everything you need, when you start fresh.