Duplicati and S3 Glacier Deep Archive

Support
1

Hi,
In an attempt to reduce storage costs, while still using AWS S3, I have set up a life cycle rule to push the database files (dblock.zip.aes) too Deep Archive. I keep the lists (dlist.zip.aes) in standard-IA. For me this backup is only for emergency off-site backup, as I also have local backups, and I accept the difficulties in restoring the files (getting the files back from Deep Archive to standard-IA).
I now experience that Duplicati is trying to verify some blocks at the end of the backup. As this is not possible (because they are in Deep Archive), this results in verification errors. As the verification is at the end of the backup task, I assume the backup is still successful.

Is it possible to disable verification of the blocks, and only verify the dlist files?

2

No.

backup-test-samples=0 will stop that, and also dindex and dlist. They’re a set.

Presumably you already have no-auto-compact set, as compact will do reads.

3

As @ts678 mentions, it is not currently possible.

I have a PR here that will add that feature.
The way it works is by reading the storage class of each object during the file listing, and then avoid verification on any files that are in one of the “unavailable” classes.

I have been holding off on merging it because it changes the database schema, but I will revisit and see if I can either do a better roll-back feature for the database or implement this without having the archive attribute stored in the database.