First of, thank you kindly for making this excellent project available and thank you to everyone taking the time to provide support. I’ve been lurking on the forums for a long time and have learned a lot about how Duplicati works.
The problem:
- Sometimes while running a large backup to WebDAV, my network connection appears to drop for 10-30 seconds.
- This appears to cause a missing file error in AppData.
- In turn corrupting the database.
- None of the common recovery options seems to work. Only deleting and recreating the database (a ~30 hour operation for me).
- The backup will then run fine for days, before succumbing to the same issue again.
Question:
Any tips/pointers on things I should try in order to (1) avoid the issue with missing files or (2) recover without recreating the database?
Unsuccesful attempts to fix:
repair database (Repair not possible, missing 513 blocks.)
purge-broken-files (Unable to start the purge process as there are 6 orphan file(s))
rebuild-missing-dblock-files (Found 16 files that are missing from the remote storage, please run repair)
deleting the faulty backup (denied due to orphan files)
Excluded temporary folder from Windows’ antivirus.
Moved temporary folder to a different location.
verify
compact
Setting http-operation-timeout = 1 day
My setup:
Version: 2.0.5.1 / also attempted 2.0.5.114_canary_2021-03-10
Source: Local files
Destination: Nextcloud via WebDAV (SSL enabled)
The complete errors:
Running the backup:
[Error-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteFiles]: Found 16 files that are missing from the remote storage, please run repair
repair:
[Error-Duplicati.Library.Main.Operation.RepairHandler-CleanupMissingFileError]: Failed to perform cleanup for missing file: duplicati-b40db2c533f27469c805a6584418ef839.dblock.zip.aes, message: Repair not possible, missing 515 blocks.2021-03-24 21:04:00 +01 - [Error-Duplicati.Library.Main.Operation.RepairHandler-CleanupMissingFileError]: Failed to perform cleanup for missing file: duplicati-b1612934ab14d4dfd89858f516eabfde8.dblock.zip.aes, message: Repair not possible, missing 513 blocks.
purge-broken-files:
The operation PurgeBrokenFiles has failed with error: Unable to start the purge process as there are 6 orphan file(s)
rebuild-missing-dblock-files:
2021-03-24 20:42:52 +01 - [Error-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteFiles]: Found 16 files that are missing from the remote storage, please run repair
What I believe may be causing the issue:
System.IO.FileNotFoundException: Could not find file ‘C:\Users<username>\AppData\Local\Temp\dup-5b1345dc-9fb2-473a-b11b-f4f616fa6849’.
Thank you kindly for your time and any pointers.