Most of my backups fail, thanks to some issue where duplicati has to re-download files because of the downloaded file size was not what was expected. It’ll retry and retry and occasionally it manages to complete, but it fails like 80% of the time.
Like so:
Jun 8, 2019 8:19 PM: Operation Get with file duplicati-b032286bc49da4cd6bae8291968e4e3f3.dblock.zip.aes attempt 2 of 5 failed with message: The file duplicati-b032286bc49da4cd6bae8291968e4e3f3.dblock.zip.aes was downloaded and had size 17947404 but the size was expected to be 52418413
For some reason duplicati is downloading these files very slowly and apparently it gives up. Check out the times: 1st attempt: 6 minutes until it was “completed” at 29 megs; 2nd attempt 4 minutes until it “completed” at 17 megs, 3rd attempt was fast but again only 17 megs downloaded, 4th attempt succeeded but it took a full 10 minutes!
Jun 8, 2019 8:29 PM: Backend event: Get - Completed: duplicati-b032286bc49da4cd6bae8291968e4e3f3.dblock.zip.aes (49.99 MB)
Jun 8, 2019 8:19 PM: Backend event: Get - Started: duplicati-b032286bc49da4cd6bae8291968e4e3f3.dblock.zip.aes (49.99 MB)
Jun 8, 2019 8:19 PM: Backend event: Get - Retrying: duplicati-b032286bc49da4cd6bae8291968e4e3f3.dblock.zip.aes (49.99 MB)
Jun 8, 2019 8:19 PM: Backend event: Get - Completed: duplicati-b032286bc49da4cd6bae8291968e4e3f3.dblock.zip.aes (17.12 MB)
Jun 8, 2019 8:19 PM: Backend event: Get - Started: duplicati-b032286bc49da4cd6bae8291968e4e3f3.dblock.zip.aes (49.99 MB)
Jun 8, 2019 8:19 PM: Backend event: Get - Retrying: duplicati-b032286bc49da4cd6bae8291968e4e3f3.dblock.zip.aes (49.99 MB)
Jun 8, 2019 8:19 PM: Backend event: Get - Completed: duplicati-b032286bc49da4cd6bae8291968e4e3f3.dblock.zip.aes (17.12 MB)
Jun 8, 2019 8:15 PM: Backend event: Get - Started: duplicati-b032286bc49da4cd6bae8291968e4e3f3.dblock.zip.aes (49.99 MB)
Jun 8, 2019 8:15 PM: Backend event: Get - Retrying: duplicati-b032286bc49da4cd6bae8291968e4e3f3.dblock.zip.aes (49.99 MB)
Jun 8, 2019 8:15 PM: Backend event: Get - Completed: duplicati-b032286bc49da4cd6bae8291968e4e3f3.dblock.zip.aes (29.25 MB)
Jun 8, 2019 8:09 PM: Backend event: Get - Started: duplicati-b032286bc49da4cd6bae8291968e4e3f3.dblock.zip.aes (49.99 MB)
The backup files are only 52 megs and I can download them directly from backblaze’s site in a few seconds, so it’s not any actual network issue. I’m struggling to figure out what is going on and what I can do to debug this further.
This has been pretty much always happening since I started using duplicati around 2.0.4.x and I’m currently using 2.0.4.18_canary_2019-05-12. Client is ubuntu 16.04 if that matters.
Does anyone have any ideas or suggestions?