Please verify the sha256 hash error

Support
1

Hi all,

New user to duplicati, so far really impressed. However 2 of my backups now have the above titled error.

Documents Backup Error:

Warnings: [
    remote file duplicati-b1e6835cbe55249ce83aa1a67cfe7a087.dblock.zip.aes is listed as Verified with size 50266112 but should be 52337229, please verify the sha256 hash "m4NP9+rhauMms+XyeK9J0OnVIGCVNgBm+5dQejO83x0=",
    remote file duplicati-b9eb5499aecf048a9829a84ba1ebc071f.dblock.zip.aes is listed as Verified with size 1048576 but should be 52393309, please verify the sha256 hash "SqU/lsF1Dzdn+rLPGEfv4SM2Fe16dMHhsDRfQrMvJDA=",
    remote file duplicati-b12f6c0e2d2904745bf87141c85e1a076.dblock.zip.aes is listed as Verified with size 786432 but should be 52345949, please verify the sha256 hash "d99h1bynMNVkLCGqH9pcYXpKz5ZEOmY60UJHlYW7OUk=",
    remote file duplicati-b788fb9cde60341c68e1a565c9539da03.dblock.zip.aes is listed as Verified with size 49811512 but should be 52343501, please verify the sha256 hash "kKiInA9XYilXdKEGqLae3qq2NFfN1AaxKzbyPYaZKG8=",
    remote file duplicati-be0c5617898c44c518ed1a2bfa880e8e6.dblock.zip.aes is listed as Verified with size 2162688 but should be 52387565, please verify the sha256 hash "F/PFn1tllVQqrRm/nER6RxeUDSvgATytye1ZEsse7tw=",
    remote file duplicati-bdbeacd6d5ffe404ba0dec1d0d0d8105d.dblock.zip.aes is listed as Verified with size 1638400 but should be 52377117, please verify the sha256 hash "NBZrjRwPudAr2Nue/4WOYw5GUPLvetAm8sq1xsTBh5k=",
    remote file duplicati-b7f97800bc77f43158e77b2d9f5af4604.dblock.zip.aes is listed as Verified with size 1179648 but should be 52394141, please verify the sha256 hash "eCHsiCzKUIIVW0g4y6D9rroS8fAymWnNymwOeX72eZs=",
    remote file duplicati-b91a0d8d7fc7049229e65c1d4eade21ea.dblock.zip.aes is listed as Verified with size 786432 but should be 52413453, please verify the sha256 hash "kzN9npKMDSR+Sh/32I5/AvKwBmaMi8XFB5foMkzywcA=",
    remote file duplicati-b7e835f7946eb403585286123191e27b3.dblock.zip.aes is listed as Verified with size 851968 but should be 52392845, please verify the sha256 hash "xmbRDrwb9kkdwAyQZuj8EnZWzu0Ia5qSOgefQbzCF7E=",
    remote file duplicati-bd745f42f0e2b416db5062ea84cd1a945.dblock.zip.aes is listed as Verified with size 1507328 but should be 52397373, please verify the sha256 hash "I1wLfq6ciztoKK/VCKlybPfb93DoVgICF3oa1RY3DeU=",
    remote file duplicati-b86b91743cde54743a32c330bc0ce5325.dblock.zip.aes is listed as Verified with size 7274496 but should be 52394685, please verify the sha256 hash "gHERzxg5zwkSSdHSu+TQgcWf4qMaouBj2kHR+dxHn8U=",
    remote file duplicati-b16d31d7a84774f7fb4bd68d58e4198ec.dblock.zip.aes is listed as Verified with size 1048576 but should be 52346077, please verify the sha256 hash "YDbnSE9uDU6v1ExQ9mLso4RoGNZt3E73HwHDkJTIzIw=",
    remote file duplicati-b5b1409b6aef24b14a17b8e235f384b72.dblock.zip.aes is listed as Verified with size 1179648 but should be 52327565, please verify the sha256 hash "Jb9jtwrY8XMCdm5JAmtMHAfGfy0bNEct0+uGBlq4Hrc=",
    remote file duplicati-b7a854b28b3ce43f0a407d531bdee97c1.dblock.zip.aes is listed as Verified with size 404964 but should be 52419677, please verify the sha256 hash "hKwKf39nJbQ/FaGJGEyhgoc/51v6quFPSW/yNzW+4wE=",
    remote file duplicati-b5eba4ebcbd544bdeb7a8600413acb3a5.dblock.zip.aes is listed as Verified with size 1638400 but should be 52348109, please verify the sha256 hash "bLy2w+eiC5ECzE6sc3aQJMVUUmmRDmbuwNGMTPzoAeE=",
    remote file duplicati-b0d0fbd1fc44d405986703c2337186865.dblock.zip.aes is listed as Verified with size 47579136 but should be 52331101, please verify the sha256 hash "r+C+/rhTyMqhLPkKIggWN69x+NURu3kUo73KpfcNa84=",
    remote file duplicati-b8622eab781bb482b8963f1171622ef8c.dblock.zip.aes is listed as Verified with size 1114112 but should be 52413389, please verify the sha256 hash "Q3TGuvh8ctUhMR3nQzk84rocdFweVWKQTr7mPYzG/NU=",
    remote file duplicati-b944f4a2ea5d44aa287508674e0f41212.dblock.zip.aes is listed as Verified with size 34209792 but should be 52329293, please verify the sha256 hash "xZy1OrKT8qkNHoKImmKBM9lk8XdrpygSCitG1O8leqM=",
    remote file duplicati-bcfe1338ccc6b4a5d893280ba6133b981.dblock.zip.aes is listed as Verified with size 1310720 but should be 52385517, please verify the sha256 hash "6X7CA3kZf3Cwb49PjhILgvdwpMjvBVu919Oi/MBziH0=",
    remote file duplicati-b93e2a71676434b4dbb699962abd40c9a.dblock.zip.aes is listed as Verified with size 50266112 but should be 52346381, please verify the sha256 hash "ZJUG0gdvKa2AAfLv3f/NEf+xC/YFJL5FmR1IeOGEiyA=",
    remote file duplicati-b5eb11835838c4c68937dfb6306d029ef.dblock.zip.aes is listed as Verified with size 43712512 but should be 52386877, please verify the sha256 hash "yBzWID5hQbccAUcKd2ealuL61yTl51wNhNO1YVTdIes=",
    remote file duplicati-b72cdd316abc34c3fa53b9caebc07f996.dblock.zip.aes is listed as Verified with size 720896 but should be 52331917, please verify the sha256 hash "bCrIfYKeGZvE40s3P0/LiWwV3LSOceCVhGK6ib+wONA=",
    remote file duplicati-b7bbf05c4846d49a7a95c19661b8994fc.dblock.zip.aes is listed as Verified with size 377520 but should be 52367789, please verify the sha256 hash "4Cih3uNmv/rnJ045qaCO8244RaQhCH4KHIadoNMJDDU=",
    remote file duplicati-be7eefb37f5ca4c23bc0fb9f2e4d99d45.dblock.zip.aes is listed as Verified with size 655360 but should be 52418893, please verify the sha256 hash "eFFOKxy4GJvTkcAm7RQpLEERXUf8guPEtnV4DTm96i4=",
    remote file duplicati-bd209a35d816b49d7801115884923c409.dblock.zip.aes is listed as Verified with size 42336256 but should be 52358269, please verify the sha256 hash "dML5T5d1HlXhaFLVOn8nckIkgniCQU+wOC+KRq0b9O4=",
    remote file duplicati-b6a67ef9f21c74c588b27b94c61600f02.dblock.zip.aes is listed as Verified with size 1114112 but should be 52411773, please verify the sha256 hash "FvJB7Xa48PWz9l1Hz5q+NsiYpFt3/OVJlqbKf5+lByo=",
    remote file duplicati-bf3bd9b79232940519ed4ce061db99c81.dblock.zip.aes is listed as Verified with size 1441792 but should be 52340685, please verify the sha256 hash "HdQqb80CCpIZMFgMIPmwDEit6H9CqJG6c5Vd7lbJbvY=",
    remote file duplicati-bff18ed73e136401892922600020a89ff.dblock.zip.aes is listed as Verified with size 33947648 but should be 52392045, please verify the sha256 hash "YliI76XlL5p7ZzrQWoBinUcx03OGtCEbje4NfNhObPQ=",
    remote file duplicati-baf86500674a34ca6b1680000413340a6.dblock.zip.aes is listed as Verified with size 38993920 but should be 52377085, please verify the sha256 hash "9g/m8Y0bNyQ5B/NTPjEXIfhRsUAKrVLlmlBoIi0fkl8=",
    remote file duplicati-bc244da34192a42ddabc5c2ccc2a668d1.dblock.zip.aes is listed as Verified with size 1572864 but should be 52356061, please verify the sha256 hash "YE5Gc1OhR2ElTgMJyvmL3NwQBvbXY/jlbUepAMA3oWk=",
    remote file duplicati-b9e25cbc21b404e81b36a6bb3d5049f28.dblock.zip.aes is listed as Verified with size 40435712 but should be 52374397, please verify the sha256 hash "hYQO3vakuAXH+GCthZEZFK8zLjj4o/XJf+CWghN6K1o=",
    remote file duplicati-bd572ade9c1b94dabbe1a9dbf35ed6930.dblock.zip.aes is listed as Verified with size 13893632 but should be 52335101, please verify the sha256 hash "tLV7TZKksvY3gsOecLQrbXbdSKLf0JuCA5DvbdW93n8=",
    remote file duplicati-bd17de7b6b11a4d5ba3724ff971ec0eca.dblock.zip.aes is listed as Verified with size 1638400 but should be 52427517, please verify the sha256 hash "smy1IBqwoztRfGxdgLibcfXRdB3gyB7Es2pZVQLnjPc=",
    remote file duplicati-b21fa1fa3813d4ab48f75d3f9bfb6f683.dblock.zip.aes is listed as Verified with size 983040 but should be 52399693, please verify the sha256 hash "nQlG4NlLLBnW+qbVRuJprXavbh8D8e+1HVCpa/pQxj0=",
    remote file duplicati-bd4543e3c2a3e41cdb8e4900d63b584fa.dblock.zip.aes is listed as Verified with size 11796480 but should be 52396413, please verify the sha256 hash "xs7sSVKbrxR3i3oUQRTZPIj8JYT2OAsQ3zEMXrzmdJA=",
    remote file duplicati-b5f5e7199264441c4ab7d9fd6c6dd6582.dblock.zip.aes is listed as Verified with size 1179648 but should be 52418445, please verify the sha256 hash "hAtb7ql2NehUCXmcw89/8uyVUx3G1NSFuySK/h8W6VI=",
    remote file duplicati-b44f7f4c0b4f2466e86211c9ad15b9d6e.dblock.zip.aes is listed as Verified with size 41287680 but should be 52388973, please verify the sha256 hash "59oBNmk+XYMrFMjslvhhVhXh7EdTSWGmDudVgjqWXU0=",
    remote file duplicati-b1e6835cbe55249ce83aa1a67cfe7a087.dblock.zip.aes is listed as Verified with size 50266112 but should be 52337229, please verify the sha256 hash "m4NP9+rhauMms+XyeK9J0OnVIGCVNgBm+5dQejO83x0=",
    remote file duplicati-b9eb5499aecf048a9829a84ba1ebc071f.dblock.zip.aes is listed as Verified with size 1048576 but should be 52393309, please verify the sha256 hash "SqU/lsF1Dzdn+rLPGEfv4SM2Fe16dMHhsDRfQrMvJDA=",
    remote file duplicati-b12f6c0e2d2904745bf87141c85e1a076.dblock.zip.aes is listed as Verified with size 786432 but should be 52345949, please verify the sha256 hash "d99h1bynMNVkLCGqH9pcYXpKz5ZEOmY60UJHlYW7OUk=",
    remote file duplicati-b788fb9cde60341c68e1a565c9539da03.dblock.zip.aes is listed as Verified with size 49811512 but should be 52343501, please verify the sha256 hash "kKiInA9XYilXdKEGqLae3qq2NFfN1AaxKzbyPYaZKG8=",
    remote file duplicati-be0c5617898c44c518ed1a2bfa880e8e6.dblock.zip.aes is listed as Verified with size 2162688 but should be 52387565, please verify the sha256 hash "F/PFn1tllVQqrRm/nER6RxeUDSvgATytye1ZEsse7tw=",
    remote file duplicati-bdbeacd6d5ffe404ba0dec1d0d0d8105d.dblock.zip.aes is listed as Verified with size 1638400 but should be 52377117, please verify the sha256 hash "NBZrjRwPudAr2Nue/4WOYw5GUPLvetAm8sq1xsTBh5k=",
    remote file duplicati-b7f97800bc77f43158e77b2d9f5af4604.dblock.zip.aes is listed as Verified with size 1179648 but should be 52394141, please verify the sha256 hash "eCHsiCzKUIIVW0g4y6D9rroS8fAymWnNymwOeX72eZs=",
    remote file duplicati-b91a0d8d7fc7049229e65c1d4eade21ea.dblock.zip.aes is listed as Verified with size 786432 but should be 52413453, please verify the sha256 hash "kzN9npKMDSR+Sh/32I5/AvKwBmaMi8XFB5foMkzywcA=",
    remote file duplicati-b7e835f7946eb403585286123191e27b3.dblock.zip.aes is listed as Verified with size 851968 but should be 52392845, please verify the sha256 hash "xmbRDrwb9kkdwAyQZuj8EnZWzu0Ia5qSOgefQbzCF7E=",
    remote file duplicati-bd745f42f0e2b416db5062ea84cd1a945.dblock.zip.aes is listed as Verified with size 1507328 but should be 52397373, please verify the sha256 hash "I1wLfq6ciztoKK/VCKlybPfb93DoVgICF3oa1RY3DeU=",
    remote file duplicati-b86b91743cde54743a32c330bc0ce5325.dblock.zip.aes is listed as Verified with size 7274496 but should be 52394685, please verify the sha256 hash "gHERzxg5zwkSSdHSu+TQgcWf4qMaouBj2kHR+dxHn8U=",
    remote file duplicati-b16d31d7a84774f7fb4bd68d58e4198ec.dblock.zip.aes is listed as Verified with size 1048576 but should be 52346077, please verify the sha256 hash "YDbnSE9uDU6v1ExQ9mLso4RoGNZt3E73HwHDkJTIzIw=",
    remote file duplicati-b5b1409b6aef24b14a17b8e235f384b72.dblock.zip.aes is listed as Verified with size 1179648 but should be 52327565, please verify the sha256 hash "Jb9jtwrY8XMCdm5JAmtMHAfGfy0bNEct0+uGBlq4Hrc=",
    remote file duplicati-b7a854b28b3ce43f0a407d531bdee97c1.dblock.zip.aes is listed as Verified with size 404964 but should be 52419677, please verify the sha256 hash "hKwKf39nJbQ/FaGJGEyhgoc/51v6quFPSW/yNzW+4wE=",
    remote file duplicati-b5eba4ebcbd544bdeb7a8600413acb3a5.dblock.zip.aes is listed as Verified with size 1638400 but should be 52348109, please verify the sha256 hash "bLy2w+eiC5ECzE6sc3aQJMVUUmmRDmbuwNGMTPzoAeE=",
    remote file duplicati-b0d0fbd1fc44d405986703c2337186865.dblock.zip.aes is listed as Verified with size 47579136 but should be 52331101, please verify the sha256 hash "r+C+/rhTyMqhLPkKIggWN69x+NURu3kUo73KpfcNa84=",
    remote file duplicati-b8622eab781bb482b8963f1171622ef8c.dblock.zip.aes is listed as Verified with size 1114112 but should be 52413389, please verify the sha256 hash "Q3TGuvh8ctUhMR3nQzk84rocdFweVWKQTr7mPYzG/NU=",
    remote file duplicati-b944f4a2ea5d44aa287508674e0f41212.dblock.zip.aes is listed as Verified with size 34209792 but should be 52329293, please verify the sha256 hash "xZy1OrKT8qkNHoKImmKBM9lk8XdrpygSCitG1O8leqM=",
    remote file duplicati-bcfe1338ccc6b4a5d893280ba6133b981.dblock.zip.aes is listed as Verified with size 1310720 but should be 52385517, please verify the sha256 hash "6X7CA3kZf3Cwb49PjhILgvdwpMjvBVu919Oi/MBziH0=",
    remote file duplicati-b93e2a71676434b4dbb699962abd40c9a.dblock.zip.aes is listed as Verified with size 50266112 but should be 52346381, please verify the sha256 hash "ZJUG0gdvKa2AAfLv3f/NEf+xC/YFJL5FmR1IeOGEiyA=",
    remote file duplicati-b5eb11835838c4c68937dfb6306d029ef.dblock.zip.aes is listed as Verified with size 43712512 but should be 52386877, please verify the sha256 hash "yBzWID5hQbccAUcKd2ealuL61yTl51wNhNO1YVTdIes=",
    remote file duplicati-b72cdd316abc34c3fa53b9caebc07f996.dblock.zip.aes is listed as Verified with size 720896 but should be 52331917, please verify the sha256 hash "bCrIfYKeGZvE40s3P0/LiWwV3LSOceCVhGK6ib+wONA=",
    remote file duplicati-b7bbf05c4846d49a7a95c19661b8994fc.dblock.zip.aes is listed as Verified with size 377520 but should be 52367789, please verify the sha256 hash "4Cih3uNmv/rnJ045qaCO8244RaQhCH4KHIadoNMJDDU=",
    remote file duplicati-be7eefb37f5ca4c23bc0fb9f2e4d99d45.dblock.zip.aes is listed as Verified with size 655360 but should be 52418893, please verify the sha256 hash "eFFOKxy4GJvTkcAm7RQpLEERXUf8guPEtnV4DTm96i4=",
    remote file duplicati-bd209a35d816b49d7801115884923c409.dblock.zip.aes is listed as Verified with size 42336256 but should be 52358269, please verify the sha256 hash "dML5T5d1HlXhaFLVOn8nckIkgniCQU+wOC+KRq0b9O4=",
    remote file duplicati-b6a67ef9f21c74c588b27b94c61600f02.dblock.zip.aes is listed as Verified with size 1114112 but should be 52411773, please verify the sha256 hash "FvJB7Xa48PWz9l1Hz5q+NsiYpFt3/OVJlqbKf5+lByo=",
    remote file duplicati-bf3bd9b79232940519ed4ce061db99c81.dblock.zip.aes is listed as Verified with size 1441792 but should be 52340685, please verify the sha256 hash "HdQqb80CCpIZMFgMIPmwDEit6H9CqJG6c5Vd7lbJbvY=",
    remote file duplicati-bff18ed73e136401892922600020a89ff.dblock.zip.aes is listed as Verified with size 33947648 but should be 52392045, please verify the sha256 hash "YliI76XlL5p7ZzrQWoBinUcx03OGtCEbje4NfNhObPQ=",
    remote file duplicati-baf86500674a34ca6b1680000413340a6.dblock.zip.aes is listed as Verified with size 38993920 but should be 52377085, please verify the sha256 hash "9g/m8Y0bNyQ5B/NTPjEXIfhRsUAKrVLlmlBoIi0fkl8=",
    remote file duplicati-bc244da34192a42ddabc5c2ccc2a668d1.dblock.zip.aes is listed as Verified with size 1572864 but should be 52356061, please verify the sha256 hash "YE5Gc1OhR2ElTgMJyvmL3NwQBvbXY/jlbUepAMA3oWk=",
    remote file duplicati-b9e25cbc21b404e81b36a6bb3d5049f28.dblock.zip.aes is listed as Verified with size 40435712 but should be 52374397, please verify the sha256 hash "hYQO3vakuAXH+GCthZEZFK8zLjj4o/XJf+CWghN6K1o=",
    remote file duplicati-bd572ade9c1b94dabbe1a9dbf35ed6930.dblock.zip.aes is listed as Verified with size 13893632 but should be 52335101, please verify the sha256 hash "tLV7TZKksvY3gsOecLQrbXbdSKLf0JuCA5DvbdW93n8=",
    remote file duplicati-bd17de7b6b11a4d5ba3724ff971ec0eca.dblock.zip.aes is listed as Verified with size 1638400 but should be 52427517, please verify the sha256 hash "smy1IBqwoztRfGxdgLibcfXRdB3gyB7Es2pZVQLnjPc=",
    remote file duplicati-b21fa1fa3813d4ab48f75d3f9bfb6f683.dblock.zip.aes is listed as Verified with size 983040 but should be 52399693, please verify the sha256 hash "nQlG4NlLLBnW+qbVRuJprXavbh8D8e+1HVCpa/pQxj0=",
    remote file duplicati-bd4543e3c2a3e41cdb8e4900d63b584fa.dblock.zip.aes is listed as Verified with size 11796480 but should be 52396413, please verify the sha256 hash "xs7sSVKbrxR3i3oUQRTZPIj8JYT2OAsQ3zEMXrzmdJA=",
    remote file duplicati-b5f5e7199264441c4ab7d9fd6c6dd6582.dblock.zip.aes is listed as Verified with size 1179648 but should be 52418445, please verify the sha256 hash "hAtb7ql2NehUCXmcw89/8uyVUx3G1NSFuySK/h8W6VI=",
    remote file duplicati-b44f7f4c0b4f2466e86211c9ad15b9d6e.dblock.zip.aes is listed as Verified with size 41287680 but should be 52388973, please verify the sha256 hash "59oBNmk+XYMrFMjslvhhVhXh7EdTSWGmDudVgjqWXU0="
]
Errors: []

Videos Backup Error:

Warnings: [
    remote file duplicati-bdde9d7032f014ba4bd2cca8f549095f8.dblock.zip.aes is listed as Verified with size 524288 but should be 52418701, please verify the sha256 hash "GuZzrt9PkmVkjG5CgNjzBKJ2+RidkuqVick2g3AFr6I=",
    remote file duplicati-bdde9d7032f014ba4bd2cca8f549095f8.dblock.zip.aes is listed as Verified with size 524288 but should be 52418701, please verify the sha256 hash "GuZzrt9PkmVkjG5CgNjzBKJ2+RidkuqVick2g3AFr6I="
]
Errors: []

I have checked a few of these files and they are different sizes. Is there a repair i can run, or are these now corrupt backups?

Thanks,

Tony

2

Anyone have any ideas?

3

Looks like i’ll have to delete my current backups and start again. I would rather fix the issue however.

4

OK so i found this post - Please verify the sha256 hash? - #11 by Kenny and kenkendk comment:

So i tried this and then ran a backup and no errors. So i’ll keep an eye on this one.

5

Hi @showstopper, welcome to the forum!

Sorry for not catching this sooner - sometimes real life intrudes on the things we’d rather be doing. :slight_smile:

Since the incorrectly sized files were dblock files, there isn’t much you can do other than what you did. The dblock files are where the actual versioned backup data is stored so if something is wrong with the file we can’t really go back to “the source” to rebuild it.

Please let do us know if this happens to you again and, if so, include the version of Duplicati you are using as well as what destination.

6

Hi JonMikeIV,

Thanks for replying. Yeah i am not sure why this broke but everything seems OK now, once i did that procedure.

7

Glad it’s still working OK. I went ahead and flagged your post as the “solution” in case anybody else runs into it.

1 Like
8

OK this has happened again now - what can i do to troubleshoot the problem here, as i can see this becoming a bit of a (no pun intended) showstopper if this keeps failing:

Messages: [
    removing file listed as Temporary: duplicati-bcde47d0d7b16440b9e4973fadeebb3af.dblock.zip.aes,
    removing file listed as Temporary: duplicati-ia00c280d361a4462823cf6c46c064244.dindex.zip.aes
]
Warnings: [
    remote file duplicati-b370ce81149c2414db26f320edafa3c7d.dblock.zip.aes is listed as Verified with size 37814272 but should be 52377005, please verify the sha256 hash "L+0jzrSFpeSz1h/wLXiFu3i8msZs/Wz90n0NSnEW+H0=",
    remote file duplicati-b09483b6e490a4277867fe226520fb478.dblock.zip.aes is listed as Verified with size 43843584 but should be 52370413, please verify the sha256 hash "BAfx4sDmImyJVb4TT4kDy42uJFmGOmZm8mhmAmD/a2U=",
    remote file duplicati-b370ce81149c2414db26f320edafa3c7d.dblock.zip.aes is listed as Verified with size 37814272 but should be 52377005, please verify the sha256 hash "L+0jzrSFpeSz1h/wLXiFu3i8msZs/Wz90n0NSnEW+H0=",
    remote file duplicati-b09483b6e490a4277867fe226520fb478.dblock.zip.aes is listed as Verified with size 43843584 but should be 52370413, please verify the sha256 hash "BAfx4sDmImyJVb4TT4kDy42uJFmGOmZm8mhmAmD/a2U="
]
Errors: []

The files are all different sizes.

Duplicati unraid docker - Duplicati - 2.0.3.3_beta_2018-04-02
Netgear ReadyNAS as local storage location
5 backup jobs - but this one keeps failing (it is the largest backup though)

9

Are you mounting your ReadyNAS with CIFS? If so, try NFS instead.

10

Pretty sure it’s NFS - the other 4 jobs seem OK at the moment.

11

Well the issue is that the local database thinks the file should be size X while the destination is reporting the file as size Y.

Unfortunately, we don’t know which size is correct so I’d suggest trying the affected command one one of the files to see what backups use that file. Make note of a few of the affected files / versions and try restore of those files (being sure to use the --no-local-blocks=true parameter so Duplicati is ONLY using the remote data).

If the restore fails, then most likely the remote files have gotten corrupted somehow and there’s not much to do other than purge the broken files.

If the restore succeeds, then most likely the local database has gotten screwed up somehow in which case a database Repair (or Recreate, if necessary) should re-align things.

12

The sizes of the damaged files are suspiciously binary (pasted some into Windows Calculator in Programmer mode), many are 4 KB multiples (making me think Windows cluster size or 4 KB drive sector), but at least one wound up not a multiple of 4 KB but a multiple of 512 bytes (drive sector?). I didn’t look at ALL the file sizes…

Windows efforts to repair a filesystem might cause chops at cluster size boundaries, but that 512 puzzles me.

File names and sizes are often logged when files go to the backend, If you want to look for the original view…
–dblock-size defaults to 50mb, so dblock files of that size would be normal for a substantial backup increment.

13

More searching in the forum makes me think @haus suggested NFS based on personal experience, such as

Please verify the sha256 hash?
Restore failed 2 files

and maybe others. Despite the believed use of NFS in the current issue, maybe forum posts have some ideas. One key question is whether full-length files made it to the NAS disk, got damaged there, or size read wrong…

14

I am using NFS. I only seem to get errors for this particular backup job, although it is the largest job.
Not sure what to do if it does fail again. I may completely remove the job and try again.

15

NFS has many options, if one is up for experiments. I assume this is Linux, so here’s a sample nfs man page. Some options, such as nfs versions, or udp versus tcp, probably depend on what this ReadyNAS will support, while others, such as soft versus hard mounts, might be dependent entirely on the client. Even if nothing gets changed in the options, trying to characterize the problem will help, especially if a non-Duplicati use can get it.

To confirm loss at end of the file (or at least not the start), the start of any short file should be characters AES.

16

If you have the time/bandwidth I’d suggest doing a full backup test as described here:

This will essentially download ALL your remote files and make sure they are decryptable and uncompressable. If that comes back with no errors, then we know what’s up there now is good.

If at some point in the future you get these errors again and they are for files that were created before above test process, then we can be pretty sure the issue happened AFTER Duplicati put it on the Destination. So either a problem at the destination or during the download caused the corrupted.

At least in theory.

@kenkendk or @Pectojin , how hard would it be to add “last verified date” to remote file warnings (like the “Verified with size…” ones in the original post)?

17

Thanks for all your help. So far i haven’t had the failure messages again. If it does happen i will do the test\verify and then report back.

1 Like