Verify sha256 hash

1

Hello,

The past couple of days I’ve been getting the following backup warning:

* 2020-02-17 19:53:47 +00 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-bdedcaa78f933440c93db47148f89443e.dblock.zip.aes is listed as Uploaded with size 0 but should be 5447629, please verify the sha256 hash "Zo5BVHRu7KMVt7PQCRZY7qXPSxpzPQIY8taTYbDXjFM=" * 2020-02-17 19:53:57 +00 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-bdedcaa78f933440c93db47148f89443e.dblock.zip.aes is listed as Uploaded with size 0 but should be 5447629, please verify the sha256 hash "Zo5BVHRu7KMVt7PQCRZY7qXPSxpzPQIY8taTYbDXjFM="

The file is infact 0 bytes when I check the remote SMB backup share.

I’ve tried to delete the dblock file and run purge broken files command but I then got an error about orphaned files, so purge couldn’t run.

Any suggestions? I’m stuck at the moment.

Thanks.

2

Update - I restored the 0 byte dblock I deleted, then backed up my Database, then ran a “Recreate (Delete and repair)” on the database, once this was done I was able to delete the 0 byte dblock and run purge broken files without the Orphan file message.
Ran the backup again and no errors.

3

Welcome to the forum @egtrev

Backing up to an SMB destination seems to be a common source of troubles. Sometimes they’re very solid (at least one person moved to NFS for reliability), other times the suspicion is that an intermittent connection (e.g. laptop moving around) contributed. Your file was believed to be uploaded, but wasn’t.

Although zero is a special number, sometimes files are non-zero-short with a round size inhexadecimal. Although this has been observed, I’m not sure if a reproducible case has been available to be looked at (and even if that were the case, the conclusion might be that Duplicati did OK, and SMB dropped data).

Is Duplicati on Windows, Linux, or something else? There might be some client-side tweaks to help this.
Please verify the sha256 hash? helped Linux, and Windows has some options. What’s the destination? Unfortunately I’m not personally familiar with all the tricks to help SMB, but I can see that some exist…

4

It’s on Windows 10 backing up to a SMB share (on a local Linux NAS).
I believe the issue started when I had my laptop outside of the local network, but temporary connected to my local VPN, so the local Duplicati backup went ahead because the SMB destination was temporary available over the VPN, I’m thinking the connection got lost at some point causing it to not backup correctly. When I ran the list broken files command, the broken files/dates matched when I was not at home. Backup has been solid for a year now and my B2/Google Cloud Duplciati backup was not affected.

5

The cloud backups are probably more reliable (in a way) because they don’t try to accept data from Duplicati for later delivery. If it fails (which it will if there’s no connectivity), it fails right then and there subject to –number-of-retries before any error. If it finally errors, it should pick up on the next backup.

Anyway, I’m glad you’ve got several backups (good idea) and even SMB seems to not be intolerable.

6

I hope it’s OK to continue an old thread.

I am now getting the same message for one of my backup jobs. Each time I run the job, I get six of these messages. When I run the "check file"or whatever it is called in English, I get three of these messages.

I can see in this thread the steps the OP needed to recify the situation, but in this heat I have trouble understanding why to re-create the database (as the problem is elsewhere) and what is “run purge broken files” exactly. In other words, which command do I need to run, and what exactly is it needed for.

Most importantly, do I lose or have I already lost some of the backed-up data?

7

0 byte destination files, or some other unexpected sizes? Can you give examples of the sizes reported?

Do the files look that size to you, examined from the local system and (if possible) from the destination?

Are the file dates on the affected files recent or variable to the extent you know? Might be a new problem, which might be a good thing because loss of older files might affect more files due to block deduplication using old blocks for new files that happen to have the same block. Can’t tell without some testing though.

What destination type?

Is the Advanced option backup-test-samples set to something more than 1 (which is 1 set of three files)?
The TEST command can be set to all and run in Commandline if you want to download and test all files.
This can take a long time, of course. If the destination is directly accessible from an OS that does scripts, upload-verification-file with utility-scripts\DuplicatiVerify.{py,ps1} is another way to verify integrity of all files.

The AFFECTED command can answer that. Tell it whatever backup files appear to have gotten corrupted.
Generally if you’re getting complaints about some files, those files are kept for a reason, so there’s impact.

Disaster Recovery is a lab exercise which intentionally damages files, then shows how to trim off damage so that backup and restore can continue on undamaged portions. One thing that either changed or wasn’t documented correctly is that damaged files need to be removed manually, or moved to some other folder.

8

Thank you for the help.

Usually I would do the research and fix it, but right now I am in a precarious family situation and cannot invest my time in digging it all up. So I will just tell what I have and then create a new job to replace the current one, as I really don’t have time to go the long way.

I have Duplicati - 2.0.6.1_beta_2021-05-03, the backup destination is an external disk connected via USB cable, and since the disk is encrypted, the job isn’t. The reason why I am happy to create a new job and remove the old is that this particular job only has one single file in it, an encrypted file that I open with “cryptmount” tool. I will later replace it with multiple “tomb” files, but for now, I have to concentrate on domestic problems.

9

Thx egtrev. I got the same error and ran your solution and it works perfect.
I had this 0 byte dblock because of an webdav smb share with a bad connection.

It would be great to have an option in Duplicati called “Allways repair 0 bytes dblock files after backup”.

That should do the following:

  • backed up the database,
  • ran a “Recreate (Delete and repair)” on the database
  • delete the 0 byte dblock files
  • run purge broken files
    • without:
      • Commandline arguments
      • exclude
  • run the backup one time again
1 Like
10

Did you first try purge-broken-files (risky) or list-broken-files (safer start) without the Recreate step?
Recovering by purging files gets into this but might be forgetting to talk about manual dblock deletes.
Going right to Recreate will start an extremely long action on big backups that aren’t configured well.

Could you tell how old that file was? If a connection fails, Duplicati is supposed to be able to deal with destination messes. An upload goes through multiple states – Uploading, Uploaded, Verified, and isn’t considered fully “done” until Verified. That is not a download, but seeing that file looks good in a listing.

If you like, you can open it yourself with DB Browser for SQLite to see what Remotevolume table says.

Alternatively you could slip old DB back in during some idle time, do Create bug report, post a link to it, reinstall current database, and let someone else attempt to figure out the history behind the empty file.

1 Like
11

It was a new Duplicati backup. I didn’t worry about the data. I had a bitrix24 netfolder which i created with net use u: https://...... The backup run to the local drive u:
I would rather access the bitrix drive directly via duplicati. But I could not get that to work.
I’m running a new backup and i will try purge files when the warnings come back and there are 0 bytes files.

12

Today the backup get finished.
list-broken-files shows 4 files.
purge-broken-files shows the following:

  Listing remote folder ...
remote file duplicati-b7429655e285e4782b5e6bb1921f8c9fa.dblock.zip.aes is listed as Uploaded with size 0 but should be 52347053, please verify the sha256 hash "yv5oXf2vng+6APE1q1roxRUcQ3NpmiJzwlehuvv+zrY="
remote file duplicati-bd40721a8356741bdaf6a918f7079359d.dblock.zip.aes is listed as Uploaded with size 0 but should be 52370269, please verify the sha256 hash "YbWzniz/Q8anzLvpYggVC2R2jNOT4QwCRa1JepFlxts="
remote file duplicati-bd24595c5185049ea856fa8d7d2f6c516.dblock.zip.aes is listed as Uploaded with size 0 but should be 52402733, please verify the sha256 hash "PPFFjsUDySK4i75BYFbR9cj5k4J1+oMD6n++lMQoV6A="
remote file duplicati-bd2394b0643334078a94c21318e82aa15.dblock.zip.aes is listed as Uploaded with size 0 but should be 52358829, please verify the sha256 hash "DjupSjpQVS5s786ELbjZOWj2oNAM4T1a1iMhMo4/Fzk="
Return code: 0

The files were not deleted. Then i deleted the files and start the Backup: Found 4 files that are missing from the remote storage, please run repair

Then i restore the 4 files.

After that i could run the backup but got 8 warnings.

2021-10-14 11:53:01 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-b7429655e285e4782b5e6bb1921f8c9fa.dblock.zip.aes is listed as Uploaded with size 0 but should be 52347053, please verify the sha256 hash "yv5oXf2vng+6APE1q1roxRUcQ3NpmiJzwlehuvv+zrY="
2021-10-14 11:53:01 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-bd40721a8356741bdaf6a918f7079359d.dblock.zip.aes is listed as Uploaded with size 0 but should be 52370269, please verify the sha256 hash "YbWzniz/Q8anzLvpYggVC2R2jNOT4QwCRa1JepFlxts="
2021-10-14 11:53:01 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-bd24595c5185049ea856fa8d7d2f6c516.dblock.zip.aes is listed as Uploaded with size 0 but should be 52402733, please verify the sha256 hash "PPFFjsUDySK4i75BYFbR9cj5k4J1+oMD6n++lMQoV6A="
2021-10-14 11:53:01 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-bd2394b0643334078a94c21318e82aa15.dblock.zip.aes is listed as Uploaded with size 0 but should be 52358829, please verify the sha256 hash "DjupSjpQVS5s786ELbjZOWj2oNAM4T1a1iMhMo4/Fzk="
2021-10-14 11:53:04 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-b7429655e285e4782b5e6bb1921f8c9fa.dblock.zip.aes is listed as Uploaded with size 0 but should be 52347053, please verify the sha256 hash "yv5oXf2vng+6APE1q1roxRUcQ3NpmiJzwlehuvv+zrY="
2021-10-14 11:53:04 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-bd40721a8356741bdaf6a918f7079359d.dblock.zip.aes is listed as Uploaded with size 0 but should be 52370269, please verify the sha256 hash "YbWzniz/Q8anzLvpYggVC2R2jNOT4QwCRa1JepFlxts="
2021-10-14 11:53:04 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-bd24595c5185049ea856fa8d7d2f6c516.dblock.zip.aes is listed as Uploaded with size 0 but should be 52402733, please verify the sha256 hash "PPFFjsUDySK4i75BYFbR9cj5k4J1+oMD6n++lMQoV6A="
2021-10-14 11:53:04 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-bd2394b0643334078a94c21318e82aa15.dblock.zip.aes is listed as Uploaded with size 0 but should be 52358829, please verify the sha256 hash "DjupSjpQVS5s786ELbjZOWj2oNAM4T1a1iMhMo4/Fzk="

Then i run "Recreate (Delete and repair)” on the database and get 20 warnings.

2021-10-14 13:00:11 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-b0e292bd659e44991840eea0d42cfaff5.dblock.zip.aes is listed as Uploaded with size 0 but should be 104824781, please verify the sha256 hash "er1r8qLoVJ4MNnoafUi9I5xsC7v8PxKsd7FpvQodwnM="
2021-10-14 13:00:11 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-be814903db2a6450e82bbaca176363641.dblock.zip.aes is listed as Uploaded with size 0 but should be 104779725, please verify the sha256 hash "++Pn/XNX27IIhHl0s/LM3OZHKK6NlqOzaXD0o8X8Euo="
2021-10-14 13:00:11 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-bd4a2cbb6edc14b9fbf7836bdec242ffb.dblock.zip.aes is listed as Uploaded with size 0 but should be 104836285, please verify the sha256 hash "A/FWRRJeEux/ear8Fu2UBnwez8ez95Y56XVmsX53U0Y="
2021-10-14 13:00:11 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-be37683048294486c9dd7844c93c2fa91.dblock.zip.aes is listed as Uploaded with size 0 but should be 104832205, please verify the sha256 hash "k6Ce5a05vOXZznziqPvcb4bNTqg9lv744uhJEUmsh10="
2021-10-14 13:00:11 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-b7c1dd9f3901d41e8a18dad51ea9f5283.dblock.zip.aes is listed as Uploaded with size 0 but should be 104836285, please verify the sha256 hash "SEaKPIwGSlRa71XhCJFPa3cLyOZNPCyu+hLfJ8XB8xY="
2021-10-14 13:00:11 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-bdb36d718cbb444feb0f397f89d7118b5.dblock.zip.aes is listed as Uploaded with size 0 but should be 104772557, please verify the sha256 hash "+pcE7YOoocof4PkpIJ6lBKymgwHLYFGgm2RKR9gb33Q="
2021-10-14 13:00:11 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-i5c6f0969b1da41cb9085cdfd9458ca1f.dindex.zip.aes is listed as Uploaded with size 0 but should be 35901, please verify the sha256 hash "BlU9rf7hqvuLNsjkU4x8WCXEAL4CT5OmUHE8oh3Jdh0="
2021-10-14 13:00:11 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-b017ea23b5f6d4df68ff96ff1c88df542.dblock.zip.aes is listed as Uploaded with size 0 but should be 104836285, please verify the sha256 hash "68ozenm1sujHDSrgd2tWRSdswOb9Mur9Q/Y1qfZFHUc="
2021-10-14 13:00:11 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-b6cd342ee34d9476787179b3bc8742559.dblock.zip.aes is listed as Uploaded with size 0 but should be 104836285, please verify the sha256 hash "TaKHSO8Jy8ZneGTtdAOT2OJeZaZBexcXbShuwCHZSLs="
2021-10-14 13:00:11 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-b63ef53c768794e92ac82775a50b0b315.dblock.zip.aes is listed as Uploaded with size 0 but should be 104769565, please verify the sha256 hash "Qj96v9NuerhAhFmY6W8AnL4AxzqYSG8sRzp9IsaZHFI="
2021-10-14 13:03:19 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-b0e292bd659e44991840eea0d42cfaff5.dblock.zip.aes is listed as Uploaded with size 0 but should be 104824781, please verify the sha256 hash "er1r8qLoVJ4MNnoafUi9I5xsC7v8PxKsd7FpvQodwnM="
2021-10-14 13:03:19 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-be814903db2a6450e82bbaca176363641.dblock.zip.aes is listed as Uploaded with size 0 but should be 104779725, please verify the sha256 hash "++Pn/XNX27IIhHl0s/LM3OZHKK6NlqOzaXD0o8X8Euo="
2021-10-14 13:03:19 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-bd4a2cbb6edc14b9fbf7836bdec242ffb.dblock.zip.aes is listed as Uploaded with size 0 but should be 104836285, please verify the sha256 hash "A/FWRRJeEux/ear8Fu2UBnwez8ez95Y56XVmsX53U0Y="
2021-10-14 13:03:19 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-be37683048294486c9dd7844c93c2fa91.dblock.zip.aes is listed as Uploaded with size 0 but should be 104832205, please verify the sha256 hash "k6Ce5a05vOXZznziqPvcb4bNTqg9lv744uhJEUmsh10="
2021-10-14 13:03:19 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-b7c1dd9f3901d41e8a18dad51ea9f5283.dblock.zip.aes is listed as Uploaded with size 0 but should be 104836285, please verify the sha256 hash "SEaKPIwGSlRa71XhCJFPa3cLyOZNPCyu+hLfJ8XB8xY="
2021-10-14 13:03:19 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-bdb36d718cbb444feb0f397f89d7118b5.dblock.zip.aes is listed as Uploaded with size 0 but should be 104772557, please verify the sha256 hash "+pcE7YOoocof4PkpIJ6lBKymgwHLYFGgm2RKR9gb33Q="
2021-10-14 13:03:19 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-i5c6f0969b1da41cb9085cdfd9458ca1f.dindex.zip.aes is listed as Uploaded with size 0 but should be 35901, please verify the sha256 hash "BlU9rf7hqvuLNsjkU4x8WCXEAL4CT5OmUHE8oh3Jdh0="
2021-10-14 13:03:19 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-b017ea23b5f6d4df68ff96ff1c88df542.dblock.zip.aes is listed as Uploaded with size 0 but should be 104836285, please verify the sha256 hash "68ozenm1sujHDSrgd2tWRSdswOb9Mur9Q/Y1qfZFHUc="
2021-10-14 13:03:19 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-b6cd342ee34d9476787179b3bc8742559.dblock.zip.aes is listed as Uploaded with size 0 but should be 104836285, please verify the sha256 hash "TaKHSO8Jy8ZneGTtdAOT2OJeZaZBexcXbShuwCHZSLs="
2021-10-14 13:03:19 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-b63ef53c768794e92ac82775a50b0b315.dblock.zip.aes is listed as Uploaded with size 0 but should be 104769565, please verify the sha256 hash "Qj96v9NuerhAhFmY6W8AnL4AxzqYSG8sRzp9IsaZHFI="