Restore Hash Failed - How to retry/restore from other backup?

Have to preface this by saying I think it has done a pretty damn good job for the most part, considering the amount of data it restored.

As for the stragglers - 39 files - is there a fast way to get it to ‘retry’, or to attempt restoring from a backup from another time where the file may have been slightly different?

Q1: I must say that the disk was accidentally being used by other software when this hash error came up, so it may have been due to heavy usage. Does it only calculate the hash once, or does it retry?

Q2: Ultimately, if I could get a list of files that failed, can I perhaps run them through the “command line” function to attempt restore from other earlier instances of the files?

Many thanks - fantastic software!

Restored Files 37926 (513.60 GB)
Restored Folders 33314
Restored Symlinks 0
 Warnings 0
 Errors 39 
2023-01-19 17:23:33 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-PatchingFailed]: Failed to patch with remote file: "duplicati-bcdf22a29adb8413fa810d73aa043f1e6.dblock.zip.aes", message: Failed to decrypt data (invalid passphrase?): Message has been altered, do not trust content
2023-01-19 20:03:29 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Tribute Mega Stars\Midnight City (Cover Mix Tribute to M83)\03 Midnight City (Acapella).m4a". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Tribute Mega Stars\Midnight City (Cover Mix Tribute to M83)\03 Midnight City (Acapella).m4a". File hash is eB1uw7xSB3ecMfTti8BeO4jT+HmEzSzR/fSV/7tFuRA=, expected hash is Q2weRDLJYBYTEcBvfAMeq7V0Ws67+ntsx0DKkBBQxQ8=
2023-01-19 20:03:29 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Tribute Mega Stars\Angels (Cover Mix Tribute to the Xx) - E\03 Angels (Acapella).m4a". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Tribute Mega Stars\Angels (Cover Mix Tribute to the Xx) - E\03 Angels (Acapella).m4a". File hash is WIsQ00L2pDw+fG6Iwvov23p4q95DHoJjj/6WVcS3eMs=, expected hash is nTW2XYCWeAQk2RJdzGXdwnjEdJgw3FEhwYQeGPbTA9o=
2023-01-19 20:03:29 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Tribute Mega Stars\Angels (Cover Mix Tribute to the Xx) - E\06 Angels (Synths).m4a". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Tribute Mega Stars\Angels (Cover Mix Tribute to the Xx) - E\06 Angels (Synths).m4a". File hash is dQ8rdTlTnGQCnYLu7gPP7PWn44XkhzI7URvsXSLkDek=, expected hash is XtsoRTQoV49d1RHyxsCqaVBAsNOOU0z//CRulHCvV4M=
2023-01-19 20:07:38 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Triple X\X Files Theme - The Truth\01 X-Files [Skitz Radio Mix].m4a". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Triple X\X Files Theme - The Truth\01 X-Files [Skitz Radio Mix].m4a". File hash is vRhr0eBNpNZgi5OTYuleOjKeccEbruSl6BpqDBAHUlU=, expected hash is adipKsKtEg4yL77DNvLObzH28EH0mgXM6sl0VOZvbEE=
2023-01-19 20:07:38 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Travis Scott\Rodeo (Expanded Edition)\09 Antidote.m4a". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Travis Scott\Rodeo (Expanded Edition)\09 Antidote.m4a". File hash is DDMWeVNLnvSlybu9RXoJ57MJ2bhD2Yt/VfWCHHI1kRk=, expected hash is mJawS8eWbz1KXnmyltrCMKde+AuUho4H241BtMw+nb4=
2023-01-19 20:14:58 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Triple X\Unknown Album\Feel the Same (Acapella).mp3". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Triple X\Unknown Album\Feel the Same (Acapella).mp3". File hash is wSv1rfpPr2IsXVOjzH1o/waMPqXet1H9GhoeDiLwtZQ=, expected hash is 2oMwX04DhS0jjhNpMvcvQ6iO+SfL8D9HhWfgfrVhFrc=
2023-01-19 20:14:58 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Triple X\Unknown Album\feel the same.mp3". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Triple X\Unknown Album\feel the same.mp3". File hash is bswbZei6BEbtr7L2yJCDGbFzDUjN80i4sFFoRzeKSAw=, expected hash is u/q6tVySctRZtBuYWnuMn5fb0crpLycwebsKGR3WT50=
2023-01-19 20:14:58 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Triple X\Rise Anthems Volume 1\06 Feel The Same - DJ Sneak Dub.mp3". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Triple X\Rise Anthems Volume 1\06 Feel The Same - DJ Sneak Dub.mp3". File hash is qg3S3Cv3RnQolBfbwp2FvxOJZA+kqnkxNZqSM2tlsYs=, expected hash is QWBwyTj4oGuq8v749ATi/ZKfaUKrrYl39HBWa6CzC6A=
2023-01-19 20:14:58 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Triple A\A State Of Trance 2011 (Mixed By Armin V\01 Winter Stayed (Armin van Buuren_s.mp3". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Triple A\A State Of Trance 2011 (Mixed By Armin V\01 Winter Stayed (Armin van Buuren_s.mp3". File hash is DhBGVOgQhP924V2+kHiqOfUnsIDD8uc5PKTJ8pOjLFs=, expected hash is Llk5M5K1U5Qf4i56A/UWWjhqaRI00ZsoHZ/1xFnPCTo=
2023-01-19 20:14:58 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trinidad Cardona\Unknown Album\01 Dinero (Clean) (Clean Version).mp3". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trinidad Cardona\Unknown Album\01 Dinero (Clean) (Clean Version).mp3". File hash is grYhhSPKDAI7LJgzsrnopLwkKLaix5y+dKEaOdUmcNg=, expected hash is oCNYXUsRxH9ONG9R2VGXQtkxC92cqLrgzwsjiyCrUG4=
2023-01-19 20:14:58 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trinidad Cardona\Unknown Album\01 Dinero (Original Mix).mp3". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trinidad Cardona\Unknown Album\01 Dinero (Original Mix).mp3". File hash is z1EJYR/Ax+Nw0BMmVMUh2zaM62SmogIFWsew7c1T5k8=, expected hash is t248TiF17uP4GOQha5djUqVfCLrvZdLv6Em2v1QpUQ8=
2023-01-19 20:14:58 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trini Jacobs & Kevin Lyttle\GLOW' o3 Soundtrack\15 Sexy Ways (Acapella).mp3". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trini Jacobs & Kevin Lyttle\GLOW' o3 Soundtrack\15 Sexy Ways (Acapella).mp3". File hash is hq4J6glt/mnluOgojDDBV0CPjSmy1p/UjakxCInP0eI=, expected hash is H1NbXYXbmWlVhsxaAjEc43i5oLRa/QUvaakapqAVDpU=
2023-01-19 20:14:58 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\trinere\Unknown Album\rockin' to the rhythm.mp3". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\trinere\Unknown Album\rockin' to the rhythm.mp3". File hash is SWOv1UrakJaQalxAMeXHgC4qYTgSazFAINOd6M0wAXM=, expected hash is y47RUhFd84cky3KY3zzkarGurZ1ORGn03RBxzm0FZ2U=
2023-01-19 20:14:58 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trina Feat.Rick Ross-Told Y'al\cds\04 Told Y'all(Acapella).mp3". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trina Feat.Rick Ross-Told Y'al\cds\04 Told Y'all(Acapella).mp3". File hash is y/5G/dmAu6gxNmHzWxG+lKI+BCVnZAOWDRO9wZXLzXs=, expected hash is Aj/+2C9GkSwIMPay1x3fgkdsaq7I39H1yXkc8xM0Lmo=
2023-01-19 20:14:58 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trickbaby V Freemasons\CD Pool Dance October Cd2\Zap Me Lovely (the Nokia Tune).mp3". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trickbaby V Freemasons\CD Pool Dance October Cd2\Zap Me Lovely (the Nokia Tune).mp3". File hash is TBhxdZpcmi0afNlcj9B71kFKEGtIrwu6ZwC7YjN8+xo=, expected hash is bsR6IWsY7bn6iJdKf+t+2cMsP2ock1vUKQ59f1h0TVs=
2023-01-19 20:14:58 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trick Daddy Ft. Trina - Nann (Acapella)\Trick Daddy ft. Trina - Nann (\06 Trick Daddy Ft. Trina - Nann (Aca.mp3". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trick Daddy Ft. Trina - Nann (Acapella)\Trick Daddy ft. Trina - Nann (\06 Trick Daddy Ft. Trina - Nann (Aca.mp3". File hash is ufxv8RK6gHQG9kdf3ybdYmcO6KkEBKPUN+AmGfwRrr0=, expected hash is KBujvPf/vQh/JFTLsNRZol0A1/DXrEsNeSCjnbDTBzc=
2023-01-19 20:14:58 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trick Daddy - Who Dat(Acapella)\Trick Daddy - Who Dat(Acapella\01 Trick Daddy - Who Dat(Acapella).mp3". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trick Daddy - Who Dat(Acapella)\Trick Daddy - Who Dat(Acapella\01 Trick Daddy - Who Dat(Acapella).mp3". File hash is 5Z1xWWT4F6Al3w8I1tJwK77fO0hkAdhaees06pmVcAU=, expected hash is o4BdX/WHs8mMnQT3Wnlzq1rOAoyNbUdT3jjQP6TFaDo=
2023-01-19 20:14:58 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trick Daddy\Unknown Album\32 Boy.mp3". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trick Daddy\Unknown Album\32 Boy.mp3". File hash is yABUac47n0qLT4Jxtew2nb6CRc83lOQf6GN57UL8WdM=, expected hash is HMSu9ypMPpZHv3Kn6kt214w60ZODmxX/eCnNV6jOq1s=
2023-01-19 20:14:59 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trick & Kubic\Easy Vinyl\Easy (Nieskisch remix).mp3". Error message was: Failed to restore file: "D:\iTunes\iTunes Media\Music\Trick & Kubic\Easy Vinyl\Easy (Nieskisch remix).mp3". File hash is xAqlZA04Jz7U9AXVJxqWuzn3jwyAVLI/6CJ/4XrRHVM=, expected hash is bn+vaa+SwMQR5N7rKZKTh5/xmx1I9hRUwYKD+/KblMY=

When you restore, you can select individual files as well as backup times. Are you saying that you can’t do this?

Welcome to the forum @adamlove

The easy slow way is to just run again. Any file whose content is already correct won’t need a patch.
This should reduce the amount of downloading. What storage type is the Destination, and how fast?

There’s a nice CLI example of the download reduction on second try to the same restore folder here.

looks like it broke a file. Maybe that file had content common to all of the files that couldn’t be rebuilt.
Disaster Recovery talks about this, e.g. the affected command which you could run in Commandline.

You can also inspect duplicati-bcdf22a29adb8413fa810d73aa043f1e6.dblock.zip.aes for an unexpectedly new timestamp, check its size, try decrypt with AES Crypt or Duplicati SharpAESCrypt.
Destination dblock files contain blocks from source files. Ideally you can find a good one. Long shot?

Implementing the feature to restore any version of a single file might help with that. Not released yet.
Restoring files from a backup will let you pick any backup date to look (or search) for a file of interest.
It’s kind of awkward. Looking in a copy of the database with DB Browser for SQLite in File view can easily let you filter any Path of interest. If only one row shows up, there’s only one version of that file.

If you’re nervous about these experiments, you can do test restores into a different folder one by one.
This might take less machine time at the expense of more of your time leading the experimentation…

Probably once, but it did it on lots of files. If disk activity hurts file reading that badly, that’s a big issue.

I’m confused. Didn’t you post the list? Whether GUI or CLI, a human-driven retry attempt needs the list.

The RESTORE command

--version=<int>
Restore files from a specific backup.

The FIND command

If no <filename> is specified, a list of all available backups is shown.

(version number is on the left, just like it is on the GUI Restore selector.

If entire path is specified, all available versions of the file are listed.

--all-versions=<boolean>
Searches in all backup sets, instead of just searching the latest.

actually might be a way to see which file versions had a path of interest, without looking inside the DB.
You probably wouldn’t be able to recognize actual different versions of the file, just versions that had it.

One can also use the search box to help with finding a file if it happens to be deep in a folder structure.
Most or all of the posted errors are in D:\iTunes\iTunes Media\Music though. Just open that folder.
You can try the files one at a time or check all the ones that you want to try from that particular version.

You made my reply longer for me :slight_smile:

Actually, I was going to say more just now but won’t because I do wonder if this is more complicated or possibilities missed and I don’t want to spend the time on that.

If a damaged file is found, I’m curious about its history. Some storage types are more prone to damage, however there is quite a bit of checking done to guard against it, such as file listing, and sample testing.

Verifying backend files
The TEST command
backup-test-samples
backup-test-percentage

The database tracks testing, trying to test files not yet tested. Was this tested, then broke? We can look.
Creating a bug report then posting a link would let us read VerificationCount in Remotevolume table.

If you want to know why I didn’t want to spend time on it (besides not wanting to lol), this is involving the remote side.

Yes Duplicati does do verification after but it is indeed possible though that verification fails from the remote side code issue and then the backup would need to be attempted fixed on following backups (I worked on a FTP server app recently so I know this can happen). Could it have done something incorrectly that resulted in bad hashes? I don’t know. Its unknown. That’s what bugs are.

In any case, its possible that the local DB hash and remote DB hash could be different. Its also possible that the remote file is different.

It would be interesting to test local restore verses remote restore if that were possible here should the current install of Duplicati have the original DB. I’d definitely want to know if there’s a difference there in hashes here.

I don’t want you posting a long reply on this. I’m just saying :slight_smile:

Thank you for such a prompt and comprehensive reply! I’m looking into these links that you have posted.

I restored again via the easy slow way, and got 39 files again, so that’s a good thing I suppose.

Being fairly intermediate with these sorts of things, bash/command line etc, I wonder how the average joe would go about attempting to get the last of their files restored.

{
  "RestoredFiles": 37925,
  "SizeOfRestoredFiles": 551478183318,
  "RestoredFolders": 33314,
  "RestoredSymlinks": 0,
  "PatchedFiles": 0,
  "DeletedFiles": 0,
  "DeletedFolders": 0,
  "DeletedSymlinks": 0,
  "MainOperation": "Restore",
  "RecreateDatabaseResults": null,
  "ParsedResult": "Error",
  "Version": "2.0.6.3 (2.0.6.3_beta_2021-06-17)",
  "EndTime": "2023-01-19T22:56:24.0907309Z",
  "BeginTime": "2023-01-19T14:51:35.1257412Z",
  "Duration": "08:04:48.9649897",
  "MessagesActualLength": 23840,
  "WarningsActualLength": 0,
  "ErrorsActualLength": 39,
  "Messages": [
    "2023-01-20 01:51:35 +11 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Restore has started",
    "2023-01-20 01:51:47 +11 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  ()",
    "2023-01-20 01:51:55 +11 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (27.24 KB)",
    "2023-01-20 01:51:56 +11 - [Information-Duplicati.Library.Main.Database.LocalRestoreDatabase-SearchingBackup]: Searching backup 7 (18/01/2023 5:28:37 AM) ...",
    "2023-01-20 01:58:51 +11 - [Information-Duplicati.Library.Main.Operation.RestoreHandler-RemoteFileCount]: 11913 remote files are required to restore",
    "2023-01-20 01:58:51 +11 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-b834d9b3fd07047d8be29d7a5c1d1b7cd.dblock.zip.aes (50.00 MB)",
    "2023-01-20 01:58:52 +11 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-b834d9b3fd07047d8be29d7a5c1d1b7cd.dblock.zip.aes (50.00 MB)",
    "2023-01-20 01:58:52 +11 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-b997b9ecfc56846ee8062210ad5018f6f.dblock.zip.aes (49.94 MB)",
    "2023-01-20 01:58:53 +11 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-b997b9ecfc56846ee8062210ad5018f6f.dblock.zip.aes (49.94 MB)",
    "2023-01-20 01:58:53 +11 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-bad654844058a47abb8a8e9ccd6bca67e.dblock.zip.aes (49.96 MB)",
    "2023-01-20 01:58:55 +11 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-bad654844058a47abb8a8e9ccd6bca67e.dblock.zip.aes (49.96 MB)",
    "2023-01-20 01:58:55 +11 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-b9579d1000b614d529ac00693abd23fa8.dblock.zip.aes (49.94 MB)",
    "2023-01-20 01:58:56 +11 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-b9579d1000b614d529ac00693abd23fa8.dblock.zip.aes (49.94 MB)",
    "2023-01-20 01:58:56 +11 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-baae94feb5076471788b438a0347b3864.dblock.zip.aes (49.97 MB)",
    "2023-01-20 01:58:57 +11 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-baae94feb5076471788b438a0347b3864.dblock.zip.aes (49.97 MB)",
    "2023-01-20 01:58:57 +11 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-bbb9a095706f74517b8365d6aa9d6b11c.dblock.zip.aes (49.94 MB)",
    "2023-01-20 01:58:58 +11 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-bbb9a095706f74517b8365d6aa9d6b11c.dblock.zip.aes (49.94 MB)",
    "2023-01-20 01:58:58 +11 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-ba2cc2ce934b94bb0a8a9d339062497d9.dblock.zip.aes (49.90 MB)",
    "2023-01-20 01:59:00 +11 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-ba2cc2ce934b94bb0a8a9d339062497d9.dblock.zip.aes (49.90 MB)",
    "2023-01-20 01:59:00 +11 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-b89b193cbe4dd4a22a2f8ad0f5fd572df.dblock.zip.aes (49.91 MB)"
  ],
  "Warnings": [],
  "Errors": [
    "2023-01-20 06:38:18 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-PatchingFailed]: Failed to patch with remote file: \"duplicati-bcdf22a29adb8413fa810d73aa043f1e6.dblock.zip.aes\", message: Failed to decrypt data (invalid passphrase?): Message has been altered, do not trust content",
    "2023-01-20 08:54:43 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Tribute Mega Stars\\Midnight City (Cover Mix Tribute to M83)\\03 Midnight City (Acapella).m4a\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Tribute Mega Stars\\Midnight City (Cover Mix Tribute to M83)\\03 Midnight City (Acapella).m4a\". File hash is eB1uw7xSB3ecMfTti8BeO4jT+HmEzSzR/fSV/7tFuRA=, expected hash is Q2weRDLJYBYTEcBvfAMeq7V0Ws67+ntsx0DKkBBQxQ8=",
    "2023-01-20 08:54:43 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Tribute Mega Stars\\Angels (Cover Mix Tribute to the Xx) - E\\03 Angels (Acapella).m4a\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Tribute Mega Stars\\Angels (Cover Mix Tribute to the Xx) - E\\03 Angels (Acapella).m4a\". File hash is WIsQ00L2pDw+fG6Iwvov23p4q95DHoJjj/6WVcS3eMs=, expected hash is nTW2XYCWeAQk2RJdzGXdwnjEdJgw3FEhwYQeGPbTA9o=",
    "2023-01-20 08:54:43 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Tribute Mega Stars\\Angels (Cover Mix Tribute to the Xx) - E\\06 Angels (Synths).m4a\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Tribute Mega Stars\\Angels (Cover Mix Tribute to the Xx) - E\\06 Angels (Synths).m4a\". File hash is dQ8rdTlTnGQCnYLu7gPP7PWn44XkhzI7URvsXSLkDek=, expected hash is XtsoRTQoV49d1RHyxsCqaVBAsNOOU0z//CRulHCvV4M=",
    "2023-01-20 08:58:05 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Triple X\\X Files Theme - The Truth\\01 X-Files [Skitz Radio Mix].m4a\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Triple X\\X Files Theme - The Truth\\01 X-Files [Skitz Radio Mix].m4a\". File hash is vRhr0eBNpNZgi5OTYuleOjKeccEbruSl6BpqDBAHUlU=, expected hash is adipKsKtEg4yL77DNvLObzH28EH0mgXM6sl0VOZvbEE=",
    "2023-01-20 08:58:05 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Travis Scott\\Rodeo (Expanded Edition)\\09 Antidote.m4a\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Travis Scott\\Rodeo (Expanded Edition)\\09 Antidote.m4a\". File hash is DDMWeVNLnvSlybu9RXoJ57MJ2bhD2Yt/VfWCHHI1kRk=, expected hash is mJawS8eWbz1KXnmyltrCMKde+AuUho4H241BtMw+nb4=",
    "2023-01-20 09:04:24 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Triple X\\Unknown Album\\Feel the Same (Acapella).mp3\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Triple X\\Unknown Album\\Feel the Same (Acapella).mp3\". File hash is wSv1rfpPr2IsXVOjzH1o/waMPqXet1H9GhoeDiLwtZQ=, expected hash is 2oMwX04DhS0jjhNpMvcvQ6iO+SfL8D9HhWfgfrVhFrc=",
    "2023-01-20 09:04:24 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Triple X\\Unknown Album\\feel the same.mp3\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Triple X\\Unknown Album\\feel the same.mp3\". File hash is bswbZei6BEbtr7L2yJCDGbFzDUjN80i4sFFoRzeKSAw=, expected hash is u/q6tVySctRZtBuYWnuMn5fb0crpLycwebsKGR3WT50=",
    "2023-01-20 09:04:24 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Triple X\\Rise Anthems Volume 1\\06 Feel The Same - DJ Sneak Dub.mp3\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Triple X\\Rise Anthems Volume 1\\06 Feel The Same - DJ Sneak Dub.mp3\". File hash is qg3S3Cv3RnQolBfbwp2FvxOJZA+kqnkxNZqSM2tlsYs=, expected hash is QWBwyTj4oGuq8v749ATi/ZKfaUKrrYl39HBWa6CzC6A=",
    "2023-01-20 09:04:24 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Triple A\\A State Of Trance 2011 (Mixed By Armin V\\01 Winter Stayed (Armin van Buuren_s.mp3\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Triple A\\A State Of Trance 2011 (Mixed By Armin V\\01 Winter Stayed (Armin van Buuren_s.mp3\". File hash is DhBGVOgQhP924V2+kHiqOfUnsIDD8uc5PKTJ8pOjLFs=, expected hash is Llk5M5K1U5Qf4i56A/UWWjhqaRI00ZsoHZ/1xFnPCTo=",
    "2023-01-20 09:04:24 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trinidad Cardona\\Unknown Album\\01 Dinero (Clean) (Clean Version).mp3\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trinidad Cardona\\Unknown Album\\01 Dinero (Clean) (Clean Version).mp3\". File hash is grYhhSPKDAI7LJgzsrnopLwkKLaix5y+dKEaOdUmcNg=, expected hash is oCNYXUsRxH9ONG9R2VGXQtkxC92cqLrgzwsjiyCrUG4=",
    "2023-01-20 09:04:24 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trinidad Cardona\\Unknown Album\\01 Dinero (Original Mix).mp3\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trinidad Cardona\\Unknown Album\\01 Dinero (Original Mix).mp3\". File hash is z1EJYR/Ax+Nw0BMmVMUh2zaM62SmogIFWsew7c1T5k8=, expected hash is t248TiF17uP4GOQha5djUqVfCLrvZdLv6Em2v1QpUQ8=",
    "2023-01-20 09:04:24 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trini Jacobs & Kevin Lyttle\\GLOW' o3 Soundtrack\\15 Sexy Ways (Acapella).mp3\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trini Jacobs & Kevin Lyttle\\GLOW' o3 Soundtrack\\15 Sexy Ways (Acapella).mp3\". File hash is hq4J6glt/mnluOgojDDBV0CPjSmy1p/UjakxCInP0eI=, expected hash is H1NbXYXbmWlVhsxaAjEc43i5oLRa/QUvaakapqAVDpU=",
    "2023-01-20 09:04:24 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\trinere\\Unknown Album\\rockin' to the rhythm.mp3\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\trinere\\Unknown Album\\rockin' to the rhythm.mp3\". File hash is SWOv1UrakJaQalxAMeXHgC4qYTgSazFAINOd6M0wAXM=, expected hash is y47RUhFd84cky3KY3zzkarGurZ1ORGn03RBxzm0FZ2U=",
    "2023-01-20 09:04:24 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trina Feat.Rick Ross-Told Y'al\\cds\\04 Told Y'all(Acapella).mp3\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trina Feat.Rick Ross-Told Y'al\\cds\\04 Told Y'all(Acapella).mp3\". File hash is y/5G/dmAu6gxNmHzWxG+lKI+BCVnZAOWDRO9wZXLzXs=, expected hash is Aj/+2C9GkSwIMPay1x3fgkdsaq7I39H1yXkc8xM0Lmo=",
    "2023-01-20 09:04:24 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trickbaby V Freemasons\\CD Pool Dance October Cd2\\Zap Me Lovely (the Nokia Tune).mp3\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trickbaby V Freemasons\\CD Pool Dance October Cd2\\Zap Me Lovely (the Nokia Tune).mp3\". File hash is TBhxdZpcmi0afNlcj9B71kFKEGtIrwu6ZwC7YjN8+xo=, expected hash is bsR6IWsY7bn6iJdKf+t+2cMsP2ock1vUKQ59f1h0TVs=",
    "2023-01-20 09:04:24 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trick Daddy Ft. Trina - Nann (Acapella)\\Trick Daddy ft. Trina - Nann (\\06 Trick Daddy Ft. Trina - Nann (Aca.mp3\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trick Daddy Ft. Trina - Nann (Acapella)\\Trick Daddy ft. Trina - Nann (\\06 Trick Daddy Ft. Trina - Nann (Aca.mp3\". File hash is ufxv8RK6gHQG9kdf3ybdYmcO6KkEBKPUN+AmGfwRrr0=, expected hash is KBujvPf/vQh/JFTLsNRZol0A1/DXrEsNeSCjnbDTBzc=",
    "2023-01-20 09:04:24 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trick Daddy - Who Dat(Acapella)\\Trick Daddy - Who Dat(Acapella\\01 Trick Daddy - Who Dat(Acapella).mp3\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trick Daddy - Who Dat(Acapella)\\Trick Daddy - Who Dat(Acapella\\01 Trick Daddy - Who Dat(Acapella).mp3\". File hash is 5Z1xWWT4F6Al3w8I1tJwK77fO0hkAdhaees06pmVcAU=, expected hash is o4BdX/WHs8mMnQT3Wnlzq1rOAoyNbUdT3jjQP6TFaDo=",
    "2023-01-20 09:04:24 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trick Daddy\\Unknown Album\\32 Boy.mp3\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trick Daddy\\Unknown Album\\32 Boy.mp3\". File hash is yABUac47n0qLT4Jxtew2nb6CRc83lOQf6GN57UL8WdM=, expected hash is HMSu9ypMPpZHv3Kn6kt214w60ZODmxX/eCnNV6jOq1s=",
    "2023-01-20 09:04:25 +11 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trick & Kubic\\Easy Vinyl\\Easy (Nieskisch remix).mp3\". Error message was: Failed to restore file: \"D:\\iTunes\\iTunes Media\\Music\\Trick & Kubic\\Easy Vinyl\\Easy (Nieskisch remix).mp3\". File hash is xAqlZA04Jz7U9AXVJxqWuzn3jwyAVLI/6CJ/4XrRHVM=, expected hash is bn+vaa+SwMQR5N7rKZKTh5/xmx1I9hRUwYKD+/KblMY="
  ],
  "BackendStatistics": {
    "RemoteCalls": 11918,
    "BytesUploaded": 0,
    "BytesDownloaded": 623694436376,
    "FilesUploaded": 0,
    "FilesDownloaded": 11912,
    "FilesDeleted": 0,
    "FoldersCreated": 0,
    "RetryAttempts": 4,
    "UnknownFileSize": 0,
    "UnknownFileCount": 0,
    "KnownFileCount": 27891,
    "KnownFileSize": 730894069063,
    "LastBackupDate": "2023-01-20T01:01:33+11:00",
    "BackupListCount": 39,
    "TotalQuotaSpace": 0,
    "FreeQuotaSpace": 0,
    "AssignedQuotaSpace": -1,
    "ReportedQuotaError": false,
    "ReportedQuotaWarning": false,
    "MainOperation": "Restore",
    "ParsedResult": "Success",
    "Version": "2.0.6.3 (2.0.6.3_beta_2021-06-17)",
    "EndTime": "0001-01-01T00:00:00",
    "BeginTime": "2023-01-19T14:51:35.1257412Z",
    "Duration": "00:00:00",
    "MessagesActualLength": 0,
    "WarningsActualLength": 0,
    "ErrorsActualLength": 0,
    "Messages": null,
    "Warnings": null,
    "Errors": null
  }
}

In this case it’s a case of copying and pasting 39 times. Not the end of the world but the number could be far worse. If I could get a simple unadulterated list of the files that I can copy/paste all at once, I could perhaps put it into a text file and pipe that into some sort of bash or powershell function (or even copy paste that list into the command line section in duplicity).

Hello @adamlove

if a file on your backup is corrupted, the probability of recovery is low. You will not get it by mucking around with aescrypt, even partially, and even if you got some part of a zip file it would hardly get you something useful.

That was slower than necessary because it looks like it wasn’t on top of prior restore attempt.
Regardless, another try and it’s consistent, which makes recovery of final files look less likely.

Some questions should not need much looking, for example what kind of storage is backup on?
Please provide answers when you can get them. Until then, not a whole lot more can be said…

That’s just a test that it’s genuinely gone. If backup data is lost, chances are that file data is lost.

Checking decryption is easier than checking hashes. I felt a little bad about even asking for size.
Sometimes size that, when converted to hex, is too even is a sign of filesystem or SMB damage.
Actually finding the recorded size could be done by getting Size of file in Remotevolume table or
upload-verification-file (plus maybe a backup, which is probably a poor idea now) can also get it.
Hash is in the same areas but even harder to explain because it’s a Base64 encode of SHA-256.