Backup error windows 10 - please post solution. Microsoft Edge Browser Thanks

h82w84 · April 6, 2021, 8:06pm

2021-03-31 16:40:24 -04 - [Error-Duplicati.Library.Main.Operation.TestHandler-FailedToProcessFile]: Failed to process file duplicati-20210331T183837Z.dlist.zip.aes

drwtsn32 · April 6, 2021, 11:07pm

Hello and welcome!

Duplicati is failing during the testing phase (after backup is complete). What type of destination are you using?

h82w84 · April 7, 2021, 3:09am

I’m using an external drive connected to my netgear nighthawk router the drive is tested and I have used another program to complete backup with the same setup. Drive tested scan disk checked and passed. I appreciate your follow up

drwtsn32 · April 7, 2021, 5:52pm

What protocol are you using? FTP or?

We might need more detailed logging. Go to About → Show log → Live → and set the dropdown to verbose. Then open another tab to the Duplicati web UI and start your backup again. Go back to the Live Log tab and when you get the warning see if there are more details you can send us.

h82w84 · April 11, 2021, 9:42pm

Time
Start 2021-03-31 14:38:37
End 2021-03-31 16:40:55
Duration 02:02:19
Source Files
Examined 402547 (44.80 GB)
Opened 99630 (6.98 GB)
Added 90511 (4.43 GB)
Modified 9119 (2.44 GB)
Deleted 69010
Test Phase
Compact Phase
Delete Phase (Old Backup Versions)
Warnings 1254
Errors 1
2021-03-31 16:40:24 -04 - [Error-Duplicati.Library.Main.Operation.TestHandler-FailedToProcessFile]: Failed to process file duplicati-20210331T183837Z.dlist.zip.aes

drwtsn32 · April 12, 2021, 8:07pm

That’s a log entry from the job itself. Would prefer to see something from the Live log per my previous message. Also what protocol are you using?

h82w84 · April 14, 2021, 3:29pm

Time
Start 2021-03-31 14:38:37
End 2021-03-31 16:40:55
Duration 02:02:19
Source Files
Examined 402547 (44.80 GB)
Opened 99630 (6.98 GB)
Added 90511 (4.43 GB)
Modified 9119 (2.44 GB)
Deleted 69010
Test Phase
Compact Phase
Delete Phase (Old Backup Versions)
Warnings 1254
Errors 1
2021-03-31 16:40:24 -04 - [Error-Duplicati.Library.Main.Operation.TestHandler-FailedToProcessFile]: Failed to process file duplicati-20210331T183837Z.dlist.zip.aes

h82w84 · April 14, 2021, 3:31pm

Strangely so, today’s backup ran without any errors for the first time. I assume whatever caused it has fixed itself. BTW I mentioned previously that I was doing my backup on my external hard drive connected to my router and backed up via network hard drive. Thanks for your reply.

drwtsn32 · April 14, 2021, 4:32pm

Yes, I saw that… but it doesn’t tell me what protocol is being used, which is why I asked again. The protocol is what is shown in the “Storage Type” dropdown on page 2 of your backup job configuration.

Glad it’s working today!

h82w84 · April 14, 2021, 6:08pm

Under configuration the advanced option is left blank. I don’t know where in the setting I can look up the protocol that you asked for but it’s not via remote login but on my network readyshare drive under network. I ran a backup again to test it and here’s a copy of the error log
{
{
“DeletedFiles”: 0,
“DeletedFolders”: 0,
“ModifiedFiles”: 0,
“ExaminedFiles”: 0,
“OpenedFiles”: 0,
“AddedFiles”: 0,
“SizeOfModifiedFiles”: 0,
“SizeOfAddedFiles”: 0,
“SizeOfExaminedFiles”: 0,
“SizeOfOpenedFiles”: 0,
“NotProcessedFiles”: 0,
“AddedFolders”: 0,
“TooLargeFiles”: 0,
“FilesWithError”: 0,
“ModifiedFolders”: 0,
“ModifiedSymlinks”: 0,
“AddedSymlinks”: 0,
“DeletedSymlinks”: 0,
“PartialBackup”: false,
“Dryrun”: false,
“MainOperation”: “Backup”,
“CompactResults”: {
“DeletedFileCount”: 2,
“DownloadedFileCount”: 0,
“UploadedFileCount”: 0,
“DeletedFileSize”: 1722,
“DownloadedFileSize”: 0,
“UploadedFileSize”: 0,
“Dryrun”: false,
“VacuumResults”: null,
“MainOperation”: “Compact”,
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “2021-04-14T16:38:54.4903204Z”,
“BeginTime”: “2021-04-14T16:38:49.5297468Z”,
“Duration”: “00:00:04.9605736”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null,
“BackendStatistics”: {
“RemoteCalls”: 13,
“BytesUploaded”: 1722,
“BytesDownloaded”: 354579515,
“FilesUploaded”: 2,
“FilesDownloaded”: 7,
“FilesDeleted”: 2,
“FoldersCreated”: 0,
“RetryAttempts”: 4,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 1240,
“KnownFileSize”: 32452178504,
“LastBackupDate”: “2021-03-29T11:41:58-04:00”,
“BackupListCount”: 2,
“TotalQuotaSpace”: 5000845586432,
“FreeQuotaSpace”: 4609682558976,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2021-04-14T16:38:15.2616497Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
},
“VacuumResults”: null,
“DeleteResults”: {
“DeletedSetsActualLength”: 0,
“DeletedSets”: ,
“Dryrun”: false,
“MainOperation”: “Delete”,
“CompactResults”: {
“DeletedFileCount”: 2,
“DownloadedFileCount”: 0,
“UploadedFileCount”: 0,
“DeletedFileSize”: 1722,
“DownloadedFileSize”: 0,
“UploadedFileSize”: 0,
“Dryrun”: false,
“VacuumResults”: null,
“MainOperation”: “Compact”,
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “2021-04-14T16:38:54.4903204Z”,
“BeginTime”: “2021-04-14T16:38:49.5297468Z”,
“Duration”: “00:00:04.9605736”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null,
“BackendStatistics”: {
“RemoteCalls”: 13,
“BytesUploaded”: 1722,
“BytesDownloaded”: 354579515,
“FilesUploaded”: 2,
“FilesDownloaded”: 7,
“FilesDeleted”: 2,
“FoldersCreated”: 0,
“RetryAttempts”: 4,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 1240,
“KnownFileSize”: 32452178504,
“LastBackupDate”: “2021-03-29T11:41:58-04:00”,
“BackupListCount”: 2,
“TotalQuotaSpace”: 5000845586432,
“FreeQuotaSpace”: 4609682558976,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2021-04-14T16:38:15.2616497Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
},
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “2021-04-14T16:38:54.4903204Z”,
“BeginTime”: “2021-04-14T16:38:39.7033926Z”,
“Duration”: “00:00:14.7869278”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null,
“BackendStatistics”: {
“RemoteCalls”: 13,
“BytesUploaded”: 1722,
“BytesDownloaded”: 354579515,
“FilesUploaded”: 2,
“FilesDownloaded”: 7,
“FilesDeleted”: 2,
“FoldersCreated”: 0,
“RetryAttempts”: 4,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 1240,
“KnownFileSize”: 32452178504,
“LastBackupDate”: “2021-03-29T11:41:58-04:00”,
“BackupListCount”: 2,
“TotalQuotaSpace”: 5000845586432,
“FreeQuotaSpace”: 4609682558976,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2021-04-14T16:38:15.2616497Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
},
“RepairResults”: null,
“TestResults”: {
“MainOperation”: “Test”,
“VerificationsActualLength”: 3,
“Verifications”: [
{
“Key”: “duplicati-20210325T222803Z.dlist.zip.aes”,
“Value”: [
{
“Key”: “Error”,
“Value”: “Hash mismatch on file “C:\Users\h82w8\AppData\Local\Temp\dup-d4622ab5-cf96-47ff-9afc-447403c9441c”, recorded hash: 79vESSUTVHQksPyxS8+Nb+KSfNLoR1+XRZtjmjRrOWE=, actual hash RjU1shTme53BfwmR8S/4jueTiCRd23W9luYFAit0eyU=”
}
]
},
{
“Key”: “duplicati-ic7b3ad8a744f4c33b412bfa06773f422.dindex.zip.aes”,
“Value”:
},
{
“Key”: “duplicati-be3ec2790272840c68a6abbbbc3273196.dblock.zip.aes”,
“Value”:
}
],
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “2021-04-14T16:39:48.3522604Z”,
“BeginTime”: “2021-04-14T16:39:00.0061315Z”,
“Duration”: “00:00:48.3461289”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null,
“BackendStatistics”: {
“RemoteCalls”: 13,
“BytesUploaded”: 1722,
“BytesDownloaded”: 354579515,
“FilesUploaded”: 2,
“FilesDownloaded”: 7,
“FilesDeleted”: 2,
“FoldersCreated”: 0,
“RetryAttempts”: 4,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 1240,
“KnownFileSize”: 32452178504,
“LastBackupDate”: “2021-03-29T11:41:58-04:00”,
“BackupListCount”: 2,
“TotalQuotaSpace”: 5000845586432,
“FreeQuotaSpace”: 4609682558976,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2021-04-14T16:38:15.2616497Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
},
“ParsedResult”: “Error”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “2021-04-14T16:39:49.1653174Z”,
“BeginTime”: “2021-04-14T16:38:15.2616497Z”,
“Duration”: “00:01:33.9036677”,
“MessagesActualLength”: 37,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 1,
“Messages”: [
“2021-04-14 12:38:15 -04 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started”,
“2021-04-14 12:38:30 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2021-04-14 12:38:34 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (1.21 KB)”,
“2021-04-14 12:38:35 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-bd889a185bc0743cfab0354b8efb910a5.dblock.zip.aes (845 bytes)”,
“2021-04-14 12:38:38 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-bd889a185bc0743cfab0354b8efb910a5.dblock.zip.aes (845 bytes)”,
“2021-04-14 12:38:39 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-ib15d2802a7924cf9817d462a070a77b8.dindex.zip.aes (877 bytes)”,
“2021-04-14 12:38:39 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-ib15d2802a7924cf9817d462a070a77b8.dindex.zip.aes (877 bytes)”,
“2021-04-14 12:38:49 -04 - [Information-Duplicati.Library.Main.Operation.DeleteHandler-DeleteResults]: No remote filesets were deleted”,
“2021-04-14 12:38:53 -04 - [Information-Duplicati.Library.Main.Database.LocalDeleteDatabase-CompactReason]: Compacting because there are 1 fully deletable volume(s)”,
“2021-04-14 12:38:53 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Delete - Started: duplicati-bd889a185bc0743cfab0354b8efb910a5.dblock.zip.aes (845 bytes)”,
“2021-04-14 12:38:54 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Delete - Completed: duplicati-bd889a185bc0743cfab0354b8efb910a5.dblock.zip.aes (845 bytes)”,
“2021-04-14 12:38:54 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Delete - Started: duplicati-ib15d2802a7924cf9817d462a070a77b8.dindex.zip.aes (877 bytes)”,
“2021-04-14 12:38:54 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Delete - Completed: duplicati-ib15d2802a7924cf9817d462a070a77b8.dindex.zip.aes (877 bytes)”,
“2021-04-14 12:38:54 -04 - [Information-Duplicati.Library.Main.Operation.CompactHandler-CompactResults]: Deleted 2 files, which reduced storage by 1.68 KB”,
“2021-04-14 12:38:54 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2021-04-14 12:38:59 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (1.21 KB)”,
“2021-04-14 12:38:59 -04 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-RemoteUnwantedMissingFile]: removing file listed as Temporary: duplicati-b94bd2b16897f41eb9ef9d6910fae13c9.dblock.zip.aes”,
“2021-04-14 12:38:59 -04 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-RemoteUnwantedMissingFile]: removing file listed as Temporary: duplicati-ifabea2381bff4b88b009edc2ea4d7322.dindex.zip.aes”,
“2021-04-14 12:39:00 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20210325T222803Z.dlist.zip.aes (57.62 MB)”,
“2021-04-14 12:39:02 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20210325T222803Z.dlist.zip.aes (57.62 MB)”
],
“Warnings”: ,
“Errors”: [
“2021-04-14 12:39:45 -04 - [Error-Duplicati.Library.Main.Operation.TestHandler-FailedToProcessFile]: Failed to process file duplicati-20210325T222803Z.dlist.zip.aes”
],
“BackendStatistics”: {
“RemoteCalls”: 13,
“BytesUploaded”: 1722,
“BytesDownloaded”: 354579515,
“FilesUploaded”: 2,
“FilesDownloaded”: 7,
“FilesDeleted”: 2,
“FoldersCreated”: 0,
“RetryAttempts”: 4,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 1240,
“KnownFileSize”: 32452178504,
“LastBackupDate”: “2021-03-29T11:41:58-04:00”,
“BackupListCount”: 2,
“TotalQuotaSpace”: 5000845586432,
“FreeQuotaSpace”: 4609682558976,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2021-04-14T16:38:15.2616497Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
}

drwtsn32 · April 14, 2021, 6:32pm

Page 2 of your backup job configuration. This is the Destination configuration. There is a dropdown labeled “Storage Type”. What is it set to?

What antivirus software are you using?

h82w84 · April 14, 2021, 11:46pm

backup connection tested successfully, Readyshare drive with netgear router shows up locally and configured properly as I can use any media to play or store from remote. The antivirus firewall has full control to duplicati and not an issue.

Backup destination. The new log after I can shows 2 error and is as follows:

2021-04-14 19:32:38 -04 - [Error-Duplicati.Library.Main.Operation.TestHandler-FailedToProcessFile]: Failed to process file duplicati-bfb7c8d9c3388483da02f1b11663ab43c.dblock.zip.aes

drwtsn32 · April 15, 2021, 3:47am

Please tell me what the Storage Type is set to. What does this yellow highlighted area say? Does it say “FTP”, “Local folder or drive”, or something else? This is an important detail and may be relevant to your issue.

capture

The “full control to duplicati” doesn’t make sense to me. I’m not sure what you mean. Reason I am asking about antivirus is because it can sometimes interfere with the duplicati files. What antivirus program is it? Can you try disabling it temporarily just to re-test?

h82w84 · April 15, 2021, 1:18pm

Storage Type: Local folder or drive
Folder path: B:\MRVBPR1\

The firewall has zero interference with duplicati and even disabling the antivirus and the firewall give the errors.

drwtsn32 · April 15, 2021, 2:35pm

I didn’t think the firewall mattered, but we have seen some antivirus products block access to the temp files Duplicati builds. Thank you for testing with it disabled just to rule it out.

Also thank you for confirming storage type.

All I can tell at this point is it seems the files are not reading back correctly when Duplicati is doing the testing phase.

Just as a test - can you try doing backups to a different USB drive attached directly to your computer?

kees-z · May 19, 2021, 11:27am

In case this is still an issue:
Drive letters A: en B: are reserved for floppy disk drives, can you try to map another drive letter to the external drive?