Returning errors after running Test Command

Good afternoon,

I have run a test through the command-line on 320 samples with the option full-remote-verification.
I have around 3950 Duplicati’s files in total on the remote server. Each sample is 3 files so it is approx 25% of the files that have been tested.

I get the following result on the “Running commandline entry” page:

duplicati-if6df543d19f541549644278ea218f9f3.dindex.zip.aes: 1 errors
Extra: pTh7g/UFWq8ybW66EvcKT62DCRS1NEdgyggvixyPJb8=

duplicati-ic4b0123181fe4f59859f0669f4e9b069.dindex.zip.aes: 1 errors
Extra: tRPvdixeOR7uBFfHXbVCM8BowTOthk9PbFMmLiU3KBQ=

duplicati-b36012929fa5847d4a8e90364e517461d.dblock.zip.aes: 1 errors
Extra: jPZjna2BNElBBwicHW6xtFzY0KBWuMrGTvM5RW8aDOw=

duplicati-b949f8a7442004984843c24048d0df93d.dblock.zip.aes: 1 errors
Extra: ciOdv/NKQ00hQFfQBEBNIUEegUDWnUK9N9LbZiVIs7U=

duplicati-b0a37db9c31a64e349f883e97b9e68a1c.dblock.zip.aes: 2 errors
Extra: URGA24ypHnaRTIky2vzh+SeCxox4XnWwgO074k+4p9g=
Extra: r1Vw9aGBC3r3jK9LxwpmDw31HkK6+R1N5bIyjeDoPfw=

duplicati-b7968c48387904024a8cef5a7dcbbcc36.dblock.zip.aes: 1 errors
Extra: tRPvdixeOR7uBFfHXbVCM8BowTOthk9PbFMmLiU3KBQ=

Return code: 3

I was wondering the following:

  • What can I do now to solve these error?
  • How can I know which files and versions are affected by these errors
  • What they implies? If one of these errors are on my 20 Gb PST file, this will make impossible to restore? Just a specific version of it?
  • What is the meaning of the

Return code: 3

I paste below the log I get from the GUI homepage for that test. As you can see no error is reported:

MainOperation: Test
Verifications: [
Key: duplicati-20190429T171727Z.dlist.zip.aes
Value: ,
Key: duplicati-20190114T223432Z.dlist.zip.aes
Value: ,
Key: duplicati-20180604T151129Z.dlist.zip.aes
Value: ,
Key: duplicati-20190620T131138Z.dlist.zip.aes
Value: ,
Key: duplicati-20190510T161332Z.dlist.zip.aes
Value: ,

]
ParsedResult: Success
Version: 2.0.4.5 (2.0.4.5_beta_2018-11-28)
EndTime: 14/07/2019 19:24:25 (1563125065)
BeginTime: 14/07/2019 14:17:17 (1563106637)
Duration: 05:07:08.1182103
Messages: [
2019-07-14 14:17:17 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Test has started,
2019-07-14 14:18:21 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: (),
2019-07-14 14:18:29 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (3.87 KB),
2019-07-14 14:18:29 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20190429T171727Z.dlist.zip.aes (3.73 MB),
2019-07-14 14:18:34 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20190429T171727Z.dlist.zip.aes (3.73 MB),

]
Warnings:
Errors:
BackendStatistics:
RemoteCalls: 947
BytesUploaded: 0
BytesDownloaded: 22424984506
FilesUploaded: 0
FilesDownloaded: 946
FilesDeleted: 0
FoldersCreated: 0
RetryAttempts: 0
UnknownFileSize: 0
UnknownFileCount: 0
KnownFileCount: 3967
KnownFileSize: 100108845603
LastBackupDate: 12/07/2019 19:13:18 (1562951598)
BackupListCount: 86
TotalQuotaSpace: 0
FreeQuotaSpace: 0
AssignedQuotaSpace: -1
ReportedQuotaError: False
ReportedQuotaWarning: False
ParsedResult: Success
Version: 2.0.4.5 (2.0.4.5_beta_2018-11-28)
Messages: [
2019-07-14 14:17:17 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Test has started,
2019-07-14 14:18:21 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: (),
2019-07-14 14:18:29 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (3.87 KB),
2019-07-14 14:18:29 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20190429T171727Z.dlist.zip.aes (3.73 MB),
2019-07-14 14:18:34 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20190429T171727Z.dlist.zip.aes (3.73 MB),

]
Warnings:
Errors:

This is more as a comment than a request for support. If I had not checked the results shown on the command-line page, I would never been aware of the above mentioned error.

Thanks for your time.

Anyone can help me with these errors?

I only have answers for 2 out of 4 questions. We’ll see if anyone else wants to try on the other questions:

The AFFECTED command could be fed the remote filename of concern.

looks like it’s just what’s returned if you got past “No files examined, is the remote destination is empty?” which is 100, and “Examined {0} files and found no errors” which is 0. It explains errors then returns a 3, which means the return code documentation isn’t quite right, or maybe the return code here isn’t right…

C:\Program Files\Duplicati 2>Duplicati.CommandLine.exe help returncodes

Duplicati reports the following return/exit codes:
  0 - Success
  1 - Successful operation, but no files were changed
  2 - Successful operation, but with warnings
  50 - Backup uploaded some files, but did not finish
  100 - An error occurred
  200 - Invalid commandline arguments found



C:\Program Files\Duplicati 2>

One experiment you could do, if you can figure out what’s potentially impacted by a file giving complaints, would be to try a file restore and see whether or not the restore will restore the source file properly or not. Restore to some other area of course, not directly on top of the original file which might make it incorrect.

Generally I would think “Extra” information is fairly harmless, but others sound worrisome, per the below:

The lead developer doesn’t answer as much here as before, but Google found several previous thoughts:

Verify a specific dblock.zip.aes file (specifically sounds pretty harmless)

Question about TEST command vs. Backup with –full-remote-verification and backup-test-samples (implicitly sounds pretty harmless, however with wrong guess at cause)

How to recover backup with damaged dblock file? (has thoughts, user tries lots of repairs, made it worse)

This is me jumping in with a technical deep dive plus guesses when I hit this one. That killed that topic. :disappointed:

Or maybe it is correct… 3 could be the 1 and 2 results OR’ed because both apply… .successful operation, no files were changed, but we got some warnings.

“OR’ed” doesn’t fit 50/100/200 very well, plus I’d hope any attempt at a bitmask-type return would be noted.

My guess is that someone just extended past 2 but for some reason wanted to distinguish from 100 return.

EDIT: Above code is from Backup not Test.

1 Like

That is most likely the answer. :slight_smile:

Thanks a lot for your time @ts678

I have run the AFFECTED command, I paste below one of the result if it has any interest for you:

The following filesets are affected:
0 : 17/07/2019 21:09:38
1 : 16/07/2019 21:54:30
2 : 15/07/2019 19:11:14
3 : 14/07/2019 20:45:29
4 : 12/07/2019 19:13:18
5 : 11/07/2019 19:16:32
6 : 10/07/2019 18:55:34
7 : 09/07/2019 19:06:45
8 : 08/07/2019 19:22:42
9 : 03/07/2019 19:48:53
10 : 02/07/2019 20:50:41
11 : 01/07/2019 22:30:20
12 : 28/06/2019 14:52:06
13 : 27/06/2019 20:45:23
14 : 26/06/2019 20:59:03
15 : 25/06/2019 19:16:12
16 : 21/06/2019 18:36:23
17 : 20/06/2019 15:11:38
18 : 19/06/2019 18:33:17
19 : 18/06/2019 18:40:47
20 : 17/06/2019 18:18:59
21 : 14/06/2019 16:59:22
22 : 13/06/2019 19:16:34
23 : 13/06/2019 8:16:55
24 : 11/06/2019 20:29:22
25 : 08/06/2019 23:25:00
26 : 06/06/2019 19:46:25
27 : 05/06/2019 18:50:46
28 : 04/06/2019 16:38:42
29 : 03/06/2019 19:04:45
30 : 31/05/2019 20:50:24
31 : 30/05/2019 20:27:15
32 : 28/05/2019 19:18:38
33 : 27/05/2019 19:36:25
34 : 24/05/2019 15:43:30
35 : 23/05/2019 20:28:44
36 : 22/05/2019 16:50:54
37 : 21/05/2019 19:03:29
38 : 20/05/2019 17:39:29
39 : 17/05/2019 16:13:08
40 : 16/05/2019 19:16:38
41 : 15/05/2019 19:14:55
42 : 14/05/2019 18:19:11
43 : 13/05/2019 19:11:51
44 : 10/05/2019 18:13:32
45 : 09/05/2019 18:21:42
46 : 08/05/2019 18:52:56
47 : 07/05/2019 17:30:10
48 : 06/05/2019 17:17:49
49 : 03/05/2019 14:36:44
50 : 02/05/2019 19:33:56
51 : 30/04/2019 19:52:24
52 : 29/04/2019 19:17:27
53 : 26/04/2019 18:56:44
54 : 25/04/2019 21:34:31
55 : 24/04/2019 19:16:03
56 : 23/04/2019 19:32:55
57 : 18/04/2019 16:09:31
58 : 17/04/2019 16:45:14
59 : 10/04/2019 18:30:15
60 : 03/04/2019 18:16:37
61 : 26/03/2019 22:19:40
62 : 19/03/2019 19:11:17
63 : 11/03/2019 19:27:18
64 : 01/03/2019 17:01:37
65 : 22/02/2019 16:37:50
66 : 15/02/2019 15:19:46
67 : 07/02/2019 20:04:25
68 : 30/01/2019 21:05:18
69 : 22/01/2019 22:11:42
70 : 14/01/2019 23:34:32
71 : 04/01/2019 19:14:13
72 : 28/12/2018 1:40:47
73 : 18/12/2018 22:17:32
74 : 11/12/2018 20:09:58
75 : 02/12/2018 22:32:07
76 : 22/11/2018 22:24:11
77 : 15/11/2018 16:25:17
78 : 06/11/2018 19:22:09

A total of 73 file(s) are affected:
C:\Users\USER\AppData\Roaming\Microsoft\Outlook\Outlook.xml
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\hs3b7z31.default - Copy
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\hs3b7z31.default - Copy\storage\default\about+newtab\idb
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\hs3b7z31.default - Copy\storage\default\https+++mega.nz\idb
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\hs3b7z31.default - Copy\storage\default\https+++www.flightradar24.com\idb
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\hs3b7z31.default - Copy\storage\default\moz-extension+++069725ca-62b4-42c8-a635-7e42a7190f13\idb
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\hs3b7z31.default - Copy\storage\permanent\chrome\idb
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\hs3b7z31.default - Copy\storage\permanent\indexeddb+++fx-devtools\idb
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\hs3b7z31.default - Copy\storage\permanent\moz-safe-about+home\idb
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\AlternateServices.txt
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\SecurityPreloadState.txt
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\SiteSecurityServiceState.txt
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\TRRBlacklist.txt
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\addonStartup.json.lz4
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\addons.json
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\bookmarkbackups
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\broadcast-listeners.json
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\content-prefs.sqlite
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\cookies.sqlite
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\crashes
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\crashes\store.json.mozlz4
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\datareporting
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\datareporting\archived\2018-11
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\datareporting\archived\2018-11\1541489168250.3af3fd7b-23f4-4e89-a7f7-9933465b1e6d.main.jsonlz4
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\datareporting\archived\2018-11\1541492078145.904a68b4-1985-46ff-be68-12e7899403af.event.jsonlz4
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\datareporting\archived\2018-11\1541492085835.b447767b-bcc0-4087-8877-d27c794d9b1d.health.jsonlz4
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\datareporting\archived\2018-11\1541501481730.f3b54850-66e2-49ca-8d62-7fc30c053867.health.jsonlz4
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\datareporting\archived\2018-11\1541501605135.c2e4f4f1-0524-4efc-bfb6-7e72f11f2df9.modules.jsonlz4
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\datareporting\archived\2018-11\1541503313490.882f5dfa-9c11-40f2-9d00-7ec4c1a8c934.health.jsonlz4
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\datareporting\archived\2018-11\1541503313543.78461985-25a6-41e6-b04f-6f74d25e172b.main.jsonlz4
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\datareporting\archived\2018-11\1541515240116.36289b62-1cbd-47f0-8d02-4a246d993c88.main.jsonlz4
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\datareporting\archived\2018-11\1541525178324.57142670-eeb4-4de6-bcf4-5c4e6dbcbb79.main.jsonlz4
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\datareporting\archived\2018-11\1541527568602.51030d20-0c94-4e5f-8bc3-bb9e774bb826.main.jsonlz4
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\datareporting\session-state.json
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\extensions.json
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\favicons.sqlite
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\formhistory.sqlite
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\parent.lock
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\places.sqlite
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\prefs.js
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\saved-telemetry-pings
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\sessionCheckpoints.json
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\sessionstore-backups
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\sessionstore-backups\previous.jsonlz4
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\sessionstore-backups\recovery.baklz4
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\sessionstore-backups\recovery.jsonlz4
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\sessionstore.jsonlz4
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\shield-preference-experiments.json
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\storage-sync.sqlite
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\storage\default
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\storage\default\about+home\idb
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\storage\default\about+newtab.metadata-v2
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\storage\default\about+newtab\idb
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\storage\default\about+newtab\idb\3312185054sbndi_pspte.files
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\storage\default\about+newtab\idb\3312185054sbndi_pspte.files\429
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\storage\default\about+newtab\idb\3312185054sbndi_pspte.files\journals
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\storage\default\about+newtab\idb\3312185054sbndi_pspte.sqlite
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\storage\default\https+++mega.nz\idb
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\storage\default\https+++www.flightradar24.com\idb
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\storage\default\moz-safe-about+home\idb
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\storage\permanent\chrome\idb
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\storage\permanent\chrome\idb\1657114595AmcateirvtiSty.sqlite
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\storage\permanent\chrome\idb\3345959086bslnoocdkdlaiFs2t%s.sqlite
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\storage\permanent\indexeddb+++fx-devtools\idb
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372772739\webappsstore.sqlite
C:\Users\USER\AppData\Roaming\Mozilla\Firefox\Profiles\dieyusie.default-1398372
C:\Users\USER\Desktop
C:\Users\USER\Desktop\06112018154055.pdf
E:\Outlook
E:\Outlook\Outlook.pst
E:\V.A.P\prg\Video\captvty-2.7.6
E:\V.A.P\prg\Video\captvty-2.7.6\captvty.ini

The following related log messages were found:
14/07/2019 17:24:27: {“Size”:51755149,“Hash”:“QqufE/D7pbxMZKN+dE2puS+Dz3DtPqJKTU6UZmPcWc8=”}

Return code: 0

Look a little bit scary because nearly all filesets look to be affected but it is only Extra warning.

I will try to restore a file and version flagged as affected. I will let you know.

Again @ts678, thanks a lot for your time and your detailed response. (And it is not the first time that you help me!) :slightly_smiling_face: