thanks again @ts678 !
First, I believe right after the successful restore from that destination, I did not see the log entry, that is available now:
Warnings 1
- 2021-08-18 22:07:38 +02 - [Warning-Duplicati.Library.Main.Operation.RestoreHandler-MetadataWriteFailed]: Failed to apply metadata to file: “/pool2/pool2/pool2/”, message: Invalid parameter
Under “Full protocol” there is:
{
“RestoredFiles”: 3,
“SizeOfRestoredFiles”: 221620,
“RestoredFolders”: 0,
“RestoredSymlinks”: 0,
“PatchedFiles”: 0,
“DeletedFiles”: 0,
“DeletedFolders”: 0,
“DeletedSymlinks”: 0,
“MainOperation”: “Restore”,
“RecreateDatabaseResults”: null,
“ParsedResult”: “Warning”,
“Version”: “2.0.6.3 (2.0.6.3_beta_2021-06-17)”,
“EndTime”: “2021-08-18T20:07:38.43874Z”,
“BeginTime”: “2021-08-18T20:05:08.358465Z”,
“Duration”: “00:02:30.0802750”,
“MessagesActualLength”: 7,
“WarningsActualLength”: 1,
“ErrorsActualLength”: 0,
“Messages”: [
“2021-08-18 22:05:08 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: Die Operation Restore wurde gestartet”,
“2021-08-18 22:05:08 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2021-08-18 22:06:57 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (20,09 KB)”,
“2021-08-18 22:07:00 +02 - [Information-Duplicati.Library.Main.Database.LocalRestoreDatabase-SearchingBackup]: Searching backup 0 (8/15/2021 12:37:25 PM) …”,
“2021-08-18 22:07:19 +02 - [Information-Duplicati.Library.Main.Operation.RestoreHandler-RemoteFileCount]: 1 remote files are required to restore”,
“2021-08-18 22:07:19 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-b2ff5c2cedf9c4937ba9b1c5732811058.dblock.zip.aes (49,90 MB)”,
“2021-08-18 22:07:38 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-b2ff5c2cedf9c4937ba9b1c5732811058.dblock.zip.aes (49,90 MB)”
],
“Warnings”: [
“2021-08-18 22:07:38 +02 - [Warning-Duplicati.Library.Main.Operation.RestoreHandler-MetadataWriteFailed]: Failed to apply metadata to file: "/pool2/pool2/pool2/", message: Invalid parameter”
],
“Errors”: ,
“BackendStatistics”: {
“RemoteCalls”: 2,
“BytesUploaded”: 0,
“BytesDownloaded”: 52328509,
“FilesUploaded”: 0,
“FilesDownloaded”: 1,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 382,
“UnknownFileCount”: 1,
“KnownFileCount”: 20573,
“KnownFileSize”: 539273462601,
“LastBackupDate”: “2021-08-15T14:37:25+02:00”,
“BackupListCount”: 2,
“TotalQuotaSpace”: 1099511627776,
“FreeQuotaSpace”: 560224478441,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Restore”,
“ParsedResult”: “Success”,
“Version”: “2.0.6.3 (2.0.6.3_beta_2021-06-17)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2021-08-18T20:05:08.358469Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
}
That looks OK to me and as stated before, that files I called, did actually come.
Now on to the TEST command I ran from “command line via GUI”. When I wrote up the last post, I just triggered the TEST with 1 sample, meanwhile gave it 30+ hours so far. The GUI still said “Laufende Aufgabe: Sicherung wird gestartet…” (probably “Running task: starting backup…”). So far, there was no new log entry, neither at the job at General or Remote, nor in the About - Show Logs section under Saved or Live. Hitting the “abort” button showed the stop options but it seems I can click whatever I want, it has no effect. So, again, I had to force the container into restart, to get back in control. After restart, still no log entries about the job that ran for 30+ hours.
I then ran the VERIFY FILES command on another, smaller backup set to see if maybe it’s a network thing or it just hangs based on certain commands. It completed just fine:
{
“MainOperation”: “Test”,
“VerificationsActualLength”: 3,
“Verifications”: [
{
“Key”: “duplicati-20210808T093809Z.dlist.zip.aes”,
“Value”:
},
{
“Key”: “duplicati-ibc6b566cdab345b499fd34a2e463c52b.dindex.zip.aes”,
“Value”:
},
{
“Key”: “duplicati-b32cbd0a60cb84153bf10e9a78eaa3419.dblock.zip.aes”,
“Value”:
}
],
“ParsedResult”: “Success”,
“Version”: “2.0.6.3 (2.0.6.3_beta_2021-06-17)”,
“EndTime”: “2021-08-20T10:32:46.520301Z”,
“BeginTime”: “2021-08-20T10:31:45.618322Z”,
“Duration”: “00:01:00.9019790”,
“MessagesActualLength”: 9,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: [
“2021-08-20 12:31:45 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: Die Operation Test wurde gestartet”,
“2021-08-20 12:31:55 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2021-08-20 12:32:19 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (3,38 KB)”,
“2021-08-20 12:32:19 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20210808T093809Z.dlist.zip.aes (11,17 MB)”,
“2021-08-20 12:32:23 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20210808T093809Z.dlist.zip.aes (11,17 MB)”,
“2021-08-20 12:32:23 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-ibc6b566cdab345b499fd34a2e463c52b.dindex.zip.aes (28,20 KB)”,
“2021-08-20 12:32:24 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-ibc6b566cdab345b499fd34a2e463c52b.dindex.zip.aes (28,20 KB)”,
“2021-08-20 12:32:32 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-b32cbd0a60cb84153bf10e9a78eaa3419.dblock.zip.aes (50,00 MB)”,
“2021-08-20 12:32:46 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-b32cbd0a60cb84153bf10e9a78eaa3419.dblock.zip.aes (50,00 MB)”
],
“Warnings”: ,
“Errors”: ,
“BackendStatistics”: {
“RemoteCalls”: 4,
“BytesUploaded”: 0,
“BytesDownloaded”: 64170375,
“FilesUploaded”: 0,
“FilesDownloaded”: 3,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 3460,
“KnownFileSize”: 90473071108,
“LastBackupDate”: “2021-08-08T11:52:12+02:00”,
“BackupListCount”: 4,
“TotalQuotaSpace”: 1099511627776,
“FreeQuotaSpace”: 906415691671,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Test”,
“ParsedResult”: “Success”,
“Version”: “2.0.6.3 (2.0.6.3_beta_2021-06-17)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2021-08-20T10:31:45.619076Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
}
General verbose log is:
-
Aug 20, 2021 12:32 PM: Die Operation Test ist abgeschlossen
-
Aug 20, 2021 12:32 PM: Backend event: Get - Completed: duplicati-b32cbd0a60cb84153bf10e9a78eaa3419.dblock.zip.aes (50,00 MB)
-
Aug 20, 2021 12:32 PM: Backend event: Get - Started: duplicati-b32cbd0a60cb84153bf10e9a78eaa3419.dblock.zip.aes (50,00 MB)
-
Aug 20, 2021 12:32 PM: Backend event: Get - Completed: duplicati-ibc6b566cdab345b499fd34a2e463c52b.dindex.zip.aes (28,20 KB)
-
Aug 20, 2021 12:32 PM: Backend event: Get - Started: duplicati-ibc6b566cdab345b499fd34a2e463c52b.dindex.zip.aes (28,20 KB)
-
Aug 20, 2021 12:32 PM: Backend event: Get - Completed: duplicati-20210808T093809Z.dlist.zip.aes (11,17 MB)
-
Aug 20, 2021 12:32 PM: Backend event: Get - Started: duplicati-20210808T093809Z.dlist.zip.aes (11,17 MB)
-
Aug 20, 2021 12:32 PM: Backend event: List - Completed: (3,38 KB)
-
Aug 20, 2021 12:31 PM: Backend event: List - Started: ()
-
Aug 20, 2021 12:31 PM: Die Operation Test wurde gestartet
-
Aug 20, 2021 12:29 PM: Server has started and is listening on 0.0.0.0, port 8200
So next, I ran the VERIFY FILES on the backup set in question here (8x bigger). To my surprise, it completes within 3-4 minutes and concludes in positive log:
{
“MainOperation”: “Test”,
“VerificationsActualLength”: 3,
“Verifications”: [
{
“Key”: “duplicati-20210815T123725Z.dlist.zip.aes”,
“Value”:
},
{
“Key”: “duplicati-i7ecac5e668b44b3eb51f93c7d22a8719.dindex.zip.aes”,
“Value”:
},
{
“Key”: “duplicati-b4623746c4c334f678414840a57cac76b.dblock.zip.aes”,
“Value”:
}
],
“ParsedResult”: “Success”,
“Version”: “2.0.6.3 (2.0.6.3_beta_2021-06-17)”,
“EndTime”: “2021-08-20T10:42:40.467838Z”,
“BeginTime”: “2021-08-20T10:39:39.181759Z”,
“Duration”: “00:03:01.2860790”,
“MessagesActualLength”: 9,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: [
“2021-08-20 12:39:39 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Test has started”,
“2021-08-20 12:40:02 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2021-08-20 12:41:48 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (20.09 KB)”,
“2021-08-20 12:41:50 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20210815T123725Z.dlist.zip.aes (24.96 MB)”,
“2021-08-20 12:41:57 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20210815T123725Z.dlist.zip.aes (24.96 MB)”,
“2021-08-20 12:41:57 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-i7ecac5e668b44b3eb51f93c7d22a8719.dindex.zip.aes (17.97 KB)”,
“2021-08-20 12:41:58 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-i7ecac5e668b44b3eb51f93c7d22a8719.dindex.zip.aes (17.97 KB)”,
“2021-08-20 12:42:25 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-b4623746c4c334f678414840a57cac76b.dblock.zip.aes (49.92 MB)”,
“2021-08-20 12:42:40 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-b4623746c4c334f678414840a57cac76b.dblock.zip.aes (49.92 MB)”
],
“Warnings”: ,
“Errors”: ,
“BackendStatistics”: {
“RemoteCalls”: 4,
“BytesUploaded”: 0,
“BytesDownloaded”: 78544871,
“FilesUploaded”: 0,
“FilesDownloaded”: 3,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 382,
“UnknownFileCount”: 1,
“KnownFileCount”: 20573,
“KnownFileSize”: 539273462601,
“LastBackupDate”: “2021-08-15T14:37:25+02:00”,
“BackupListCount”: 2,
“TotalQuotaSpace”: 1099511627776,
“FreeQuotaSpace”: 560224478441,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Test”,
“ParsedResult”: “Success”,
“Version”: “2.0.6.3 (2.0.6.3_beta_2021-06-17)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2021-08-20T10:39:39.182485Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
}
So, next thing was I hit Database - Repair. Took another few minutes and (apart from many other log entries in Verbose, of course) resulted in successful completion:
Aug 20, 2021 12:48 PM: Destination and database are synchronized, not making any changes
Finally, I dared to simply hit Run Now and I’ll see if maybe all the finagling with restarts, test and verify commands broke the Gordian knot. After 2-3 minutes, an error popped:
Failed to connect: The database file is locked
database is locked
After I clicked OK, however, it continued to count files and gigabytes AND NOW…
it completed the d### f### backup with now 2 versions available. hahahah

Well, I don’t know what exactly did the trick but @ts678 you certainly helped me maneuver through this. Thank you yet again!
For everyone else, who runs into the same trouble, maybe our extensive logging steps help find their way, too.
For the DevTeam, if I can contribute to preventing the same happening to others in anyways, please let me know!
Cheers, degudejung