Unexpected difference in fileset version error

[dr8876]

OK. Here’s the log for the backup. Looks like I got warnings, but no error.

        {

“DeletedFiles”: 234,
“DeletedFolders”: 80,
“ModifiedFiles”: 72,
“ExaminedFiles”: 4862,
“OpenedFiles”: 97,
“AddedFiles”: 25,
“SizeOfModifiedFiles”: 544963,
“SizeOfAddedFiles”: 98314330,
“SizeOfExaminedFiles”: 18672391791,
“SizeOfOpenedFiles”: 188162286,
“NotProcessedFiles”: 0,
“AddedFolders”: 1,
“TooLargeFiles”: 0,
“FilesWithError”: 0,
“ModifiedFolders”: 0,
“ModifiedSymlinks”: 0,
“AddedSymlinks”: 0,
“DeletedSymlinks”: 0,
“PartialBackup”: false,
“Dryrun”: false,
“MainOperation”: “Backup”,
“CompactResults”: null,
“VacuumResults”: null,
“DeleteResults”: {
“DeletedSetsActualLength”: 0,
“DeletedSets”: ,
“Dryrun”: false,
“MainOperation”: “Delete”,
“CompactResults”: null,
“ParsedResult”: “Success”,
“Interrupted”: false,
“Version”: “2.0.7.100 (2.0.7.100_canary_2023-12-27)”,
“EndTime”: “2024-03-19T21:04:10.3225449Z”,
“BeginTime”: “2024-03-19T21:04:09.7485412Z”,
“Duration”: “00:00:00.5740037”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null,
“BackendStatistics”: {
“RemoteCalls”: 10,
“BytesUploaded”: 100880609,
“BytesDownloaded”: 53151847,
“FilesUploaded”: 5,
“FilesDownloaded”: 3,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 835,
“KnownFileSize”: 19113367495,
“LastBackupDate”: “2024-03-19T16:48:28-04:00”,
“BackupListCount”: 21,
“TotalQuotaSpace”: 0,
“FreeQuotaSpace”: 0,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Interrupted”: false,
“Version”: “2.0.7.100 (2.0.7.100_canary_2023-12-27)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2024-03-19T20:48:28.2521562Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
},
“RepairResults”: null,
“TestResults”: {
“MainOperation”: “Test”,
“VerificationsActualLength”: 3,
“Verifications”: [
{
“Key”: “duplicati-20240313T142539Z.dlist.zip.aes”,
“Value”:
},
{
“Key”: “duplicati-ib331108f4e6a445d92094f86ecd21613.dindex.zip.aes”,
“Value”:
},
{
“Key”: “duplicati-b8c9df816e09d4ddf8140f9a74e20e1a8.dblock.zip.aes”,
“Value”:
}
],
“ParsedResult”: “Success”,
“Interrupted”: false,
“Version”: “2.0.7.100 (2.0.7.100_canary_2023-12-27)”,
“EndTime”: “2024-03-19T21:04:18.4790251Z”,
“BeginTime”: “2024-03-19T21:04:10.7055492Z”,
“Duration”: “00:00:07.7734759”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null,
“BackendStatistics”: {
“RemoteCalls”: 10,
“BytesUploaded”: 100880609,
“BytesDownloaded”: 53151847,
“FilesUploaded”: 5,
“FilesDownloaded”: 3,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 835,
“KnownFileSize”: 19113367495,
“LastBackupDate”: “2024-03-19T16:48:28-04:00”,
“BackupListCount”: 21,
“TotalQuotaSpace”: 0,
“FreeQuotaSpace”: 0,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Interrupted”: false,
“Version”: “2.0.7.100 (2.0.7.100_canary_2023-12-27)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2024-03-19T20:48:28.2521562Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
},
“ParsedResult”: “Warning”,
“Interrupted”: false,
“Version”: “2.0.7.100 (2.0.7.100_canary_2023-12-27)”,
“EndTime”: “2024-03-19T21:04:18.5061209Z”,
“BeginTime”: “2024-03-19T20:48:28.2521562Z”,
“Duration”: “00:15:50.2539647”,
“MessagesActualLength”: 23,
“WarningsActualLength”: 20,
“ErrorsActualLength”: 0,
“Messages”: [
“2024-03-19 16:48:28 -04 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started”,
“2024-03-19 16:48:29 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2024-03-19 16:48:29 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (830 bytes)”,
“2024-03-19 17:03:50 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b66ab7357832d4bc6815eff4a181d9527.dblock.zip.aes (49.95 MB)”,
“2024-03-19 17:03:53 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b3c30b91b79fd44319f0ef5ea87c8722d.dblock.zip.aes (45.43 MB)”,
“2024-03-19 17:04:07 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b66ab7357832d4bc6815eff4a181d9527.dblock.zip.aes (49.95 MB)”,
“2024-03-19 17:04:07 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-i2e0ef74ed61c4091a9b197ad2510b6e4.dindex.zip.aes (93.29 KB)”,
“2024-03-19 17:04:07 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b3c30b91b79fd44319f0ef5ea87c8722d.dblock.zip.aes (45.43 MB)”,
“2024-03-19 17:04:07 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-i4092298d162a479fb1279c340da14286.dindex.zip.aes (94.09 KB)”,
“2024-03-19 17:04:08 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-i2e0ef74ed61c4091a9b197ad2510b6e4.dindex.zip.aes (93.29 KB)”,
“2024-03-19 17:04:08 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-i4092298d162a479fb1279c340da14286.dindex.zip.aes (94.09 KB)”,
“2024-03-19 17:04:08 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-20240319T204828Z.dlist.zip.aes (660.25 KB)”,
“2024-03-19 17:04:09 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-20240319T204828Z.dlist.zip.aes (660.25 KB)”,
“2024-03-19 17:04:10 -04 - [Information-Duplicati.Library.Main.Operation.DeleteHandler-DeleteResults]: No remote filesets were deleted”,
“2024-03-19 17:04:10 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2024-03-19 17:04:10 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (835 bytes)”,
“2024-03-19 17:04:10 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20240313T142539Z.dlist.zip.aes (688.93 KB)”,
“2024-03-19 17:04:11 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20240313T142539Z.dlist.zip.aes (688.93 KB)”,
“2024-03-19 17:04:11 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-ib331108f4e6a445d92094f86ecd21613.dindex.zip.aes (27.31 KB)”,
“2024-03-19 17:04:12 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-ib331108f4e6a445d92094f86ecd21613.dindex.zip.aes (27.31 KB)”
],
“Warnings”: [
“2024-03-19 16:48:30 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root\Center for Biblical Studies\\r\nFileNotFoundException: Could not find file ‘\\?\E:\empower\Root\Center for Biblical Studies\’.”,
“2024-03-19 16:48:30 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root\Center for Biblical Studies\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root\Center for Biblical Studies’.”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root\TCPs\West Bengal\TCP_IND_WB_HARVESTERS OUTREACH INDIA_001\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root\TCPs\West Bengal\TCP_IND_WB_HARVESTERS OUTREACH INDIA_001\’.”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root\TCPs\West Bengal\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root\TCPs\West Bengal’.”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root\TCPs\Assam\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root\TCPs\Assam’.”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root\TCPs\West Bengal\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root\TCPs\West Bengal’.”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root\TCPs\Assam\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root\TCPs\Assam’.”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root\TCPs\West Bengal\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root\TCPs\West Bengal’.”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root\TCPs\National Master List\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root\TCPs\National Master List’.”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root\TCPs\National Master List\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root\TCPs\National Master List’.”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root\TCPs\Assam\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root\TCPs\Assam’.”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root\TCPs\Assam\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root\TCPs\Assam’.”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.MetadataGenerator.Metadata-MetadataProcessFailed]: Failed to process metadata for "E:\empower\Root\TCPs\West Bengal\", storing empty metadata\r\nDirectoryNotFoundException: \\?\E:\empower\Root\TCPs\West Bengal”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root\TCPs\National Master List\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root\TCPs\National Master List’.”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: E:\empower\Root\TCPs\West Bengal\\r\nFileNotFoundException: Could not find file ‘\\?\E:\empower\Root\TCPs\West Bengal\’.”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root\TCPs\National Master List\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root\TCPs\National Master List’.”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.MetadataGenerator.Metadata-MetadataProcessFailed]: Failed to process metadata for "E:\empower\Root\TCPs\Assam\", storing empty metadata\r\nDirectoryNotFoundException: \\?\E:\empower\Root\TCPs\Assam”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: E:\empower\Root\TCPs\Assam\\r\nFileNotFoundException: Could not find file ‘\\?\E:\empower\Root\TCPs\Assam\’.”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.MetadataGenerator.Metadata-MetadataProcessFailed]: Failed to process metadata for "E:\empower\Root\TCPs\National Master List\", storing empty metadata\r\nDirectoryNotFoundException: \\?\E:\empower\Root\TCPs\National Master List”,
“2024-03-19 16:48:31 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: E:\empower\Root\TCPs\National Master List\\r\nFileNotFoundException: Could not find file ‘\\?\E:\empower\Root\TCPs\National Master List\’.”
],
“Errors”: ,
“BackendStatistics”: {
“RemoteCalls”: 10,
“BytesUploaded”: 100880609,
“BytesDownloaded”: 53151847,
“FilesUploaded”: 5,
“FilesDownloaded”: 3,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 835,
“KnownFileSize”: 19113367495,
“LastBackupDate”: “2024-03-19T16:48:28-04:00”,
“BackupListCount”: 21,
“TotalQuotaSpace”: 0,
“FreeQuotaSpace”: 0,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Interrupted”: false,
“Version”: “2.0.7.100 (2.0.7.100_canary_2023-12-27)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2024-03-19T20:48:28.2521562Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
}

[dr8876]

Had to run again to get no errors and NO WARNINGS! SUCCESS!!

[dr8876]

I wonder why the canary version worked and the stable one did not?

[ts678]

@dr8876

I wonder why the canary version worked and the stable one did not?

@dr8876

Before changing to the Canary version, I tried to delete the version number mentioned in the error code (I think it was 3), but that did not get rid of the error.

So you might have had 3 and 4 bad, deleted 3 on Beta so 4 became 3, then Canary deleted 3.

EDIT:

or maybe you actually deleted 4 the first time. That would be more in what I think is verify order.
Whatever the order is, Beta stops on the first error, Canary keeps going, so shows all bad ones.

[ts678]

Another way to tell is to look in the job logs to see if you can find the second and first deletes. Second seemingly worked, and you can see if first one did too, or if somehow it failed delete.

If no log is in the usual logs, it might have failed and logged in About → Show log → Stored, because that’s where Beta logs such failures. Canary tries a little harder to give you a job log.

Another option (and one that I’m a little interested in anyway, as it might help to find how these problems come up), is if you run Creating a bug report, store resulting database somewhere, post a link here to download it, then I might be able to find the first delete to see what it did. Logs are commonly erased because pathnames and such get in, but remote operations can still be seen. Deleting a version should delete a dlist file on the remote because that’s how a version is saved.

[dr8876]

@ts678

If no log is in the usual logs, it might have failed and logged in About → Show log → Stored, because that’s where Beta logs such failures. Canary tries a little harder to give you a job log

Can’t see a failed delete here. Only backups and verify files.

@ts678

is if you run Creating a bug report,

bugreport.zip

[ts678]

@dr8876

Can’t see a failed delete here. Only backups and verify files.

Looking into the Complete log in the job logs for Delete (fortunately both are there) finds:

March 13 shows

2024-03-13 12:29:50 -04 - [Information-Duplicati.Library.Main.Operation.DeleteHandler-DeleteResults]: No remote filesets were deleted

March 19 shows

2024-03-19 16:48:08 -04 - [Information-Duplicati.Library.Main.Operation.DeleteHandler-DeleteRemoteFileset]: Deleting 1 remote fileset(s) …
2024-03-19 16:48:09 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Delete - Started: duplicati-20240306T182459Z.dlist.zip.aes (690.36 KB)
2024-03-19 16:48:09 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Delete - Completed: duplicati-20240306T182459Z.dlist.zip.aes (690.36 KB)
2024-03-19 16:48:09 -04 - [Information-Duplicati.Library.Main.Operation.DeleteHandler-DeleteResults]: Deleted 1 remote fileset(s)

The logs don’t have details to say what was requested, but maybe Mar 13 was mistyped?
I just tried deleting a nonexistent version, and the commandline output did tell me about it:

  Listing remote folder ...
No filesets matched the criteria
Return code: 0

however that would be easy to miss, and job log looks on the surface to be green-and-fine:

[dr8876]

OK. So you think I’m good now? Should I stick with the Canary version or go back to the beta?

[ts678]

@dr8876

So you think I’m good now?

If it’s not complaining, you’re probably out of this issue. It checks all its versions twice a backup.

Potentially there could be a hidden issue, but by definition those are hard to detect. Testing your backup occasionally is a good thing. Maybe try a small Direct restore from backup files to test a disaster recovery before real disaster. This also helps make sure your database recreate works.

@dr8876

Should I stick with the Canary version or go back to the beta?

I’d suggest not staying Canary for production, as occasionally it throws an unwelcome surprise, usually found quite fast, but you might not want to be the very first one to grab any new Canary.

This one is looking like it will work for you now that it’s had more test. I’ve been using it too. You could switch Settings to Beta if you want to keep using this one until it leads into Beta someday.

If you want to step off it, it’s probably good to uninstall before installing the regular 2.0.7.1 again.

[dr8876]

OK. Thanks. I think I will uninstall.
EDIT: But I will do a direct restore test first.

[dr8876]

OK. I did successfully restore a file direct from backup files, but I got errors. Here is the complete log:

        {

“MainOperation”: “Repair”,
“RecreateDatabaseResults”: {
“MainOperation”: “Repair”,
“ParsedResult”: “Success”,
“Interrupted”: false,
“Version”: “2.0.7.100 (2.0.7.100_canary_2023-12-27)”,
“EndTime”: “2024-03-20T14:23:30.0142386Z”,
“BeginTime”: “2024-03-20T14:19:23.0995828Z”,
“Duration”: “00:04:06.9146558”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null,
“BackendStatistics”: {
“RemoteCalls”: 465,
“BytesUploaded”: 0,
“BytesDownloaded”: 34035184,
“FilesUploaded”: 0,
“FilesDownloaded”: 464,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 0,
“KnownFileSize”: 0,
“LastBackupDate”: “0001-01-01T00:00:00”,
“BackupListCount”: 0,
“TotalQuotaSpace”: 0,
“FreeQuotaSpace”: 0,
“AssignedQuotaSpace”: 0,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Repair”,
“ParsedResult”: “Success”,
“Interrupted”: false,
“Version”: “2.0.7.100 (2.0.7.100_canary_2023-12-27)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2024-03-20T14:19:23.0705036Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
},
“ParsedResult”: “Error”,
“Interrupted”: false,
“Version”: “2.0.7.100 (2.0.7.100_canary_2023-12-27)”,
“EndTime”: “2024-03-20T14:23:30.0582302Z”,
“BeginTime”: “2024-03-20T14:19:23.0705036Z”,
“Duration”: “00:04:06.9877266”,
“MessagesActualLength”: 935,
“WarningsActualLength”: 2,
“ErrorsActualLength”: 56,
“Messages”: [
“2024-03-20 10:19:23 -04 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Repair has started”,
“2024-03-20 10:19:23 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2024-03-20 10:19:30 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (847 bytes)”,
“2024-03-20 10:19:39 -04 - [Information-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-RebuildStarted]: Rebuild database started, downloading 25 filelists”,
“2024-03-20 10:19:39 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20240221T144206Z.dlist.zip.aes (677.34 KB)”,
“2024-03-20 10:19:39 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20240221T144206Z.dlist.zip.aes (677.34 KB)”,
“2024-03-20 10:19:39 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20240222T160000Z.dlist.zip.aes (677.50 KB)”,
“2024-03-20 10:19:39 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20240222T160000Z.dlist.zip.aes (677.50 KB)”,
“2024-03-20 10:19:39 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20240223T144643Z.dlist.zip.aes (677.58 KB)”,
“2024-03-20 10:19:39 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20240223T144643Z.dlist.zip.aes (677.58 KB)”,
“2024-03-20 10:19:39 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20240223T200000Z.dlist.zip.aes (677.67 KB)”,
“2024-03-20 10:19:39 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20240223T200000Z.dlist.zip.aes (677.67 KB)”,
“2024-03-20 10:19:39 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20240224T164528Z.dlist.zip.aes (677.67 KB)”,
“2024-03-20 10:19:40 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20240224T164528Z.dlist.zip.aes (677.67 KB)”,
“2024-03-20 10:19:40 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20240226T160000Z.dlist.zip.aes (679.42 KB)”,
“2024-03-20 10:19:40 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20240226T160000Z.dlist.zip.aes (679.42 KB)”,
“2024-03-20 10:19:40 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20240226T161637Z.dlist.zip.aes (679.51 KB)”,
“2024-03-20 10:19:40 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20240226T161637Z.dlist.zip.aes (679.51 KB)”,
“2024-03-20 10:19:40 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20240227T133707Z.dlist.zip.aes (679.78 KB)”,
“2024-03-20 10:19:40 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20240227T133707Z.dlist.zip.aes (679.78 KB)”
],
“Warnings”: [
“2024-03-20 10:23:15 -04 - [Warning-Duplicati.Library.Main.Database.LocalRecreateDatabase-MissingVolumesDetected]: Found 56 missing volumes; attempting to replace blocks from existing volumes”,
“2024-03-20 10:23:29 -04 - [Warning-Duplicati.Library.Main.Database.LocalRecreateDatabase-MissingVolumesDetected]: Found 16 missing volumes; attempting to replace blocks from existing volumes”
],
“Errors”: [
“2024-03-20 10:19:41 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-b770f1ceb526c435dbe82d1fb859e86e0.dblock.zip.aes by duplicati-i22468af8a05d4ea0892a78c81e6291ab.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:19:47 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-b1d17fb916070463290ef530ff8cee5b1.dblock.zip.aes by duplicati-i074f3943b42a46cab39c69dae0a66d5c.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:19:51 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-b75939be357d34785aa957edab4d1624e.dblock.zip.aes by duplicati-ib4734d451d2b45f386f109aa1d96ce09.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:19:51 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-bcf342ce927a84a14b341f3df3fdd4bd3.dblock.zip.aes by duplicati-ida0822dbf5094d7bb772507c0df06d78.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:19:55 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-b8a3f421a39fb43e6b235dc9e72511d18.dblock.zip.aes by duplicati-ib8a8f9e4ba5d4e629e41b1568303a597.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:20:00 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-b689b27fbaa1e4635b28640d76d4a05ca.dblock.zip.aes by duplicati-i8dc7c46f00244e60973638345ef42101.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:20:01 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-bcc17fdae831943748e7b457bd51b7f1e.dblock.zip.aes by duplicati-i8a23acc7f06040b09ec433a5f04b7f48.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:20:04 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-b178d73670c4c43f48cc812a8ee1ab103.dblock.zip.aes by duplicati-i423813cb608646efbaf3eed3ff96cc6f.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:20:04 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-b8671ebe4b6ae4958876561728fa8d94e.dblock.zip.aes by duplicati-i968f646a962742efa230b809ec0298f0.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:20:08 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-b7cdf027063c54c06888070910c51076e.dblock.zip.aes by duplicati-i0c7f3985cb084743abd6be3b6bb63c78.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:20:12 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-b9ffe6164d39c45e5966a6ce783e68b0d.dblock.zip.aes by duplicati-ia5c637b37c6244a1affe7384360b870d.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:20:12 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-b6e272b1a25ac4455a164d5ce295b0349.dblock.zip.aes by duplicati-ibdb6c4ffd06a43a487050a5d87e0f502.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:20:15 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-b2ba25016cad94f6fae637cb6eea381aa.dblock.zip.aes by duplicati-i204d08dc2955412f93920303291247c2.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:20:55 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-b2dda9f6b9df34fe48621f2bbc640432d.dblock.zip.aes by duplicati-ifb7ca204ba7f4a62a7a1af15ca3d2669.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:20:57 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-b5087f6a4176a4fccb97afd238e307fbe.dblock.zip.aes by duplicati-i0110866c276847ea8cba1a2a73db219f.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:20:58 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-bd5abd01e2bec4c6e8867b2fbb282effc.dblock.zip.aes by duplicati-iaf0bfe640d0e44e7a4d7892d9e9092d2.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:20:59 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-b43d416319b0d4f5ca0da6583764e4aa2.dblock.zip.aes by duplicati-icc510116ef4c486b93224633e8d20fd3.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:20:59 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-b044787437b934536bb3ae190c3e1d69b.dblock.zip.aes by duplicati-if30f8c0aa2af42dfa71477a326f99d6f.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:21:10 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-b63d3d7fb1d83426c8669f5a49710985f.dblock.zip.aes by duplicati-i80d2bbec1f7d4228a910709fb2d4bc9a.dindex.zip.aes, but not found in list, registering a missing remote file”,
“2024-03-20 10:21:15 -04 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingFileDetected]: Remote file referenced as duplicati-b15933811ae924634bd1dc2dbfaa14f48.dblock.zip.aes by duplicati-i4d5d28ded52548c5bad11af432600e24.dindex.zip.aes, but not found in list, registering a missing remote file”
],
“BackendStatistics”: {
“RemoteCalls”: 465,
“BytesUploaded”: 0,
“BytesDownloaded”: 34035184,
“FilesUploaded”: 0,
“FilesDownloaded”: 464,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 0,
“KnownFileSize”: 0,
“LastBackupDate”: “0001-01-01T00:00:00”,
“BackupListCount”: 0,
“TotalQuotaSpace”: 0,
“FreeQuotaSpace”: 0,
“AssignedQuotaSpace”: 0,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Repair”,
“ParsedResult”: “Success”,
“Interrupted”: false,
“Version”: “2.0.7.100 (2.0.7.100_canary_2023-12-27)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2024-03-20T14:19:23.0705036Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
}

[ts678]

The final declaration of success is probably a good sign. I can see in your database bug report that there are 381 dblock files, but 437 dindex files. Extra dindex sometimes happen. More importantly, did you happen to notice how far to the right the progress bar at top of screen got on the Recreate? You can also watch About → Show log → Live → Verbose for an accurate view of what’s going on. Final 30% (not to time scale) on the progress bar is downloading dblock files in search of data that dindex files didn’t have. That can be very slow, especially between 90% and 100% on progress bar.

Ideal is recreate downloads dlist files to know the files and their blocks, then dindex to know dblock file containing the blocks. A dindex indexes a specific dblock file, but is much smaller.

[ts678]

This backup looks like it was first done around Feb 21, but the database recreate on Mar 13 deleted history, so I can’t investigate further from the bug report. You should have had similar messages on Mar 13 Recreate. Can you say anything about how that went, or what the reason was for Recreate?

There are still some ways to investigate, but since history is lost, it may be hard to determine cause.

EDIT 1:

The still-present destination files suggest that some of the early backup work had backups that did not complete. Does that sound right? Any more information? Look in About → Show log → Stored which (unlike the normal per-job logs) are in server database, so survive the job database recreate.

EDIT 2:

What’s the Destination type here? For a previous issue, you used Mountain Duck S3 into Storj. Possibly this is a different system.

[dr8876]

@ts678

What’s the Destination type here? For a previous issue, you used Mountain Duck S3 into Storj. Possibly this is a different system.

I know it’s not the best idea, but I am trying to backup the storj network drive to itself (a backups folder on storj).

[ts678]

That’s sounding familiar from your prior topic. Regardless, any info on what was going wrong here?

[dr8876]

Well, I have two synology units. One of my backup units is filling up, so I need to bring the other one on board. But until then, I need to use the storj network drive itself as a backup destination (i.e., the source being backed up to itself).

[ts678]

Looking in About → Show log → Stored from early backups might be all the info left (plus memory).

If all else fails, you can try again and watch well, or we can try to see if we can remove strangeness which might just mean moving the excess dindex files out of the way, and seeing if it helps recreate.

What I’d prefer is understanding the problem so that it can maybe get fixed. But info is needed for it.

[ts678]

Duplicati reliability with Storj probably improved with a release that is a new Canary, not in Beta:

2.0.7.101_canary_2024-03-08

Updated Uplink for Storj to 2.12, thanks @gpatel-fr and @kenkendk

I’m not immediately advising it, as Canary is sometimes risky, and we don’t know the early issue.
Again, please check server log and your memory.

EDIT:

Above change affects Duplicati to Storj work. It won’t help if you have Mountain Duck in between.

[dr8876]

@ts678 , so what would you directly recommend that I do? I am running the storj backup job, and they are completing, but I am getting warnings now.

• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.MetadataGenerator.Metadata-MetadataProcessFailed]: Failed to process metadata for “E:\empower\Root\Wipe 2.14.23\Downloads\Internal\Program plan internal_draft_2.9.21.docx”, storing empty metadata InvalidOperationException: Method failed with unexpected error code 3.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.MetadataGenerator.Metadata-MetadataProcessFailed]: Failed to process metadata for “E:\empower\Root\Wipe 2.14.23\Downloads\Internal\Program plan internal_draft_7.12.20.docx”, storing empty metadata InvalidOperationException: Method failed with unexpected error code 3.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: E:\empower\Root\Wipe 2.14.23\Downloads\Internal\Program plan internal_draft_2.9.21.docx DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root\Wipe 2.14.23\Downloads\Internal\Program plan internal_draft_2.9.21.docx’.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: E:\empower\Root\Wipe 2.14.23\Downloads\Internal\Program plan internal_draft_7.12.20.docx DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root\Wipe 2.14.23\Downloads\Internal\Program plan internal_draft_7.12.20.docx’.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_MAGAR_LEKNATH_008\Application\Questionnaires-Surveys\ DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_MAGAR_LEKNATH_008\Application\Questionnaires-Surveys’.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_MOMIN_ANIL_001\ DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_MOMIN_ANIL_001’.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_MOMIN_ANIL_001\ DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_MOMIN_ANIL_001’.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_SONARI_BENJAMIN_057\ DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_SONARI_BENJAMIN_057’.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_SONARI_BENJAMIN_057\ DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_SONARI_BENJAMIN_057’.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_NARZARY_SANJAB_029\ DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_NARZARY_SANJAB_029’.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_NARZARY_SANJAB_029\ DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_NARZARY_SANJAB_029’.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_ISLARY_SWMDWN_034\ DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_ISLARY_SWMDWN_034’.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_ISLARY_SWMDWN_034\ DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_ISLARY_SWMDWN_034’.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_BORO_RAM_011\ DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_BORO_RAM_011’.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_BORO_RAM_011\ DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_BORO_RAM_011’.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_BORO_BHUTTO_023\ DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_BORO_BHUTTO_023’.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_BORO_BHUTTO_023\ DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_BORO_BHUTTO_023’.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_NARZARY_ABRAHAM_037\ DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_NARZARY_ABRAHAM_037’.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_NARZARY_ABRAHAM_037\ DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_NARZARY_ABRAHAM_037’.
• 2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_KHAKHOLARY_JAY_016\ DirectoryNotFoundException: Could not find a part of the path ‘\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_KHAKHOLARY_JAY_016’.

Complete log:

        {

“DeletedFiles”: 1714,
“DeletedFolders”: 2781,
“ModifiedFiles”: 0,
“ExaminedFiles”: 3418,
“OpenedFiles”: 0,
“AddedFiles”: 0,
“SizeOfModifiedFiles”: 0,
“SizeOfAddedFiles”: 0,
“SizeOfExaminedFiles”: 18795960221,
“SizeOfOpenedFiles”: 0,
“NotProcessedFiles”: 0,
“AddedFolders”: 0,
“TooLargeFiles”: 0,
“FilesWithError”: 0,
“ModifiedFolders”: 0,
“ModifiedSymlinks”: 0,
“AddedSymlinks”: 0,
“DeletedSymlinks”: 0,
“PartialBackup”: false,
“Dryrun”: false,
“MainOperation”: “Backup”,
“CompactResults”: null,
“VacuumResults”: null,
“DeleteResults”: {
“DeletedSetsActualLength”: 0,
“DeletedSets”: ,
“Dryrun”: false,
“MainOperation”: “Delete”,
“CompactResults”: null,
“ParsedResult”: “Success”,
“Interrupted”: false,
“Version”: “2.0.7.100 (2.0.7.100_canary_2023-12-27)”,
“EndTime”: “2024-03-21T11:12:06.8818491Z”,
“BeginTime”: “2024-03-21T11:12:06.4230929Z”,
“Duration”: “00:00:00.4587562”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null,
“BackendStatistics”: {
“RemoteCalls”: 6,
“BytesUploaded”: 410493,
“BytesDownloaded”: 53173511,
“FilesUploaded”: 1,
“FilesDownloaded”: 3,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 851,
“KnownFileSize”: 19122525623,
“LastBackupDate”: “2024-03-21T07:03:10-04:00”,
“BackupListCount”: 27,
“TotalQuotaSpace”: 0,
“FreeQuotaSpace”: 0,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Interrupted”: false,
“Version”: “2.0.7.100 (2.0.7.100_canary_2023-12-27)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2024-03-21T11:03:10.2600147Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
},
“RepairResults”: null,
“TestResults”: {
“MainOperation”: “Test”,
“VerificationsActualLength”: 3,
“Verifications”: [
{
“Key”: “duplicati-20240228T021238Z.dlist.zip.aes”,
“Value”:
},
{
“Key”: “duplicati-i28bd0d8e017d40c2830fc487f7199459.dindex.zip.aes”,
“Value”:
},
{
“Key”: “duplicati-be0aed83433f241ab85d94ae585947214.dblock.zip.aes”,
“Value”:
}
],
“ParsedResult”: “Success”,
“Interrupted”: false,
“Version”: “2.0.7.100 (2.0.7.100_canary_2023-12-27)”,
“EndTime”: “2024-03-21T11:12:14.2496609Z”,
“BeginTime”: “2024-03-21T11:12:07.1646739Z”,
“Duration”: “00:00:07.0849870”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null,
“BackendStatistics”: {
“RemoteCalls”: 6,
“BytesUploaded”: 410493,
“BytesDownloaded”: 53173511,
“FilesUploaded”: 1,
“FilesDownloaded”: 3,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 851,
“KnownFileSize”: 19122525623,
“LastBackupDate”: “2024-03-21T07:03:10-04:00”,
“BackupListCount”: 27,
“TotalQuotaSpace”: 0,
“FreeQuotaSpace”: 0,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Interrupted”: false,
“Version”: “2.0.7.100 (2.0.7.100_canary_2023-12-27)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2024-03-21T11:03:10.2600147Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
},
“ParsedResult”: “Warning”,
“Interrupted”: false,
“Version”: “2.0.7.100 (2.0.7.100_canary_2023-12-27)”,
“EndTime”: “2024-03-21T11:12:14.2736615Z”,
“BeginTime”: “2024-03-21T11:03:10.2600147Z”,
“Duration”: “00:09:04.0136468”,
“MessagesActualLength”: 15,
“WarningsActualLength”: 177,
“ErrorsActualLength”: 0,
“Messages”: [
“2024-03-21 07:03:10 -04 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started”,
“2024-03-21 07:03:11 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2024-03-21 07:03:11 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (850 bytes)”,
“2024-03-21 07:12:05 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-20240321T110310Z.dlist.zip.aes (400.87 KB)”,
“2024-03-21 07:12:06 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-20240321T110310Z.dlist.zip.aes (400.87 KB)”,
“2024-03-21 07:12:06 -04 - [Information-Duplicati.Library.Main.Operation.DeleteHandler-DeleteResults]: No remote filesets were deleted”,
“2024-03-21 07:12:06 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2024-03-21 07:12:07 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (851 bytes)”,
“2024-03-21 07:12:07 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20240228T021238Z.dlist.zip.aes (678.43 KB)”,
“2024-03-21 07:12:07 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20240228T021238Z.dlist.zip.aes (678.43 KB)”,
“2024-03-21 07:12:07 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-i28bd0d8e017d40c2830fc487f7199459.dindex.zip.aes (49.01 KB)”,
“2024-03-21 07:12:08 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-i28bd0d8e017d40c2830fc487f7199459.dindex.zip.aes (49.01 KB)”,
“2024-03-21 07:12:08 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-be0aed83433f241ab85d94ae585947214.dblock.zip.aes (50.00 MB)”,
“2024-03-21 07:12:14 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-be0aed83433f241ab85d94ae585947214.dblock.zip.aes (50.00 MB)”,
“2024-03-21 07:12:14 -04 - [Information-Duplicati.Library.Main.Operation.TestHandler-Test results]: Successfully verified 3 remote files”
],
“Warnings”: [
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.MetadataGenerator.Metadata-MetadataProcessFailed]: Failed to process metadata for "E:\empower\Root\Wipe 2.14.23\Downloads\Internal\Program plan internal_draft_2.9.21.docx", storing empty metadata\r\nInvalidOperationException: Method failed with unexpected error code 3.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.MetadataGenerator.Metadata-MetadataProcessFailed]: Failed to process metadata for "E:\empower\Root\Wipe 2.14.23\Downloads\Internal\Program plan internal_draft_7.12.20.docx", storing empty metadata\r\nInvalidOperationException: Method failed with unexpected error code 3.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: E:\empower\Root\Wipe 2.14.23\Downloads\Internal\Program plan internal_draft_2.9.21.docx\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root\Wipe 2.14.23\Downloads\Internal\Program plan internal_draft_2.9.21.docx’.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: E:\empower\Root\Wipe 2.14.23\Downloads\Internal\Program plan internal_draft_7.12.20.docx\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root\Wipe 2.14.23\Downloads\Internal\Program plan internal_draft_7.12.20.docx’.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_MAGAR_LEKNATH_008\Application\Questionnaires-Surveys\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_MAGAR_LEKNATH_008\Application\Questionnaires-Surveys’.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_MOMIN_ANIL_001\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_MOMIN_ANIL_001’.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_MOMIN_ANIL_001\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_MOMIN_ANIL_001’.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_SONARI_BENJAMIN_057\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_SONARI_BENJAMIN_057’.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_SONARI_BENJAMIN_057\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_SONARI_BENJAMIN_057’.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_NARZARY_SANJAB_029\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_NARZARY_SANJAB_029’.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_NARZARY_SANJAB_029\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_NARZARY_SANJAB_029’.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_ISLARY_SWMDWN_034\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_ISLARY_SWMDWN_034’.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_ISLARY_SWMDWN_034\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_ISLARY_SWMDWN_034’.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_BORO_RAM_011\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_BORO_RAM_011’.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_BORO_RAM_011\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_BORO_RAM_011’.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_BORO_BHUTTO_023\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_BORO_BHUTTO_023’.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_BORO_BHUTTO_023\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_BORO_BHUTTO_023’.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_NARZARY_ABRAHAM_037\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_NARZARY_ABRAHAM_037’.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_NARZARY_ABRAHAM_037\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_NARZARY_ABRAHAM_037’.”,
“2024-03-21 07:12:04 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_KHAKHOLARY_JAY_016\\r\nDirectoryNotFoundException: Could not find a part of the path ‘\\?\E:\empower\Root 2\Records\DM\India\National\Disenrolled\DM_IN_AS_HYBD_RECORD_KHAKHOLARY_JAY_016’.”
],
“Errors”: ,
“BackendStatistics”: {
“RemoteCalls”: 6,
“BytesUploaded”: 410493,
“BytesDownloaded”: 53173511,
“FilesUploaded”: 1,
“FilesDownloaded”: 3,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 851,
“KnownFileSize”: 19122525623,
“LastBackupDate”: “2024-03-21T07:03:10-04:00”,
“BackupListCount”: 27,
“TotalQuotaSpace”: 0,
“FreeQuotaSpace”: 0,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Interrupted”: false,
“Version”: “2.0.7.100 (2.0.7.100_canary_2023-12-27)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2024-03-21T11:03:10.2600147Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
}

[ts678]

Your E: drive is not working. What is it? Is that Mountain Duck mounting Storj S3 as drive letter? That’s all outside of Duplicati, but you can test by hand running as the same user Duplicati uses.

I think a Command Prompt dir accepts \\?\E:\ syntax, but Explorer might also be suitable test.
About → System info → UserName will tell you Duplicati’s user if you’re not certain. You can also see whether Duplicati Source screen can get there. If it can’t, then backup probably cannot either.

How is the Destination going to Storj? I can’t advise if Canary will help without you telling me that, however that might not matter now because the problem of the moment looks like broken Source which is technically out of scope for Duplicati to solve, although there’s a chance advice can help.