Backup finally complete, however I have an error for a duplicate path

Support
1

Hi all, so after a little more struggle than I’d have liked, no doubt due to the sheer size and number of files of my backup, it’s finally complete, however I have an error for a duplicate path now, which is actually for an entire drive, D:

I was wondering how I can fix this issue, I’m guessing something glitched and caused a duplicate entry, however repairing the database did not work, and I’d imagine deleting and recreating it could take quite a while, so maybe there’s a way to manually fix it?

2020-03-01 23:22:12 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\

The log from my latest backup is here.

2

When you do another backup, does the error happen again?

I searched the forum for “DuplicatePathFound” and see a handful of threads, but most don’t discuss a resolution. In one thread the poster reported that the issue disappeared automatically.

3

I didn’t find much useful either when I searched, I ran backups 10 or 15 times with the same issue however it looks like it automatically fixed itself for me too, so unfortunately no real known solution to this.

My backup machine is back offsite now, so we’ll see if for some reason it comes back but I think it has to do with the host side, not the backup destination, oh well.

4

Well I had an issue with remote files missing, I deleted and recreated and now this error is happening 371 times every backup. Sheesh.

{
“DeletedFiles”: 0,
“DeletedFolders”: 0,
“ModifiedFiles”: 6,
“ExaminedFiles”: 1124685,
“OpenedFiles”: 29,
“AddedFiles”: 23,
“SizeOfModifiedFiles”: 446693376,
“SizeOfAddedFiles”: 11761559,
“SizeOfExaminedFiles”: 4866180302283,
“SizeOfOpenedFiles”: 458464703,
“NotProcessedFiles”: 0,
“AddedFolders”: 0,
“TooLargeFiles”: 0,
“FilesWithError”: 0,
“ModifiedFolders”: 0,
“ModifiedSymlinks”: 0,
“AddedSymlinks”: 0,
“DeletedSymlinks”: 0,
“PartialBackup”: false,
“Dryrun”: false,
“MainOperation”: “Backup”,
“CompactResults”: {
“DeletedFileCount”: 0,
“DownloadedFileCount”: 0,
“UploadedFileCount”: 0,
“DeletedFileSize”: 0,
“DownloadedFileSize”: 0,
“UploadedFileSize”: 0,
“Dryrun”: false,
“VacuumResults”: null,
“MainOperation”: “Compact”,
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “2020-03-18T07:51:57.5374725Z”,
“BeginTime”: “2020-03-18T07:45:20.9825936Z”,
“Duration”: “00:06:36.5548789”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null,
“BackendStatistics”: {
“RemoteCalls”: 9,
“BytesUploaded”: 112194807,
“BytesDownloaded”: 1182696279,
“FilesUploaded”: 3,
“FilesDownloaded”: 3,
“FilesDeleted”: 1,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 7384,
“KnownFileSize”: 3951798225848,
“LastBackupDate”: “2020-03-18T01:00:00-06:00”,
“BackupListCount”: 6,
“TotalQuotaSpace”: 0,
“FreeQuotaSpace”: 0,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2020-03-18T07:00:00.149621Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
},
“VacuumResults”: null,
“DeleteResults”: {
“DeletedSetsActualLength”: 1,
“DeletedSets”: [
{
“Item1”: 1,
“Item2”: “2020-03-17T20:09:40-06:00”
}
],
“Dryrun”: false,
“MainOperation”: “Delete”,
“CompactResults”: {
“DeletedFileCount”: 0,
“DownloadedFileCount”: 0,
“UploadedFileCount”: 0,
“DeletedFileSize”: 0,
“DownloadedFileSize”: 0,
“UploadedFileSize”: 0,
“Dryrun”: false,
“VacuumResults”: null,
“MainOperation”: “Compact”,
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “2020-03-18T07:51:57.5374725Z”,
“BeginTime”: “2020-03-18T07:45:20.9825936Z”,
“Duration”: “00:06:36.5548789”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null,
“BackendStatistics”: {
“RemoteCalls”: 9,
“BytesUploaded”: 112194807,
“BytesDownloaded”: 1182696279,
“FilesUploaded”: 3,
“FilesDownloaded”: 3,
“FilesDeleted”: 1,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 7384,
“KnownFileSize”: 3951798225848,
“LastBackupDate”: “2020-03-18T01:00:00-06:00”,
“BackupListCount”: 6,
“TotalQuotaSpace”: 0,
“FreeQuotaSpace”: 0,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2020-03-18T07:00:00.149621Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
},
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “2020-03-18T07:51:57.5374725Z”,
“BeginTime”: “2020-03-18T07:39:36.6968768Z”,
“Duration”: “00:12:20.8405957”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null,
“BackendStatistics”: {
“RemoteCalls”: 9,
“BytesUploaded”: 112194807,
“BytesDownloaded”: 1182696279,
“FilesUploaded”: 3,
“FilesDownloaded”: 3,
“FilesDeleted”: 1,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 7384,
“KnownFileSize”: 3951798225848,
“LastBackupDate”: “2020-03-18T01:00:00-06:00”,
“BackupListCount”: 6,
“TotalQuotaSpace”: 0,
“FreeQuotaSpace”: 0,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2020-03-18T07:00:00.149621Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
},
“RepairResults”: null,
“TestResults”: {
“MainOperation”: “Test”,
“VerificationsActualLength”: 3,
“Verifications”: [
{
“Key”: “duplicati-20200318T070000Z.dlist.zip.aes”,
“Value”:
},
{
“Key”: “duplicati-i58576706f3fd41fbab54b49db3f2b1eb.dindex.zip.aes”,
“Value”:
},
{
“Key”: “duplicati-b4fbe6ce2cf514bbf9d55cf31fda0d60c.dblock.zip.aes”,
“Value”:
}
],
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “2020-03-18T07:58:36.322408Z”,
“BeginTime”: “2020-03-18T07:51:59.6215226Z”,
“Duration”: “00:06:36.7008854”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null,
“BackendStatistics”: {
“RemoteCalls”: 9,
“BytesUploaded”: 112194807,
“BytesDownloaded”: 1182696279,
“FilesUploaded”: 3,
“FilesDownloaded”: 3,
“FilesDeleted”: 1,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 7384,
“KnownFileSize”: 3951798225848,
“LastBackupDate”: “2020-03-18T01:00:00-06:00”,
“BackupListCount”: 6,
“TotalQuotaSpace”: 0,
“FreeQuotaSpace”: 0,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2020-03-18T07:00:00.149621Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
},
“ParsedResult”: “Warning”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “2020-03-18T07:58:36.4024113Z”,
“BeginTime”: “2020-03-18T07:00:00.149621Z”,
“Duration”: “00:58:36.2527903”,
“MessagesActualLength”: 27,
“WarningsActualLength”: 371,
“ErrorsActualLength”: 0,
“Messages”: [
“2020-03-18 01:00:00 -06 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started”,
“2020-03-18 01:03:32 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2020-03-18 01:03:33 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (7.21 KB)”,
“2020-03-18 01:35:17 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b183be7132d2d421eb0100e99067b631f.dblock.zip.aes (3.83 MB)”,
“2020-03-18 01:36:45 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b183be7132d2d421eb0100e99067b631f.dblock.zip.aes (3.83 MB)”,
“2020-03-18 01:38:33 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-i7bad05d366414b26aed347176051d789.dindex.zip.aes (149.84 KB)”,
“2020-03-18 01:38:34 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-i7bad05d366414b26aed347176051d789.dindex.zip.aes (149.84 KB)”,
“2020-03-18 01:39:15 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-20200318T070000Z.dlist.zip.aes (103.02 MB)”,
“2020-03-18 01:39:36 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-20200318T070000Z.dlist.zip.aes (103.02 MB)”,
“2020-03-18 01:39:36 -06 - [Information-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-StartCheck]: Start checking if backups can be removed”,
“2020-03-18 01:39:36 -06 - [Information-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-FramesAndIntervals]: Time frames and intervals pairs: 7.00:00:00 / 1.00:00:00, 28.00:00:00 / 7.00:00:00, 365.00:00:00 / 31.00:00:00”,
“2020-03-18 01:39:36 -06 - [Information-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-BackupList]: Backups to consider: 3/17/2020 8:09:40 PM, 3/17/2020 6:11:16 PM, 3/16/2020 4:59:01 PM, 3/15/2020 4:06:11 PM, 3/9/2020 7:00:00 AM, 3/1/2020 5:52:17 PM”,
"2020-03-18 01:39:36 -06 - [Information-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-BackupsToDelete]: Backups outside of all time frames and thus getting deleted: ",
“2020-03-18 01:39:36 -06 - [Information-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-AllBackupsToDelete]: All backups to delete: 3/17/2020 8:09:40 PM”,
“2020-03-18 01:39:36 -06 - [Information-Duplicati.Library.Main.Operation.DeleteHandler-DeleteRemoteFileset]: Deleting 1 remote fileset(s) …”,
“2020-03-18 01:45:19 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Delete - Started: duplicati-20200318T020940Z.dlist.zip.aes (103.02 MB)”,
“2020-03-18 01:45:20 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Delete - Completed: duplicati-20200318T020940Z.dlist.zip.aes (103.02 MB)”,
“2020-03-18 01:45:20 -06 - [Information-Duplicati.Library.Main.Operation.DeleteHandler-DeleteResults]: Deleted 1 remote fileset(s)”,
“2020-03-18 01:51:57 -06 - [Information-Duplicati.Library.Main.Database.LocalDeleteDatabase-CompactReason]: Compacting not required”,
“2020-03-18 01:51:57 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”
],
“Warnings”: [
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”,
“2020-03-18 01:37:37 -06 - [Warning-Duplicati.Library.Main.Database.LocalDatabase-DuplicatePathFound]: Duplicate path detected: D:\”
],
“Errors”: ,
“BackendStatistics”: {
“RemoteCalls”: 9,
“BytesUploaded”: 112194807,
“BytesDownloaded”: 1182696279,
“FilesUploaded”: 3,
“FilesDownloaded”: 3,
“FilesDeleted”: 1,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 7384,
“KnownFileSize”: 3951798225848,
“LastBackupDate”: “2020-03-18T01:00:00-06:00”,
“BackupListCount”: 6,
“TotalQuotaSpace”: 0,
“FreeQuotaSpace”: 0,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2020-03-18T07:00:00.149621Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
}

screenshot.397
screenshot.3971212×813 430 KB

5

Repair runs without any issues too.

6

Do you have --symlink-policy defined for your job?

7

I don’t think I manually added it, however this issue resolved itself again too.

I don’t have any shortcuts from one drive to another so symbolic links shouldn’t really exist anyhow. Just seems odd that this issue pops up and then fixes itself randomly.