Database error backup

Support
1

Hello,

my first attempts when using Duplicati were not going as well as I have hoped. When the backup job finishes I get two errors indicating something odd with the database and block hashes. Logfile as following:

DeletedFiles: 14142

DeletedFolders: 69

ModifiedFiles: 1109

ExaminedFiles: 152172

OpenedFiles: 4569

AddedFiles: 3460

SizeOfModifiedFiles: 18499768626

SizeOfAddedFiles: 1861106673

SizeOfExaminedFiles: 53220186715

SizeOfOpenedFiles: 20363263340

NotProcessedFiles: 0

AddedFolders: 181

TooLargeFiles: 0

FilesWithError: 0

ModifiedFolders: 0

ModifiedSymlinks: 0

AddedSymlinks: 0

DeletedSymlinks: 0

PartialBackup: False

Dryrun: False

MainOperation: Backup

CompactResults:

    DeletedFileCount: 0

    DownloadedFileCount: 0

    UploadedFileCount: 0

    DeletedFileSize: 0

    DownloadedFileSize: 0

    UploadedFileSize: 0

    Dryrun: False

    MainOperation: Compact

    ParsedResult: Error

    Version: 2.0.4.23 (2.0.4.23_beta_2019-07-14)

    EndTime: 21.07.2019 17:32:14 (1563723134)

    BeginTime: 21.07.2019 17:32:08 (1563723128)

    Duration: 00:00:05.7663704

    Messages: [

        2019-07-21 17:21:04 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: Die Operation Backup wurde gestartet,

        2019-07-21 17:21:37 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),

        2019-07-21 17:21:37 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (2,30 KB),

        2019-07-21 17:22:29 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-bf030375478164523b7896200579a9d42.dblock.zip (49,92 MB),

        2019-07-21 17:22:29 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-bf030375478164523b7896200579a9d42.dblock.zip (49,92 MB),

...

    ]

    Warnings: [

        2019-07-21 17:21:38 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\NTUSER.DAT,

        2019-07-21 17:21:39 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\ntuser.dat.LOG1,

        2019-07-21 17:21:39 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\ntuser.dat.LOG2,

        2019-07-21 17:27:35 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\OneDrive - student.kit.edu\.849C9593-D756-4E56-8D6E-42412F2A707B,

        2019-07-21 17:27:35 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\OneDrive\.849C9593-D756-4E56-8D6E-42412F2A707B,

...

    ]

    Errors: [

        2019-07-21 17:29:56 +02 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-CheckingErrorsForIssue1400]: Checking errors, related to #1400. Unexpected result count: 0, expected 1, hash: bEB2A3Al2IlnI0JGzywky+Jv/9CZmdHodUItuc8454o=, size: 92168, blocksetid: 656254, ix: 41, fullhash: tmLqiizISHNlaZ28dZEA4aDDsIesjkFMLUT+SO4JJLI=, fullsize: 4290568,

        2019-07-21 17:29:56 +02 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-FoundIssue1400Error]: Found block with ID 1619296 and hash bEB2A3Al2IlnI0JGzywky+Jv/9CZmdHodUItuc8454o= and size 51128

    ]

    BackendStatistics:

        RemoteCalls: 125

        BytesUploaded: 3103059096

        BytesDownloaded: 62973598

        FilesUploaded: 119

        FilesDownloaded: 3

        FilesDeleted: 1

        FoldersCreated: 0

        RetryAttempts: 0

        UnknownFileSize: 0

        UnknownFileCount: 2

        KnownFileCount: 2468

        KnownFileSize: 64632432627

        LastBackupDate: 21.07.2019 17:21:04 (1563722464)

        BackupListCount: 2

        TotalQuotaSpace: 249994145792

        FreeQuotaSpace: 185163239424

        AssignedQuotaSpace: -1

        ReportedQuotaError: False

        ReportedQuotaWarning: False

        ParsedResult: Error

        Version: 2.0.4.23 (2.0.4.23_beta_2019-07-14)

        Messages: [

            2019-07-21 17:21:04 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: Die Operation Backup wurde gestartet,

            2019-07-21 17:21:37 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),

            2019-07-21 17:21:37 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (2,30 KB),

            2019-07-21 17:22:29 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-bf030375478164523b7896200579a9d42.dblock.zip (49,92 MB),

            2019-07-21 17:22:29 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-bf030375478164523b7896200579a9d42.dblock.zip (49,92 MB),

...

        ]

        Warnings: [

            2019-07-21 17:21:38 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\NTUSER.DAT,

            2019-07-21 17:21:39 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\ntuser.dat.LOG1,

            2019-07-21 17:21:39 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\ntuser.dat.LOG2,

            2019-07-21 17:27:35 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\OneDrive - student.kit.edu\.849C9593-D756-4E56-8D6E-42412F2A707B,

            2019-07-21 17:27:35 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\OneDrive\.849C9593-D756-4E56-8D6E-42412F2A707B,

...

        ]

        Errors: [

            2019-07-21 17:29:56 +02 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-CheckingErrorsForIssue1400]: Checking errors, related to #1400. Unexpected result count: 0, expected 1, hash: bEB2A3Al2IlnI0JGzywky+Jv/9CZmdHodUItuc8454o=, size: 92168, blocksetid: 656254, ix: 41, fullhash: tmLqiizISHNlaZ28dZEA4aDDsIesjkFMLUT+SO4JJLI=, fullsize: 4290568,

            2019-07-21 17:29:56 +02 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-FoundIssue1400Error]: Found block with ID 1619296 and hash bEB2A3Al2IlnI0JGzywky+Jv/9CZmdHodUItuc8454o= and size 51128

        ]

DeleteResults:

    DeletedSets: [

        Item1: 1

        Item2: 16.07.2019 23:00:44 (1563310844)

    ]

    Dryrun: False

    MainOperation: Delete

    ParsedResult: Error

    Version: 2.0.4.23 (2.0.4.23_beta_2019-07-14)

    EndTime: 21.07.2019 17:32:14 (1563723134)

    BeginTime: 21.07.2019 17:31:52 (1563723112)

    Duration: 00:00:22.0636988

    Messages: [

        2019-07-21 17:21:04 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: Die Operation Backup wurde gestartet,

        2019-07-21 17:21:37 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),

        2019-07-21 17:21:37 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (2,30 KB),

        2019-07-21 17:22:29 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-bf030375478164523b7896200579a9d42.dblock.zip (49,92 MB),

        2019-07-21 17:22:29 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-bf030375478164523b7896200579a9d42.dblock.zip (49,92 MB),

...

    ]

    Warnings: [

        2019-07-21 17:21:38 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\NTUSER.DAT,

        2019-07-21 17:21:39 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\ntuser.dat.LOG1,

        2019-07-21 17:21:39 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\ntuser.dat.LOG2,

        2019-07-21 17:27:35 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\OneDrive - student.kit.edu\.849C9593-D756-4E56-8D6E-42412F2A707B,

        2019-07-21 17:27:35 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\OneDrive\.849C9593-D756-4E56-8D6E-42412F2A707B,

...

    ]

    Errors: [

        2019-07-21 17:29:56 +02 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-CheckingErrorsForIssue1400]: Checking errors, related to #1400. Unexpected result count: 0, expected 1, hash: bEB2A3Al2IlnI0JGzywky+Jv/9CZmdHodUItuc8454o=, size: 92168, blocksetid: 656254, ix: 41, fullhash: tmLqiizISHNlaZ28dZEA4aDDsIesjkFMLUT+SO4JJLI=, fullsize: 4290568,

        2019-07-21 17:29:56 +02 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-FoundIssue1400Error]: Found block with ID 1619296 and hash bEB2A3Al2IlnI0JGzywky+Jv/9CZmdHodUItuc8454o= and size 51128

    ]

RepairResults: null

TestResults:

    MainOperation: Test

    Verifications: [

        Key: duplicati-20190721T152104Z.dlist.zip

        Value: [],

        Key: duplicati-ib643c66120ca4604be7e0944b8182d3c.dindex.zip

        Value: [],

        Key: duplicati-b3263845da3c64ea688ee8a15c7f73ae8.dblock.zip

        Value: []

    ]

    ParsedResult: Error

    Version: 2.0.4.23 (2.0.4.23_beta_2019-07-14)

    EndTime: 21.07.2019 17:32:16 (1563723136)

    BeginTime: 21.07.2019 17:32:16 (1563723136)

    Duration: 00:00:00.8435567

    Messages: [

        2019-07-21 17:21:04 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: Die Operation Backup wurde gestartet,

        2019-07-21 17:21:37 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),

        2019-07-21 17:21:37 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (2,30 KB),

        2019-07-21 17:22:29 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-bf030375478164523b7896200579a9d42.dblock.zip (49,92 MB),

        2019-07-21 17:22:29 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-bf030375478164523b7896200579a9d42.dblock.zip (49,92 MB),

...

    ]

    Warnings: [

        2019-07-21 17:21:38 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\NTUSER.DAT,

        2019-07-21 17:21:39 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\ntuser.dat.LOG1,

        2019-07-21 17:21:39 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\ntuser.dat.LOG2,

        2019-07-21 17:27:35 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\OneDrive - student.kit.edu\.849C9593-D756-4E56-8D6E-42412F2A707B,

        2019-07-21 17:27:35 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\OneDrive\.849C9593-D756-4E56-8D6E-42412F2A707B,

...

    ]

    Errors: [

        2019-07-21 17:29:56 +02 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-CheckingErrorsForIssue1400]: Checking errors, related to #1400. Unexpected result count: 0, expected 1, hash: bEB2A3Al2IlnI0JGzywky+Jv/9CZmdHodUItuc8454o=, size: 92168, blocksetid: 656254, ix: 41, fullhash: tmLqiizISHNlaZ28dZEA4aDDsIesjkFMLUT+SO4JJLI=, fullsize: 4290568,

        2019-07-21 17:29:56 +02 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-FoundIssue1400Error]: Found block with ID 1619296 and hash bEB2A3Al2IlnI0JGzywky+Jv/9CZmdHodUItuc8454o= and size 51128

    ]

ParsedResult: Error

Version: 2.0.4.23 (2.0.4.23_beta_2019-07-14)

EndTime: 21.07.2019 17:32:16 (1563723136)

BeginTime: 21.07.2019 17:21:04 (1563722464)

Duration: 00:11:12.0921366

Messages: [

    2019-07-21 17:21:04 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: Die Operation Backup wurde gestartet,

    2019-07-21 17:21:37 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),

    2019-07-21 17:21:37 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (2,30 KB),

    2019-07-21 17:22:29 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-bf030375478164523b7896200579a9d42.dblock.zip (49,92 MB),

    2019-07-21 17:22:29 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-bf030375478164523b7896200579a9d42.dblock.zip (49,92 MB),

...

]

Warnings: [

    2019-07-21 17:21:38 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\NTUSER.DAT,

    2019-07-21 17:21:39 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\ntuser.dat.LOG1,

    2019-07-21 17:21:39 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\ntuser.dat.LOG2,

    2019-07-21 17:27:35 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\OneDrive - student.kit.edu\.849C9593-D756-4E56-8D6E-42412F2A707B,

    2019-07-21 17:27:35 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\Michael\OneDrive\.849C9593-D756-4E56-8D6E-42412F2A707B,

...

]

Errors: [

    2019-07-21 17:29:56 +02 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-CheckingErrorsForIssue1400]: Checking errors, related to #1400. Unexpected result count: 0, expected 1, hash: bEB2A3Al2IlnI0JGzywky+Jv/9CZmdHodUItuc8454o=, size: 92168, blocksetid: 656254, ix: 41, fullhash: tmLqiizISHNlaZ28dZEA4aDDsIesjkFMLUT+SO4JJLI=, fullsize: 4290568,

    2019-07-21 17:29:56 +02 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-FoundIssue1400Error]: Found block with ID 1619296 and hash bEB2A3Al2IlnI0JGzywky+Jv/9CZmdHodUItuc8454o= and size 51128

]

May somebody can help me? Test operation exits without warnings or errors.

Thanks in advance.

2

What backend are you using? It may be relevant to those hash Errors.

The warnings about unable to process files - that’s because you have selected files that are locked/open at the time of backup. One way to workaround this is to enable snapshots.

3

I run my backup to a local harddrive.

Are there any disadvantages to snapshots?

4

Strange…maybe someone else has some ideas.

I can’t really think of one. A prerequisite is that you must run the Duplicati process with administrative rights (and elevated).

5

As drwtsn32 says, you need to run Duplicati as administartor, which is not the default. For more on that, see Installation - Duplicati 2 User's Manual. For more on snapshot usage, see FAQ · duplicati/duplicati Wiki · GitHub (you also need to have Visual C++ 2015 redist package installed) and in Advanced Options - Duplicati 2 User's Manual.