Repair and Rebuild database fails: Unexpected difference in fileset

Still the same issue:

    Errors: [
        2019-01-21 09:35:33 +01 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-CheckingErrorsForIssue1400]: Checking errors, related to #1400. Unexpected result count: 0, expected 1, hash: tYRdC0NRPdZoyjGFytfX186Kq3WL0w9q09TNEJp3+cA=, size: 76752, blocksetid: 140448, ix: 164, fullhash: hme7Jh9Y/rPFL81gWs7I3KCmvgZuGeFYvdefw/GEeTk=, fullsize: 16870352,
        2019-01-21 09:35:33 +01 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-FoundIssue1400Error]: Found block with ID 1631174 and hash tYRdC0NRPdZoyjGFytfX186Kq3WL0w9q09TNEJp3+cA= and size 35712
    ]

Is this something to ignore? Please advice - I’m not feeling too good knowing that there are occuring errors during backup.

Did you spot the suggestion to try a snapshot to counteract changing files? If not, the top part here gets in that.

Thank you, ts678. Good point.
I did as adviced - and received the same errors… :frowning:

I probably should have requested --snapshot-policy=required instead of on because on keeps going with a warning, if snapshot can’t be done. If you’re sure a warning didn’t happen, then unfortunately it might come down to trimming the backup to not backup the area that’s causing the problem, which might require using –log-file to see the line after the one in the summary. Possibly About --> Show log --> Live --> Error will do.

Here comes the logfile…:

2019-01-23 12:06:07 +01 - [Error-Duplicati.Library.Main.Operation.BackupHandler-FatalError]: Fatal error
System.UnauthorizedAccessException: Attempted to perform an unauthorized operation.
   at Alphaleonis.Win32.Vss.VssBackupComponents..ctor()
   at Alphaleonis.Win32.Vss.VssImplementation.CreateVssBackupComponents()
   at Duplicati.Library.Snapshots.WindowsSnapshot..ctor(IEnumerable`1 sources, IDictionary`2 options)
   at Duplicati.Library.Snapshots.SnapshotUtility.CreateWindowsSnapshot(IEnumerable`1 folders, Dictionary`2 options)
   at Duplicati.Library.Main.Operation.BackupHandler.GetSnapshot(String[] sources, Options options)
   at Duplicati.Library.Main.Operation.BackupHandler.<RunAsync>d__19.MoveNext()

It’s interesting that it jumped straight to an error (or maybe the warning was hard to find). –snapshot-policy:

On Windows this uses the Volume Shadow Copy Services (VSS) and requires administrative privileges.

If the account is a “Standard User”, making it an “Administrator” might solve that, or if you don’t like the idea because of concerns about security or accidents, Duplicati installed as a Windows service uses SYSTEM, which is even more powerful. Migrating from User to Service install on Windows describes the conversion.

I put too much in one paragraph before. One path is to see if the #1400 error can be avoided by requiring a snapshot. That seemingly ran into a lack of permission, per log file. The other path would be to use the log file to catch the details of the #1400 error, including the path, then avoid backing up the troublesome area… For this path, the add-on is only a log file, and snapshot would be left at default of off while chasing #1400.

If you’re able to get the #1400 very reliably, that might be especially interesting in terms of reproducing it so it can be fixed. It’s been somewhat erratic so far, and a nice test case could be a great aid to development.

  1. Duplicati was running as a “System Account”.
  2. The “snapshot policy” has been set to “required” earlier. So my logfile shows was created with this method enabled.

Trying to run the backup once again, it fails immediately because of the errors.

So, I turned the snapshot policy off and hit “run”, and dulicati started to transfer files again. See report below.

Btw: I started to exclude folders containing files that cause troubles already some weeks ago. Some examples:

AppData\Local\Duplicati
AppData\Local\Dropbox
%APPDATA%\Dropbox\installer
%MY_DOCUMENTS%\Dropbox\Dropbox\www.dropbox.com (1).url
%MY_DOCUMENTS%\Dropbox\Dropbox.dropbox.cache

Logfile from last run:
2019-01-23 21:41:24 +01 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-CheckingErrorsForIssue1400]: Checking errors, related to #1400. Unexpected result count: 0, expected 1, hash: 2ptO71K4wiSGsbv4jG6ygooDLd3ZPs9drg6VwbeiH2w=, size: 94792, blocksetid: 141701, ix: 190, fullhash: bCHbKEHrXaSUNqmESFM9EH9qT2M7n0EOblQE4D02gjU=, fullsize: 19550792 2019-01-23 21:41:24 +01 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-FoundIssue1400Error]: Found block with ID 1671079 and hash 2ptO71K4wiSGsbv4jG6ygooDLd3ZPs9drg6VwbeiH2w= and size 90688 2019-01-23 21:41:24 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\AppData\Local\Duplicati\78687874907066698382.sqlite-journal System.Exception: Unexpected result count: 0, expected 1, check log for more messages at Duplicati.Library.Main.Database.LocalBackupDatabase.AddBlockset(String filehash, Int64 size, Int32 blocksize, IEnumerable1 hashes, IEnumerable1 blocklistHashes, Int64& blocksetid, IDbTransaction transaction) at Duplicati.Library.Main.Operation.Backup.BackupDatabase.<>c__DisplayClass13_0.<AddBlocksetAsync>b__0() at Duplicati.Library.Main.Operation.Common.SingleRunner.<>c__DisplayClass4_01.b__0()
at Duplicati.Library.Main.Operation.Common.SingleRunner.d__21.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Duplicati.Library.Main.Operation.Backup.StreamBlockSplitter.<>c__DisplayClass2_0.<<Run>b__0>d.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Duplicati.Library.Main.Operation.Backup.StreamBlock.<ProcessStream>d__5.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.<>c__DisplayClass1_0.<<Run>b__0>d.MoveNext() 2019-01-23 21:41:24 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\AppData\Local\Duplicati\control_dir_v2\lock_v2 System.IO.IOException: The process cannot access the file 'C:\Users\XXX\AppData\Local\Duplicati\control_dir_v2\lock_v2' because it is being used by another process. at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Duplicati.Library.Snapshots.SystemIOWindows.FileOpenRead(String path) at Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.<>c__DisplayClass1_0.<<Run>b__0>d.MoveNext() 2019-01-23 21:41:52 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Templates - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B System.IO.IOException: The process cannot access the file 'C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Templates - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B' because it is being used by another process. at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Duplicati.Library.Snapshots.SystemIOWindows.FileOpenRead(String path) at Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.<>c__DisplayClass1_0.<<Run>b__0>d.MoveNext() 2019-01-23 21:41:52 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\RD - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B System.IO.IOException: The process cannot access the file 'C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\RD - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B' because it is being used by another process. at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Duplicati.Library.Snapshots.SystemIOWindows.FileOpenRead(String path) at Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.<>c__DisplayClass1_0.<<Run>b__0>d.MoveNext() 2019-01-23 21:41:52 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\QAQC - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B System.IO.IOException: The process cannot access the file 'C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\QAQC - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B' because it is being used by another process. at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Duplicati.Library.Snapshots.SystemIOWindows.FileOpenRead(String path) at Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.<>c__DisplayClass1_0.<<Run>b__0>d.MoveNext() 2019-01-23 21:41:52 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Projects - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B System.IO.IOException: The process cannot access the file 'C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Projects - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B' because it is being used by another process. at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Duplicati.Library.Snapshots.SystemIOWindows.FileOpenRead(String path) at Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.<>c__DisplayClass1_0.<<Run>b__0>d.MoveNext() 2019-01-23 21:41:53 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Personnel - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B System.IO.IOException: The process cannot access the file 'C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Personnel - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B' because it is being used by another process. at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Duplicati.Library.Snapshots.SystemIOWindows.FileOpenRead(String path) at Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.<>c__DisplayClass1_0.<<Run>b__0>d.MoveNext() 2019-01-23 21:41:53 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Marketing - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B System.IO.IOException: The process cannot access the file 'C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Marketing - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B' because it is being used by another process. at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Duplicati.Library.Snapshots.SystemIOWindows.FileOpenRead(String path) at Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.<>c__DisplayClass1_0.<<Run>b__0>d.MoveNext() 2019-01-23 21:41:53 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Management - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B System.IO.IOException: The process cannot access the file 'C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Management - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B' because it is being used by another process. at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Duplicati.Library.Snapshots.SystemIOWindows.FileOpenRead(String path) at Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.<>c__DisplayClass1_0.<<Run>b__0>d.MoveNext() 2019-01-23 21:41:53 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\IT - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B System.IO.IOException: The process cannot access the file 'C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\IT - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B' because it is being used by another process. at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Duplicati.Library.Snapshots.SystemIOWindows.FileOpenRead(String path) at Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.<>c__DisplayClass1_0.<<Run>b__0>d.MoveNext() 2019-01-23 21:41:53 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Inventory - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B System.IO.IOException: The process cannot access the file 'C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Inventory - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B' because it is being used by another process. at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Duplicati.Library.Snapshots.SystemIOWindows.FileOpenRead(String path) at Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.<>c__DisplayClass1_0.<<Run>b__0>d.MoveNext() 2019-01-23 21:41:53 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\HSSE - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B System.IO.IOException: The process cannot access the file 'C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\HSSE - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B' because it is being used by another process. at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Duplicati.Library.Snapshots.SystemIOWindows.FileOpenRead(String path) at Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.<>c__DisplayClass1_0.<<Run>b__0>d.MoveNext() 2019-01-23 21:41:53 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Economy - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B System.IO.IOException: The process cannot access the file 'C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Economy - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B' because it is being used by another process. at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Duplicati.Library.Snapshots.SystemIOWindows.FileOpenRead(String path) at Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.<>c__DisplayClass1_0.<<Run>b__0>d.MoveNext() 2019-01-23 21:41:53 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Contacts - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B System.IO.IOException: The process cannot access the file 'C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Contacts - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B' because it is being used by another process. at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Duplicati.Library.Snapshots.SystemIOWindows.FileOpenRead(String path) at Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.<>c__DisplayClass1_0.<<Run>b__0>d.MoveNext() 2019-01-23 21:41:53 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Admin - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B System.IO.IOException: The process cannot access the file 'C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Admin - Documents\.849C9593-D756-4E56-8D6E-42412F2A707B' because it is being used by another process. at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Duplicati.Library.Snapshots.SystemIOWindows.FileOpenRead(String path) at Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.<>c__DisplayClass1_0.<<Run>b__0>d.MoveNext() 2019-01-23 21:42:23 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\OneDrive - YYY\.849C9593-D756-4E56-8D6E-42412F2A707B System.IO.IOException: The process cannot access the file 'C:\Users\XXX\OneDrive - YYY\.849C9593-D756-4E56-8D6E-42412F2A707B' because it is being used by another process. at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Duplicati.Library.Snapshots.SystemIOWindows.FileOpenRead(String path) at Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.<>c__DisplayClass1_0.<<Run>b__0>d.MoveNext()

Why do I get warnings for a folder that is excluded? I’m refering to the Appdata=> Duplicati folder…

Seems to be stuck…:

2019-01-23 22:18:59 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.MetadataPreProcess.FileEntry-ProcessingMetadataFailed]: Failed to process entry, path: C:\Users\XXX\AppData\Local\Duplicati\HCLWFCMDMA.sqlite
CoCoL.RetiredException: The channel is retired
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at CoCoL.Channel`1.d__30.MoveNext()
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Duplicati.Library.Main.Operation.Backup.MetadataPreProcess.<>c__DisplayClass2_0.<b__0>d.MoveNext()

The lead developer describes that as

That is unfortunately a “follow error” that happens when something else breaks.

so possibly you can find an early error in the log. In any case, I’m not surprised it’s stuck after whatever.

Retracing a bit, the line above it shows it maybe trying to process its own database (the name could be verified on the job’s Database tab). This can cause problems, but I see earlier you were trying to filter it.

How was that entered or verified? In addition to a possible GUI entry bug I just found, the final filter needs either a wildcard or regular expression to allow for it not being a full path. Folder also needs trailing slash. Documentation for filters seems to focus on the lower-level view, and GUI-level documentation says little about exactly how to add filters. Maybe the exact operation wasn’t clear, and it’s certainly not clear to me.

Ways to see what filters your GUI entry actually made (it seemingly tries to simplify by editing your entry) include using the three-dot menu on the Source Data screen under Filters. Another is job Commandline, then either look for –exclude values, or check Edit as text and go looking for the raw filter expression.

Another possible filter worry is variables like %APPDATA% and %MY_DOCUMENTS% that vary by user.

How was that determined? If this refers to what Task Manager --> Run as Administrator calls SYSTEM then

C:\>whoami
nt authority\system

C:\>echo %APPDATA%
C:\WINDOWS\system32\config\systemprofile\AppData\Roaming

C:\>echo %MY DOCUMENTS%
%MY DOCUMENTS%

C:\>

however the System.UnauthorizedAccessException hit earlier with --snapshot-policy=Required hints that whatever the account is, it doesn’t have privilege to snapshot, thus almost certainly is not SYSTEM.

Figuring out the account problem may be the best path now, having tried the other some, and hit issues.

I believe About -> System info should show account under which Duplicati is running.

System properties

  • APIVersion : 1
  • PasswordPlaceholder : **********
  • ServerVersion : 2.0.4.5
  • ServerVersionName : - 2.0.4.5_beta_2018-11-28
  • ServerVersionType : Beta
  • StartedBy : Tray icon
  • BaseVersionName : 2.0.2.1_beta_2017-08-01
  • DefaultUpdateChannel : Beta
  • DefaultUsageReportLevel : Information
  • ServerTime : 2019-01-24T14:16:46.0747831+01:00
  • OSType : Windows
  • DirectorySeparator : \
  • PathSeparator : ;
  • CaseSensitiveFilesystem : false
  • MonoVersion :
  • MachineName : XXX
  • UserName : YYY
  • NewLine :
  • CLRVersion : 4.0.30319.42000
  • CLROSInfo : {“Platform”:“Win32NT”,“ServicePack”:"",“Version”:“6.2.9200.0”,“VersionString”:“Microsoft Windows NT 6.2.9200.0”}
  • ServerModules :
  • UsingAlternateUpdateURLs : false
  • LogLevels : [“ExplicitOnly”,“Profiling”,“Verbose”,“Retry”,“Information”,“DryRun”,“Warning”,“Error”]
  • SuppressDonationMessages : false

Server state properties

  • lastEventId : 89
  • lastDataUpdateId : 3
  • lastNotificationUpdateId : 0
  • estimatedPauseEnd : 0001-01-01T00:00:00
  • activeTask : {“Item1”:2,“Item2”:“4”}
  • programState : Running
  • lastErrorMessage :
  • connectionState : connected
  • xsfrerror : false
  • connectionAttemptTimer : 0
  • failedConnectionAttempts : 0
  • lastPgEvent : {“BackupID”:“4”,“TaskID”:2,“BackendAction”:“List”,“BackendPath”:null,“BackendFileSize”:-1,“BackendFileProgress”:0,“BackendSpeed”:-1,“BackendIsBlocking”:false,“CurrentFilename”:null,“CurrentFilesize”:0,“CurrentFileoffset”:0,“Phase”:“Backup_WaitForUpload”,“OverallProgress”:0,“ProcessedFileCount”:1,“ProcessedFileSize”:529997824,“TotalFileCount”:72788,“TotalFileSize”:136590390626,“StillCounting”:false}
  • updaterState : Waiting
  • updatedVersion :
  • updateReady : false
  • updateDownloadProgress : 0
  • proposedSchedule : [{“Item1”:“4”,“Item2”:“2019-01-24T17:06:00Z”}]
  • schedulerQueueIds : [{“Item1”:3,“Item2”:“4”}]
  • pauseTimeRemain : 0

This user appears not to have the required administrative privileges to request snapshots (Windows VSS).

Security Considerations for Requesters

A requester typically needs to run under a user that is a member of either the Administrators group or the Backup Operators group, or run as the Local System account.

Duplicati.WindowsService.exe could start Duplicati at boot as the SYSTEM user. See earlier Migrating link. Currently this seems to be running Tray Icon, which is fine if start at login is fine, but account needs to not be what Settings calls Standard User. Instead, it needs Administrator, or some powerful enough user.

If this is not possible for whatever reason, then we’ll abandon the VSS path and go back to fixing the other.

Sorry for replying so late to your earlier post - I must have overseen your reply earlier. Some of your questions are answered already. I will answer what I missed:

  1. Exclude folder => How was that entered or verified? Used the GUI and just entered the entire path… didn’t think this could be wrong. But since it’s failing, I changed to: %APPDATA%\Local\Duplicati\ just now. Let’s see if that helps. However, if duplicati isn’t capable of backing up it’s own database … it should be impossible to choose it as source. Btw: I’ve not enter any wildcards before - so duplicati must have “corrected” my full-path-entries.

Ok, I did the migration… so let’s see. This is what duplicati shows now in “About” => "System Information:

System properties

  • APIVersion : 1
  • PasswordPlaceholder : **********
  • ServerVersion : 2.0.4.5
  • ServerVersionName : - 2.0.4.5_beta_2018-11-28
  • ServerVersionType : Beta
  • StartedBy : Server

So thgis is what we wanted, right? Although I did not move the folder
C:\Users\Jost Wittmann\AppData\Local\Duplicati
I copied it, and now, Duplicati does not allow me to do any changes since the folder is in use…

Then, I had to select the source again (which files&folders to backup), since it gave me error on the format used - refused to start. Once done, it seems to runf through, although here is a list of Warnings/Errors:

DeletedFiles: 14955
DeletedFolders: 4103
ModifiedFiles: 2
ExaminedFiles: 67040
OpenedFiles: 28385
AddedFiles: 28383
SizeOfModifiedFiles: 1671455
SizeOfAddedFiles: 7290054743
SizeOfExaminedFiles: 136626335816
SizeOfOpenedFiles: 7291726198
NotProcessedFiles: 0
AddedFolders: 363
TooLargeFiles: 0
FilesWithError: 0
ModifiedFolders: 0
ModifiedSymlinks: 0
AddedSymlinks: 0
DeletedSymlinks: 21
PartialBackup: False
Dryrun: False
MainOperation: Backup
CompactResults: null
DeleteResults:
DeletedSets:
Dryrun: False
MainOperation: Delete
CompactResults: null
ParsedResult: Error
Version: 2.0.4.5 (2.0.4.5_beta_2018-11-28)
EndTime: 25.01.2019 11:51:15 (1548413475)
BeginTime: 25.01.2019 11:50:57 (1548413457)
Duration: 00:00:18.5047128
Messages: [
2019-01-25 11:43:29 +01 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started,
2019-01-25 11:44:39 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: (),
2019-01-25 11:44:54 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (5.36 KB),
2019-01-25 11:45:22 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-ba582f9aa78854bcb8416a6e68ff52bbb.dblock.zip.gpg (48.81 MB),
2019-01-25 11:45:50 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-ba582f9aa78854bcb8416a6e68ff52bbb.dblock.zip.gpg (48.81 MB),

]
Warnings: [
2019-01-25 11:45:25 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\AppData\Local\Duplicati\78687874907066698382.sqlite-journal,
2019-01-25 11:45:47 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\AppData\Local\Duplicati\control_dir_v2\lock_v2,
2019-01-25 11:47:40 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\AppData\Roaming\Thunderbird\Profiles\o5t6hf3q.default\parent.lock,
2019-01-25 11:49:23 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Templates - Documents.849C9593-D756-4E56-8D6E-42412F2A707B,
2019-01-25 11:49:24 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\RD - Documents.849C9593-D756-4E56-8D6E-42412F2A707B,

]
Errors: [
2019-01-25 11:45:25 +01 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-CheckingErrorsForIssue1400]: Checking errors, related to #1400. Unexpected result count: 0, expected 1, hash: ZVlgcymygssP0ZO5fWKON2emZmucvQc9sumfxynSZaE=, size: 102400, blocksetid: 163708, ix: 43, fullhash: x0ZGzOrEJJV6HasTNnvyJUSpAjdUfrifIy0kJtzxqFU=, fullsize: 4725608,
2019-01-25 11:45:25 +01 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-FoundIssue1400Error]: Found block with ID 1738470 and hash ZVlgcymygssP0ZO5fWKON2emZmucvQc9sumfxynSZaE= and size 100792
]
BackendStatistics:
RemoteCalls: 16
BytesUploaded: 248254269
BytesDownloaded: 59385151
FilesUploaded: 11
FilesDownloaded: 3
FilesDeleted: 0
FoldersCreated: 0
RetryAttempts: 0
UnknownFileSize: 0
UnknownFileCount: 0
KnownFileCount: 5503
KnownFileSize: 140718701058
LastBackupDate: 25.01.2019 11:43:29 (1548413009)
BackupListCount: 46
TotalQuotaSpace: 0
FreeQuotaSpace: 0
AssignedQuotaSpace: -1
ReportedQuotaError: False
ReportedQuotaWarning: False
ParsedResult: Error
Version: 2.0.4.5 (2.0.4.5_beta_2018-11-28)
Messages: [
2019-01-25 11:43:29 +01 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started,
2019-01-25 11:44:39 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: (),
2019-01-25 11:44:54 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (5.36 KB),
2019-01-25 11:45:22 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-ba582f9aa78854bcb8416a6e68ff52bbb.dblock.zip.gpg (48.81 MB),
2019-01-25 11:45:50 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-ba582f9aa78854bcb8416a6e68ff52bbb.dblock.zip.gpg (48.81 MB),

]
Warnings: [
2019-01-25 11:45:25 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\AppData\Local\Duplicati\78687874907066698382.sqlite-journal,
2019-01-25 11:45:47 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\AppData\Local\Duplicati\control_dir_v2\lock_v2,
2019-01-25 11:47:40 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\AppData\Roaming\Thunderbird\Profiles\o5t6hf3q.default\parent.lock,
2019-01-25 11:49:23 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Templates - Documents.849C9593-D756-4E56-8D6E-42412F2A707B,
2019-01-25 11:49:24 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\RD - Documents.849C9593-D756-4E56-8D6E-42412F2A707B,

]
Errors: [
2019-01-25 11:45:25 +01 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-CheckingErrorsForIssue1400]: Checking errors, related to #1400. Unexpected result count: 0, expected 1, hash: ZVlgcymygssP0ZO5fWKON2emZmucvQc9sumfxynSZaE=, size: 102400, blocksetid: 163708, ix: 43, fullhash: x0ZGzOrEJJV6HasTNnvyJUSpAjdUfrifIy0kJtzxqFU=, fullsize: 4725608,
2019-01-25 11:45:25 +01 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-FoundIssue1400Error]: Found block with ID 1738470 and hash ZVlgcymygssP0ZO5fWKON2emZmucvQc9sumfxynSZaE= and size 100792
]
RepairResults: null
TestResults:
MainOperation: Test
Verifications: [
Key: duplicati-20190125T104329Z.dlist.zip.gpg
Value: ,
Key: duplicati-i2d1178ace8c44d138636a550e1497581.dindex.zip.gpg
Value: ,
Key: duplicati-bd6c6268e1ccd4332898aa9b6cdf36ca7.dblock.zip.gpg
Value:
]
ParsedResult: Error
Version: 2.0.4.5 (2.0.4.5_beta_2018-11-28)
EndTime: 25.01.2019 12:03:10 (1548414190)
BeginTime: 25.01.2019 11:51:34 (1548413494)
Duration: 00:11:36.1943284
Messages: [
2019-01-25 11:43:29 +01 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started,
2019-01-25 11:44:39 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: (),
2019-01-25 11:44:54 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (5.36 KB),
2019-01-25 11:45:22 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-ba582f9aa78854bcb8416a6e68ff52bbb.dblock.zip.gpg (48.81 MB),
2019-01-25 11:45:50 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-ba582f9aa78854bcb8416a6e68ff52bbb.dblock.zip.gpg (48.81 MB),

]
Warnings: [
2019-01-25 11:45:25 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\AppData\Local\Duplicati\78687874907066698382.sqlite-journal,
2019-01-25 11:45:47 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\AppData\Local\Duplicati\control_dir_v2\lock_v2,
2019-01-25 11:47:40 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\AppData\Roaming\Thunderbird\Profiles\o5t6hf3q.default\parent.lock,
2019-01-25 11:49:23 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Templates - Documents.849C9593-D756-4E56-8D6E-42412F2A707B,
2019-01-25 11:49:24 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\RD - Documents.849C9593-D756-4E56-8D6E-42412F2A707B,

]
Errors: [
2019-01-25 11:45:25 +01 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-CheckingErrorsForIssue1400]: Checking errors, related to #1400. Unexpected result count: 0, expected 1, hash: ZVlgcymygssP0ZO5fWKON2emZmucvQc9sumfxynSZaE=, size: 102400, blocksetid: 163708, ix: 43, fullhash: x0ZGzOrEJJV6HasTNnvyJUSpAjdUfrifIy0kJtzxqFU=, fullsize: 4725608,
2019-01-25 11:45:25 +01 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-FoundIssue1400Error]: Found block with ID 1738470 and hash ZVlgcymygssP0ZO5fWKON2emZmucvQc9sumfxynSZaE= and size 100792
]
ParsedResult: Error
Version: 2.0.4.5 (2.0.4.5_beta_2018-11-28)
EndTime: 25.01.2019 12:03:10 (1548414190)
BeginTime: 25.01.2019 11:43:28 (1548413008)
Duration: 00:19:41.3750805
Messages: [
2019-01-25 11:43:29 +01 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started,
2019-01-25 11:44:39 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: (),
2019-01-25 11:44:54 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (5.36 KB),
2019-01-25 11:45:22 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-ba582f9aa78854bcb8416a6e68ff52bbb.dblock.zip.gpg (48.81 MB),
2019-01-25 11:45:50 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-ba582f9aa78854bcb8416a6e68ff52bbb.dblock.zip.gpg (48.81 MB),

]
Warnings: [
2019-01-25 11:45:25 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\AppData\Local\Duplicati\78687874907066698382.sqlite-journal,
2019-01-25 11:45:47 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\AppData\Local\Duplicati\control_dir_v2\lock_v2,
2019-01-25 11:47:40 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\AppData\Roaming\Thunderbird\Profiles\o5t6hf3q.default\parent.lock,
2019-01-25 11:49:23 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Templates - Documents.849C9593-D756-4E56-8D6E-42412F2A707B,
2019-01-25 11:49:24 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\RD - Documents.849C9593-D756-4E56-8D6E-42412F2A707B,

]
Errors: [
2019-01-25 11:45:25 +01 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-CheckingErrorsForIssue1400]: Checking errors, related to #1400. Unexpected result count: 0, expected 1, hash: ZVlgcymygssP0ZO5fWKON2emZmucvQc9sumfxynSZaE=, size: 102400, blocksetid: 163708, ix: 43, fullhash: x0ZGzOrEJJV6HasTNnvyJUSpAjdUfrifIy0kJtzxqFU=, fullsize: 4725608,
2019-01-25 11:45:25 +01 - [Error-Duplicati.Library.Main.Database.LocalBackupDatabase-FoundIssue1400Error]: Found block with ID 1738470 and hash ZVlgcymygssP0ZO5fWKON2emZmucvQc9sumfxynSZaE= and size 100792
]

I will now set the snapshot-policy to “required” and come back to you.

Hello again. Sorry for the break in communication - had some troubles with my backup server. And you know: No server, no posts… :wink:
This is the logfile from the first day back online. Duplicati mentioned 170 warnings. Snapshots were set to “required”. Also the “write to logfile” option was turned on, but I receved an error: “logfile not accessable”. Will look into it.

Jan 30, 2019 8:29 PM: Result
DeletedFiles: 0
DeletedFolders: 0
ModifiedFiles: 6
ExaminedFiles: 53036
OpenedFiles: 18
AddedFiles: 12
SizeOfModifiedFiles: 3662924
SizeOfAddedFiles: 66524926
SizeOfExaminedFiles: 115256473687
SizeOfOpenedFiles: 70187850
NotProcessedFiles: 0
AddedFolders: 2
TooLargeFiles: 0
FilesWithError: 0
ModifiedFolders: 0
ModifiedSymlinks: 0
AddedSymlinks: 0
DeletedSymlinks: 0
PartialBackup: False
Dryrun: False
MainOperation: Backup
CompactResults:
    DeletedFileCount: 0
    DownloadedFileCount: 0
    UploadedFileCount: 0
    DeletedFileSize: 0
    DownloadedFileSize: 0
    UploadedFileSize: 0
    Dryrun: False
    MainOperation: Compact
    ParsedResult: Warning
    Version: 2.0.4.5 (2.0.4.5_beta_2018-11-28)
    EndTime: 1/30/2019 8:27:07 PM (1548876427)
    BeginTime: 1/30/2019 8:26:14 PM (1548876374)
    Duration: 00:00:52.6502662
    Messages: [
        2019-01-30 20:23:04 +01 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started,
        2019-01-30 20:24:33 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),
        2019-01-30 20:24:38 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (5,42 KB),
        2019-01-30 20:25:40 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b98fb25388e184e1a84f644f5d886233a.dblock.zip.gpg (313,94 KB),
        2019-01-30 20:25:42 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b98fb25388e184e1a84f644f5d886233a.dblock.zip.gpg (313,94 KB),
...
    ]
    Warnings: [
        2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Templates - Documents\,
        2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Templates - Documents\,
        2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\RD - Documents\,
        2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\RD - Documents\,
        2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\QAQC - Documents\,
...
    ]
    Errors: []
    BackendStatistics:
        RemoteCalls: 8
        BytesUploaded: 5668474
        BytesDownloaded: 57871908
        FilesUploaded: 3
        FilesDownloaded: 3
        FilesDeleted: 0
        FoldersCreated: 0
        RetryAttempts: 0
        UnknownFileSize: 0
        UnknownFileCount: 0
        KnownFileCount: 5553
        KnownFileSize: 141034681193
        LastBackupDate: 1/30/2019 8:23:04 PM (1548876184)
        BackupListCount: 60
        TotalQuotaSpace: 0
        FreeQuotaSpace: 0
        AssignedQuotaSpace: -1
        ReportedQuotaError: False
        ReportedQuotaWarning: False
        ParsedResult: Warning
        Version: 2.0.4.5 (2.0.4.5_beta_2018-11-28)
        Messages: [
            2019-01-30 20:23:04 +01 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started,
            2019-01-30 20:24:33 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),
            2019-01-30 20:24:38 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (5,42 KB),
            2019-01-30 20:25:40 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b98fb25388e184e1a84f644f5d886233a.dblock.zip.gpg (313,94 KB),
            2019-01-30 20:25:42 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b98fb25388e184e1a84f644f5d886233a.dblock.zip.gpg (313,94 KB),
...
        ]
        Warnings: [
            2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Templates - Documents\,
            2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Templates - Documents\,
            2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\RD - Documents\,
            2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\RD - Documents\,
            2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\QAQC - Documents\,
...
        ]
        Errors: []
DeleteResults:
    DeletedSets: []
    Dryrun: False
    MainOperation: Delete
    ParsedResult: Warning
    Version: 2.0.4.5 (2.0.4.5_beta_2018-11-28)
    EndTime: 1/30/2019 8:27:07 PM (1548876427)
    BeginTime: 1/30/2019 8:26:03 PM (1548876363)
    Duration: 00:01:03.8985719
    Messages: [
        2019-01-30 20:23:04 +01 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started,
        2019-01-30 20:24:33 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),
        2019-01-30 20:24:38 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (5,42 KB),
        2019-01-30 20:25:40 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b98fb25388e184e1a84f644f5d886233a.dblock.zip.gpg (313,94 KB),
        2019-01-30 20:25:42 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b98fb25388e184e1a84f644f5d886233a.dblock.zip.gpg (313,94 KB),
...
    ]
    Warnings: [
        2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Templates - Documents\,
        2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Templates - Documents\,
        2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\RD - Documents\,
        2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\RD - Documents\,
        2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\QAQC - Documents\,
...
    ]
    Errors: []
RepairResults: null
TestResults:
    MainOperation: Test
    Verifications: [
        Key: duplicati-20190130T192304Z.dlist.zip.gpg
        Value: [],
        Key: duplicati-i09299b4398174a698aa76a4037e22cd4.dindex.zip.gpg
        Value: [],
        Key: duplicati-b6d999066c80e4f508459b2dc1ea8471a.dblock.zip.gpg
        Value: []
    ]
    ParsedResult: Warning
    Version: 2.0.4.5 (2.0.4.5_beta_2018-11-28)
    EndTime: 1/30/2019 8:29:18 PM (1548876558)
    BeginTime: 1/30/2019 8:27:11 PM (1548876431)
    Duration: 00:02:06.4088496
    Messages: [
        2019-01-30 20:23:04 +01 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started,
        2019-01-30 20:24:33 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),
        2019-01-30 20:24:38 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (5,42 KB),
        2019-01-30 20:25:40 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b98fb25388e184e1a84f644f5d886233a.dblock.zip.gpg (313,94 KB),
        2019-01-30 20:25:42 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b98fb25388e184e1a84f644f5d886233a.dblock.zip.gpg (313,94 KB),
...
    ]
    Warnings: [
        2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Templates - Documents\,
        2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Templates - Documents\,
        2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\RD - Documents\,
        2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\RD - Documents\,
        2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\QAQC - Documents\,
...
    ]
    Errors: []
ParsedResult: Warning
Version: 2.0.4.5 (2.0.4.5_beta_2018-11-28)
EndTime: 1/30/2019 8:29:18 PM (1548876558)
BeginTime: 1/30/2019 8:23:04 PM (1548876184)
Duration: 00:06:13.6303117
Messages: [
    2019-01-30 20:23:04 +01 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started,
    2019-01-30 20:24:33 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),
    2019-01-30 20:24:38 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (5,42 KB),
    2019-01-30 20:25:40 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b98fb25388e184e1a84f644f5d886233a.dblock.zip.gpg (313,94 KB),
    2019-01-30 20:25:42 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b98fb25388e184e1a84f644f5d886233a.dblock.zip.gpg (313,94 KB),
...
]
Warnings: [
    2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Templates - Documents\,
    2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\Templates - Documents\,
    2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\RD - Documents\,
    2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\RD - Documents\,
    2019-01-30 20:23:43 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint\QAQC - Documents\,
...
]
Errors: []

Strange that this Sharepoint keeps popping up. Sharepoint synchronisation is enabled, but I haven’t moved any files for the past months.
Btw.: I use duplicati on the ubuntu computer of a family member. It uses the same transfer protocol (SFTP) to the same server. During a remote desktop session to the computer, I saw the following error popping up:

Unexpected result count: 0, expected 1

Seems familiar!? Maybe it has something to do with the protocol or the backup server? So I took a look at the servers logfile today, and I see plenty of these:

Jan 30 17:51:48 Jonas mountd[1935]: mount request from 192.168.1.14 for non existent path /Bicon
Jan 30 17:51:48 Jonas mountd[1935]: mount request denied from 192.168.1.14 for /Bicon
Jan 30 20:32:35 Jonas mountd[1935]: mount request from 192.168.1.14 for non existent path /XXX
Jan 30 20:32:35 Jonas mountd[1935]: mount request denied from 192.168.1.14 for /XXX

I am pretty sure it has something to do with duplicati, since the message stopped when duplicati was done doing backups. “Bicon” is a folder that I have on my computer - but I do not know why it should be causing problems.

Hello all,
Could somebody please help me to get this sorted out?
By now, I had to run a repair “database” again to get things working. It’s running now, but still shows 170 Warnings…

Did this happen? Last list of errors posted were on C:\Users\XXX\Documents\YYY\Sharepoint\SharePoint without the error details the logfile would have. About --> Show log --> Live during the backup might catch them if you can’t get --log-file working. Assuming you want these documents backed up, we need to know what the reason is that you can’t access them. You run Duplicati as UserName : YYY so FileAccessError could happen when trying to access XXX files (if that’s really a different user). The error details would help.

You can test this by hand in Windows File Explorer running as user YYY, trying to access user XXX’s files.

The --snapshot-policy=required will get access to locked files but won’t get past Windows access control. For that, the usual solution would be to run Duplicati as SYSTEM which is default for its Windows service, however I’m assuming YYY is not SYSTEM (otherwise why obscure?). It’s probably at least Administrator group, otherwise --snapshot-policy=required would have an error, but might not really be running elevated. Some people dislike running as SYSTEM because it’s too powerful. I don’t know if you have such reasons.

If you don’t in fact want the SharePoint files, you could exclude them. I’m not sure what the goal is besides NOT having 170 warnings. I’m also not sure if there are also warnings beyond what SharePoint files made.

Did this happen?

Of course - I’m not making things up. But since this error appeared only once, I suspect the reason might have something to do with the logfile not being in write-mode. Maybe the logfile was still open in a texteditor, or the texteditor didn’t close correctly…
However, I can access the logfile manually now. Going back to the timestamp, I see most errors relate to Sharepoint, Dropbox and googledrive:

2019-01-30 20:25:25 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: C:\Users\XXX\Dropbox (YYY).dropbox.cache\qebcobkqbgpbzfynfuwbof\placeholder.ai
System.IO.IOException: (1920) Das System kann auf die Datei nicht zugreifen: [\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy40\Users\XXX\Dropbox (YYY).dropbox.cache\qebcobkqbgpbzfynfuwbof\placeholder.ai]
bei Alphaleonis.Win32.NativeError.ThrowException(UInt32 errorCode, String readPath, String writePath)
bei Alphaleonis.Win32.Filesystem.File.CreateFileCore(KernelTransaction transaction, String path, ExtendedFileAttributes attributes, FileSecurity fileSecurity, FileMode fileMode, FileSystemRights fileSystemRights, FileShare fileShare, Boolean checkPath, PathFormat pathFormat)
bei Alphaleonis.Win32.Filesystem.File.OpenCore(KernelTransaction transaction, String path, FileMode mode, FileSystemRights rights, FileShare share, ExtendedFileAttributes attributes, Nullable`1 bufferSize, FileSecurity security, PathFormat pathFormat)
bei Duplicati.Library.Snapshots.SystemIOWindows.FileOpenRead(String path)
bei Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.<>c__DisplayClass1_0.<b__0>d.MoveNext()

and

2019-01-30 20:25:17 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\YYY\Documents\XXX\Sharepoint\SharePoint\Admin - Documents
System.IO.IOException: (19) Das Medium ist schreibgeschützt: [\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy40\Users\YYY\Documents\XXX\Sharepoint\SharePoint\Admin - Documents*]
bei Alphaleonis.Win32.NativeError.ThrowException(UInt32 errorCode, String readPath, String writePath)
bei Alphaleonis.Win32.Filesystem.FindFileSystemEntryInfo.FindFirstFile(String pathLp, WIN32_FIND_DATA& win32FindData)
bei Alphaleonis.Win32.Filesystem.FindFileSystemEntryInfo.d__31.MoveNext() bei System.Linq.Buffer1…ctor(IEnumerable1 source) bei System.Linq.Enumerable.ToArray[TSource](IEnumerable1 source)
bei Duplicati.Library.Snapshots.WindowsSnapshot.ListFiles(String localFolderPath)
bei Duplicati.Library.Utility.Utility.d__23.MoveNext()

I’m happy to exclude the Sharepoint from backup, but my attempts failed for some reason earlier. In the configuration of duplicati => Source Data => Filters => Exclude Folders.
I excluded the corresponding folder just now once again, and it works: I receive “only” 105 warnings. Most (possibly all?) of them relate to googledrive and dropbox. Both should get backed up. Find below the error related to googledrive (the dropbox error is identical to the one from a few weeks ago):

2019-02-14 22:06:34 +01 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: C:\Users\XXX\Google Drive
System.UnauthorizedAccessException: (5) Zugriff verweigert: [\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy14\Users\XXX\Google Drive*]
bei Alphaleonis.Win32.NativeError.ThrowException(UInt32 errorCode, String readPath, String writePath)
bei Alphaleonis.Win32.Filesystem.FindFileSystemEntryInfo.FindFirstFile(String pathLp, WIN32_FIND_DATA& win32FindData)
bei Alphaleonis.Win32.Filesystem.FindFileSystemEntryInfo.d__31.MoveNext() bei System.Linq.Buffer1…ctor(IEnumerable1 source) bei System.Linq.Enumerable.ToArray[TSource](IEnumerable1 source)
bei Duplicati.Library.Snapshots.WindowsSnapshot.ListFiles(String localFolderPath)
bei Duplicati.Library.Utility.Utility.d__23.MoveNext()

The --snapshot-policy=required will get access to locked files but won’t get past Windows access control. For that, the usual solution would be to run Duplicati as SYSTEM which is default for its Windows service, however I’m assuming YYY is not SYSTEM (otherwise why obscure?). It’s probably at least Administrator group, otherwise --snapshot-policy=required would have an error, but might not really be running elevated. Some people dislike running as SYSTEM because it’s too powerful. I don’t know if you have such reasons.

I’d be happy to run duplicati elevated. This is what the taskmanager shows:


Not sure what this means for my case.

If you don’t in fact want the SharePoint files, you could exclude them. I’m not sure what the goal is besides NOT having 170 warnings. I’m also not sure if there are also warnings beyond what SharePoint files made

Good point! As you mentioned yourself: sometimes errors/warnings are like symptoms of a real problem. 170 Warnings make it quite difficult to track (real) problems.

Here is my conclusion so far: Duplicati has problems accessing the files which are mirrored in the cloud. Snapshotpolicy=required does not do the trick, although duplicati is running as a SYSTEM. I think this is odd, since all files of googledrive, dropbox and sharepoint are problematic - although they are not accessed/synced, while duplicati is running its backup.

I’ve been looking into this awhile, and there’s more looking needed. I hope you can research and test.

is interesting for two reasons. One is that it’s in the cache, which (like most caches) is for temporary storage of data not meant for direct access which is automatically maintained and frequently cleared.

How to clear the cache folder

If that’s the end of it, then perhaps backing up cache isn’t necessary, however I suspect the sampling simply didn’t show the same problem in the main Dropbox folder. Problem’s clue is the placeholder.

I assume you have Dropbox Professional or Business with Smart Sync. If not, ignore the next portions.

Smart Sync
Smart Sync and system extensions
Going deeper with Project Infinite

I suspect it’s OK with a mirror, but not OK with cloud software that plays fancy tricks such as not doing actual mirroring (as older sync software likes to do), but on-demand on-line action (as newer ways do). One gets a mix of files that are on the computer, or not on the computer. Not on computer = no backup.

Carbon Copy Cloner 5 Release Notes

Carbon Copy Cloner 5.1.6

October 12, 2018

  • Improved the handling of Microsoft OneDrive, Google Drive File Stream and Dropbox placeholder files. Please note that if you’re using any of these services, files that are marked as “online only” cannot be backed up. Learn more here.

Limitations of online-only placeholder files

When you choose to have these services store your files only online, do so with the understanding that it’s not possible to maintain a local backup of those files.

I’m not sure I agree, but it does lead to potential trouble, such as downloading everything there to back up.

Prevent unwanted OneDrive file downloads

Cloud drive integration (files on-demand) took a survey of possible treatments. It’s not clear which is best.

Does this seem to fit so far? I haven’t seen any backup that deals with it well, which possibly could be due to an insufficient API for the backup software to ask for the file temporarily (then put things back as before) or perhaps because it’s hard to find a sensible way to do it at the client when all the files are in the cloud…

If OK so far, the next question is whether your Google Drive app is Drive File Stream, or Backup and Sync. Drive File Stream has the same issue. If Backup and Sync, right click Google Drive to make sure Security grants access by the SYSTEM user that you found in Task Manager. If not, access will need to be granted. When I first set up Google Drive backup, I had to do this. The new Backup and Sync seems better though.

Hello ts678 - thank you once again for all the time and thoughts you put into this!

I cleared the cache of dropbox (both, the private and the business version), and initiated a backup. 5 Warnings remain (so 100 warnings less than prior this change). In a next step, I excluded the dropbox cache folders from backup - this should do the trick in the long run.

The 5 remaining warnings all relate to the googledrive.
The tool in question is called “Backup and Sync from google”. In its preferences, “Sync my drive to this computer” is activated. So the files really are on my local harddrive. I can access them while beeing offline.
Right-click the googledrive-folder => Security => Add SYSTEM as user and grant “read” access.

At this point, I initiated another duplicati backup. And voila: I can now see duplicati transfering the files of the googledrive. Since I have no changes on my googledrive since the backup before, this filetransfer shows that the access was an issue.

Since googledrive hosts few gigabytes of data, I won’t be staying up until backup is finished. But I expect, that no more warnings will pop up.

Keep you posted!