Here is what I did…On Duplicati, I setup two backup jobs one for MWF (monday, wed…etc) and the other for TTh. Labeled the external drives for use on on those days, and am monitoring it.
Having a problem with Snapshot option and Quickbooks files. error log posted below.
DeletedFiles: 0
No remote filesets were deleted,
removing file listed as Temporary: duplicati-be9b751be49564c90ab4c8f20a1a7bab3.dblock.zip.aes,
removing file listed as Temporary: duplicati-i875d56f37fd24abf8f618e36b2df177c.dindex.zip.aes
]
Warnings: [
Failed to process path: C:\shared\qb\fixed_ellis sales inc qbenterprise.qbw => The process cannot access the file 'C:\shared\qb\fixed_ellis sales inc qbenterprise.qbw' because it is being used by another process.,
Failed to process path: C:\shared\qb\fixed_ellis sales inc qbenterprise.qbw.TLG => The process cannot access the file 'C:\shared\qb\fixed_ellis sales inc qbenterprise.qbw.TLG' because it is being used by another process.
What are you using for your --snapshot-policy setting (see below)?
--snapshot-policy
This setting controls the usage of snapshots, which allows Duplicati to backup files that are locked by other programs. If this is set to “off”, Duplicati will not attempt to create a disk snapshot. Setting this to “auto” makes Duplicati attempt to create a snapshot, and fail silently if that was not allowed or supported (note that the OS may still log system warnings). A setting of “on” will also make Duplicati attempt to create a snapshot, but will produce a warning message in the log if it fails. Setting it to “required” will make Duplicati abort the backup if the snapshot creation fails. On windows this uses the Volume Shadow Copy Services (VSS) and requires administrative privileges. On Linux this uses Logical Volume Management (LVM) and requires root privileges.
Default value: “off”
Is there a specific multi-USB issue you were having troubles with?
Are you using either of these parms to help keep Duplicati from backing up to the wrong USB drive?
--alternate-destination-marker
This option only works when the --alternate-target-paths option is also specified. If there are alternate paths specified, this option indicates the name of a marker file that must be present in the folder. This can be used to handle situations where an external drive changes drive letter or mount point. By ensuring that a certain file exists, it is possible to prevent writing data to an unwanted external drive. The contents of the file are never examined, only file existence.
Default value: “”
--alternate-destination-marker
This option only works when the --alternate-target-paths option is also specified. If there are alternate paths specified, this option indicates the name of a marker file that must be present in the folder. This can be used to handle situations where an external drive changes drive letter or mount point. By ensuring that a certain file exists, it is possible to prevent writing data to an unwanted external drive. The contents of the file are never examined, only file existence.
Default value: “”
I’ve been using multiple external drives from backups without any problems. it’s much easier to backup to local drives lots of data, as well as local drives provide much faster recovery, if the site isn’t completely destroyed.
Cloud + Local (external) drives are the way to go for me.
Also data which isn’t critical, is only backed up to external drives. And there’s lots of it (terabytes). Backing this to cloud would take a while. Also recovering it from cloud would take also quite a while.
I haven’t experienced any problems with Duplicati. Except file system corruption, but that’s not duplicati issue. It’s like having bad usb hub and disconnecting exFAT drive while writing to it. Yeah, it’s bad and it happens, but that’s life.
I don’t believe the problem is with the External drives themselves. Duplicati “snapshot” feature/option does not seem to be able to perform it’s function.
Any additional ideas/suggestions would be appreciated!
Since the issue you’re having isn’t related to USB drive use I’ve gone ahead and moved things to their own topic.
On Windows Duplicati uses the standard Windows VSS functionality - either a snapshot is made or it isn’t. If it isn’t and your --snapshot-policy is set to on then you should get a warning and the backup will continue (not including in-use files) and if it’s set to required you should get an error and the backup should fail.
If you’re using on or required and NOT getting a warning or error then Windows VSS isn’t allowing access to the in-use files and there’s nothing Duplicati can do about it.
I believe other users have mentioned QuickBooks files but NOT having the issue you describe so perhaps it’s something unique to your system. Can you try posting your backup job exported “As command-line” (with personal stuff like email address, passwords, etc. removed) so we can make sure there isn’t something else going wrong? Oh, and what versions of Windows and Duplicati are you using?
Having a the same issue. Running windows server 2019, duplicati beta version and running quickbooks 2020. Here is the error message. And users are currently using the files. The rest of the files are backed up with the exception of the open files. Running webgui version.
2021-11-04 12:57:53 -07 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: D:\Accounting\IFS 2021.QBW
2021-11-04 12:57:53 -07 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: D:\Accounting\IFS