I was using Duplicati (via GUI) for the first time yesterday to back up data from an internal hard drive to another hard drive also connected via SATA.
Setting up the process was wonderfully easy, but performance was a bummer.
Most files are compressed
.NEF files so I edited that
default_compressed_extensions.txt to also contain the following line:
.NEF #Nikon RAW Image Format
(I guess those entries are not case sensitive but I wasn’t 100% sure so I capitalized NEF anyway)
This is my backup command line:
"C:\Program Files\Duplicati 2\Duplicati.CommandLine.exe" backup "file://E:\bup_desktwo_duplicati\D_Daten" "D:\Pictures\\" "D:\Documents" --backup-name=D_Daten --dbpath="U:\bastian\AppData\Local\Duplicati\CTVDEHNYLK.sqlite" --encryption-module= --compression-module=zip --dblock-size=100MB --retention-policy="1W:1D,4W:1W,12M:1M" --no-encryption=true --compression-extension-file="C:\Program Files\Duplicati 2\default_compressed_extensions.txt" --disable-module=console-password-input --exclude="*.cof" --exclude="*.cop" --exclude="*.cot" --exclude="*.ini" --exclude="*.bak~" --exclude="*.txt~" --exclude="%MY_DOCUMENTS%\Adobe\\"
So in the end, Duplicati spent 648 minutes to backup 235GB (Source) producing 217GB in the backup location.
That is a rate of 6.2MB/s.
By the way, the rate displayed in the backup-window was way lower, usually somewhere around 50KB/s-ish with peaks rarely hitting the 1MB/s mark.
I then did an ordinary file copy of another 254GB from the same internal drive to the same backup drive and it took only 48 minutes to complete, 88.2MB/s.
I inspected CPU and memory usage but neither appeared to hit a limit.
What am I doing wrong? How can I increase performance?
Thanks in advance, Bastian