Performance is really slow with high disk usage

[kees-z]

@saviodsouza

In my experience I see something I’ll call double copy… in a least complicated setup.

Backup source D:
Temp Dir C:%temp%
Destination E:

First read files from D:, create dblocks in temp, move to destination

No doubt the job is done but high resources are required. In this case even with no compression and encryption high HDD I/O is needed.

2 ideas from @kenkendk that may improve performance and reduce disk usage:

Multithreaded backup engine:

Very slow to backup

Duplicati is currently (mostly) single threaded. I am working on a version that is multithreaded. My guess is that the CPU is too slow on one core, which is why it does not upload faster (there is not enough data). I have not heard of slow-downs due to old Mono, but you could try the “aFTP” backend, as it implements the transfers a bit different.

Processing DBLOCKS and Temp files in memory:

FileNotFoundException (temp file not found during backup)

Not sure, but I would rather fix it by keeping the file “in-memory”, as it is likely to not be much of a problem (say 50-200mb file, and memory is 4GB+ on new laptops). But it is a bit of a corner case, as the file is temporary (and thus is written at the right place) but it is also used to “communicate” internally, in that it is created and passed to another method. It would be possible to keep the file open, which would prevent a cleaner program from deleting it.