Slow backup pi4

Hi,

I’ve rebuilt my HOME and WORK OMV servers and using Duplicati 2.0.8.1_beta_2024-05-07 container on the home OMV to backup to work.

HOME is a Pi 4 with an external USB SATA drive
WORK is a PC with Internal SATA drive
Network at home is 900mbps fibre and work is 1Gig leased line, both have local gigabit network connection direct to routers

I’m currently only getting 1.05MB/s transfer - I’ve set backup job compression to 0

I ran Duplicati on home laptop and got 25MB/s on a backup to work so doesn’t look like a network issue? I also took the pi to work and connected to same router and still only got 3MB/s

Can anyone please point me in the right direction diagnose why it’s slow and help me to try and speed up my backup?

Lawrence…

Hi @lozcs welcome to the forum!

For something like this, I would suggest trying first to speed-test the Pi4.
In case there is something in your setup that prevents faster speeds here, it will not be fixable for Duplicati.

There are some suggestions on how to test the performance of the Rpi.

Is this the initial backup? On later ones, transfer rates are limited by need to find file changes.

Incremental backups
Duplicati performs a full backup initially. Afterwards, Duplicati updates the initial backup by adding the changed data only. That means, if only tiny parts of a huge file have changed, only those tiny parts are added to the backup. This saves time and space and the backup size usually grows slowly.

Features

Please look with whatever OMV performance diagnostics tools you can get.

OMV6 Performance Statistics Graphs Size has a screenshot showing theirs.

BCM2711 vs Intel Pentium E2180 shows the Pi 4 CPU is in some ways slow.
I’m comparing to the barely usable 2007 Pentium Dual-Core in my spare PC.
Interestingly, I put an SSD in there to help, so this PC is usually CPU limited.
My newer usual PC still has a hard drive, so that’s memory and drive limited.

If you don’t have fancy graphs, older tools like top and iotop might be there.
Presumably somebody on OMV forum can talk about how to measure things.

What sort of storage is the OS on? eMMC might run slow. Micro SD is worse.
You can look at your Duplicati Database screen to see what path that’s using.
There will also be some /tmp use unless you’ve moved things per directions.

Thanks, I tried to follow the suggestions in the link from @kenkendk above.

Couldn’t get any of the suggestions to work.

Whatever I did do broke my install so had to reinstall OMV and Duplicati…

I started the backup again thinking it would pickup the 1TB it had completed but it wiped everything and started again - It started at 3MB/s has been running now for a few days and speed has slowly dropped to 2.39MB/s

It has 2.77TB to go at 2.39MB/s - so about 2 weeks.

It’s quite a static set of my media and I have another backup so I’m just going to leave it to complete - once the first backup is complete nightly backups won’t take long at all.

I’m not proficient in Linux enough to mess about!

Thanks for the tips though