Doing my first full backup (OSX 10.12.6) to Onedrive. The backup is slow, but my fibre upload speed is only 4Mbs. However, the backload seems to hammer my upload speeds (normally 40Mbs but can go down to a few Mbs), which improve if I pause the backup.
Activity monitor shows low levels of inbound data but lots of packets.
Any ideas - is this a bug or expected performance.
Do you have asymmetric upload/download from your ISP? Back in my days on DSL, any sort of uploading (torrenting, etc) would absolutely destroy my download speeds. I’d be surprised if that was an issue on fiber, but I’m not sure what some providers do versus other providers.
ttfn, it sounds like this is something a bit unique to your setup as I’m not hearing of anybody else being able to replicate the issue. As that’s the case, perhaps some general investigation is in order.
For example, on Windows I can look at a task manager (or certain firewall tools) that tell me exactly how much bandwidth is used by what apps / services. Is there a similar thing available for OSX 10.12.6 that might help to at least confirm bandwidth is the issue? I ask because it’s POSSIBLE that something else is the constraining factor such as disk IO or CPU load that is only being ‘exposed’ by it’s effect on transfer speeds.
For example, if you have antivirus running at the packet level but your CPU is so busy compressing archives locally that can’t get to the packets in real time it would appear that your bandwidth is being fully consumed. Actually, you could probably test that by setting the --thread-priority parameter to low (or idle) and see if that has any effect.
OK, so it looks like darker2007 is right and it is a general issue with my connection, it is fibre but very asymmetric speeds (up 40Mbps down 4 Mbps) and I can recreate the effect just by copying a bunch of files into my dropbox folder and monitor the download speed whilst it is synching
I found this a useful explanation:
so now the question is can I restrict the upload speed within Duplicati so that it doesn’t create this undesired effect, or do I have to do this through my router - but the traffic management & diffserve settings are obscure
ttfn, sure you can limit bandwidth - just edit your backup set, go to " step 5" (options) then use the “Add advanced option” selector to choose throttle-upload (and throttle-download if applicable).
If you just want to test various speeds, you can also use the “speedometer” icon in the UI (to the right of Play / Pause) to try different settings for the currently running job to see what effect they have on your total bandwidth. Note that the speedometer are for the current run only and will not be saved with the backup set options.
that has proved helpful thanks and now I have throttled backups running on 2 machines and leaving enough bandwidth for other activities. reading some of the other posts it looks like others are wanting to run backups at scheduled times to avoid similar bottlenecks and utilising cron and the pause/resume script looks to be one option. But would it be possible to adapt the script to throttle/unthrottle the upload which would give even greater flexibility. In other words is this available through the API and how would one do this in a python script.
Other that that, I’m really please to have discovered Duplicati as an alternative to CP home. for my needs it is better and it is great to have the support of the community
ttfn, if you are asking if the throttling amount can be scheduled the answer is not at the moment. I suspect it’s techinically possible but the code to do so (and support it in the UI) doesn’t exist. Yet. If you’d like to change that, feel free to let us know.
Beyond that, if you feel this Topic is resolved it would be great if you could click the Checkmark box (and maybe the as well) on the Topic that resolved it for you!