Backup to JottaCloud extremely slow

[etrigan63]

Performing a large (2.9TB) backup to JottaCloud and it looks like it is going to take 60-70 days. I have 20Mbit upload speeds, why so slow?

Carlos

[JonMikelV]

Most often the speed complaints people have with Duplicati are due to the overhead of hashing, encrypting, and compressing the files rather than actual network bandwidth availability.

Once the initial backup is completed runs tend to get quite a bit faster (depending on the amount of file changes you have in each run).

---

If you want to try and speed things up you can do things like lower the compression level (0 means no compression) or try a different hashing algorithm as discussed here:

Performance is really slow with high CPU usage!

There currently isn’t a “here are the slow parts” profiling function, but the Live Log does have a profiling mode that shows pretty much everything being done and how long it takes, but it’s not pretty. Some discussion has happened around adding metrics, but so far development time has been focused on functionality. Are you getting these 1GB/min times on initial backups, subsequent runs, or both? As far as what Duplicati is doing, the summary is (sort of in this order): compare list of curr…

---

Also, you didn’t mention what Duplicati version you’re running but the later Canary versions include improved hashing as mentioned here:

Performance is really slow with high CPU usage!

Apart from the parallel hashing, there is another speedup in the canary that uses the (terribly named) NgHash. But you can also get it to use the OpenSSL hashing library, which is faster in my tests. You need to drop in the version of the OpenSSL library you are using from here: FasterHashing/Windows-DLLs at master · kenkendk/FasterHashing · GitHub Then set the environment variable FH_LIBRARY=openssl and it should load OpenSSL and use that for hashing.

---

This post has a slightly more detailed list of what Duplicati is doing during the backups:

Performance is really slow with high CPU usage!

There currently isn’t a “here are the slow parts” profiling function, but the Live Log does have a profiling mode that shows pretty much everything being done and how long it takes, but it’s not pretty. Some discussion has happened around adding metrics, but so far development time has been focused on functionality. Are you getting these 1GB/min times on initial backups, subsequent runs, or both? As far as what Duplicati is doing, the summary is (sort of in this order): compare list of curr…

[Kelly_Trinh]

Jottacloud is just slow. Probably less about your link and more on their setup.

Benchmarking different storage providers

Are you benchmarking for speed, space usage, error rates, or none/all of the above. Would you be willing to share your results with the group?

[drakar2007]

I suggest you do a bandwidth test to see how fast you send (for example) a 1GB file to their service without Duplicati involved. My initial backup to B2 (around 1TB) only took a few days at most, and that was with it not even running 100% of the time, and I only have a 25Mbit connection. So I don’t think Duplicati is necessarily your bottleneck.