I’m another CrashPlan refugee and I’m just getting serious about building out a new solution
I have a large amount of Data (over 4TB) that I will be backing up, however much of it is very static (Mostly archived video files and such) I keep it all on a dual-parity ZFS array on a headless Ubuntu box (I control it entirely from CLI)
I keep local backups of all my home systems on the Ubuntu box but I really want something cost-effective for off-site “disaster level” scenarios. After researching cloud solutions for the amount of data I have and supporting Linux systems, I decided instead of conventional cloud, to set up a small system at a family members house ~10 miles away. This leads to several important considerations.
I plan to use ssh across the WAN. This covers a secure connection for data in transit and makes firewalling/NAT easy. (correct me if there’s an easier way to accomplish all the below with my own equipment)
#1 I need to be considerate of bandwidth. This not only affects my own 2TB monthly limit (which I’m already using 1.5TB of) but the bandwidth of my family member.
Keeping in mind 90% of my data cannot be compressed and is static, what are the optimal settings to limit bandwidth in both directions. I consider this doubly since by my understanding ublock limit can affect this through scanning of existing files (read from target backup destination). I don’t want to be reading every file on every backup, that would destroy our bandwidth limit and likely put us over our monthly quota.
#1(a) I will have a dedicated Linux server accepting the ssh connections but it won’t be beefy (just dropping in an old dual core system with a couple of big drives). What would the recommended destination file sizes be to limit bandwidth without adversely impacting the remote system.
#2 I would like to avoid having to set NAT on the remote end if possible since I won’t have regular access or control of their (cheap consumer grade) home network equipment. To that end is there any built-in way to initiate the connection from the remote system that avoids NAT? (I have considered implementing an IPSec tunnel, just looking for other options as well)
#3 should it be possible to populate the first backup within my local network and then move the system remote? Or does duplicati save information on the backups based on host name?