10TB of data to back up - where to?

I would recommend hubic.com
You get 10TB for I think 5eur - but it’s hosted in Europe.

Are you actually using their service? It seemed they were in financial trouble and closed out approx a year back in a sudden ‘servers stopped working and we abandoned the website’ way

I do, and they are still operating. They are owned by ovh which is pretty big, so I don’t think they will disappear.

I see - are you based out in France/nearby? I am free tier and encountered enough troubles that I gave up on them - from the below seems like not isolated but I guess YMMV.

https://cloudstorageinfo.org/hubic-cloud-storage-scam-legit-review

Poland - so still close enough I guess. I think only upside is cost - retrieval is slow but this is my last-case-resort backup and I am backing up from NAS so I don’t care if backup runs multiple days.
I done some basic restore tests but I didn’t do full recovery.
If you have more money to spare (or if your backup is critical) I would recommend something else.

And of course for me it was benefit that it’s NOT in us :slight_smile:

whats your OS? If you aren’t running a server, Backblaze is $6 a month now and their upload speeds are MUCH better than Crashplan.

Hubic is closed: The hubiC service is now closed to new subscriptions.

Thank you everyone for the detailed responses - some really interesting options there that I was unaware of. I reviewed my monthly backup report by CrashPlan today and the volume of data “selected for backup” has gone down hugely. It’s time for them to go in the bin sadly. In answer to one of the earlier questions, the backup is being performed from a Linux server. That’s not hard and fast - it could be another host type (e.g. Windows). I have some options to look at which is amazing - thank you!

Alternative idea:

  • Find a friend with a 24/7 Linux server
  • Buy another hard drive, hook it on your friends Linux server
  • Back up to that

My brother and I both have multi-TB backups, so we just back up to each other. Beyond the initial setup, it’s free monthly!

1 Like

Usage statistics for Duplicati Backend stats show SSH (SFTP) is the number two backend behind File, although I’m sure some of that is local not offsite. SFTP servers exist for Windows too, and many NAS systems also have it. Even though it’s easy to get, FTP over the Internet is not secure (clear-text login). FTPS (FTP secured with SSL/TLS) and WebDAV are also possibilities for building something yourself. Setting up self-hosted Minio on Windows 10 with automatically renewing SSL certificate is S3 protocol.

Backing up 10 TB might be pushing capacity limits (after some versions) for a single drive these days, however if you want something easier on the electric bill than a PC-based server, a single-bay NAS for about a hundred dollars plus drive might work. You won’t get drive redundancy, but maybe that’s OK…

you want something easier on the electric bill than a PC-based server, a single-bay NAS for about a hundred dollars plus drive might work

I use an UDOO x86. It’s got the size and power requirements of a raspberry pi, but it runs x86 code: UDOO X86 II - UDOO :slight_smile:

Pair that with a 10 TB hard drive for around $225, it’s worked great for me!

But you’re right, for someone just needing only an offsite backup solution, an NAS+hard drive combo that supports Duplicati is easier to maintain than a separate Linux server.

Main reason I love Duplicati: It naturally supports different OSs, different backends, and different setups, far better than anything else.

I was able to have a friend locate a QNAP TS-451 with 12TB in his office and make it available to me as a backup target.

That is my offsite solution for now.

The advantage of backing up to your friend: In the case when you need to restore the huge backup, you may be able to drive to your friend an pick up the drive/NAS/device there and physically move it to your site. This can improve restore speed significantly.

At the time I tried hubiC it was so slow for me (located in Germany) that I would not have been able to upload 10TB of data in a year. HubiC is also an example of incredibly cheap cloud space that did not survive.

2 Likes

Really grateful for all these replies everyone - some really great ideas! The most obvious solution to me would be to house a RPi or similar with a 10TB HDD attached at a friends office or house - however my current job is going away and the friend I trust most to host the data turns out to have purchases a metered Internet plan which isn’t going to work. I clearly need more friends! :rofl:

On a separate note, I notice that a 5 user (or more) plan on G Suite Business offers unlimited Google Drive storage for all users. I don’t particularly want to pay for a 5 user plan myself, but what’s to stop 5 people or so banding together and setting up a G Suite organisation - costs would be around US$12 per month per user as I understand it, plus a cheap domain name.

Am I missing a trick? That seems like a really obvious low cost solution, and Duplicati supports it. Any thoughts?

I seem to recall the 5 user limit not being enforced. As in you can just sign up by yourself and get the benefits.

Whether that “violation” of their policy puts your data at risk I can’t say.

How much trust is required? They need to keep your system up, but shouldn’t be able to read your data.

Fact Sheet

Duplicati uses strong AES-256 encryption to protect your backups. It is designed following the TNO principle: Trust No One. For instance, all data is encrypted locally before it is transferred to the remote storage system. The password/key to your backup never leaves your computer.

G Suite Acceptable Use Policy perhaps, if plan is considered a “resell”. Official resellers exist, but are to:

Ensure customers accept the Google TOS

Google Drive ebay accounts banned (an rclone forum topic) shows a crackdown on some big violations.

1 Like

Maybe it is cheaper to pay the better internet connection for your friend? For $12 more than what he currently pays, he should already get something that you can work with. May be a win-win :wink:

Also, you can do the first upload of the data with the RPi at your place over LAN and afterwards move the RPi it your friend. Then it is not that much data that goes over his wire.

Maybe we should start a network here where people set up storage backends for each other. Where are you located?
Trust should not be the problem, given the encryption. The only thing is that you may have to back up to multiple untrusted backends in order to have good chances that when you need the backup, one of them is there.

1 Like

@crazy4chrissi that’s a really great idea - I would be happy to work with someone else in a mutually beneficial arrangement. I’m just outside London in the UK.

I agree about encryption - my “trust issue” is more about my non-technical friends who would unplug the raspberry pi (or whatever the chosen solution is) to plug in a vacuum cleaner or something… :roll_eyes:

@ts678 - really good points - yes I did some reading last night and found out all about the ebay market for G Suite accounts, and how they were all getting disabled. So I can see how that would all go a bit “sideways”.

As I mentioned to @crazy4chrissi, I’m actually fine with the encryption - my trust issues are people who would turn the box off because the lights annoy them, or to plug in an appliance :roll_eyes: - I have some really lovely friends, but not many who are truly technical…

If online doesn’t work, maybe a carry-it-yourself rotation of 2 or 3 drives to friend or future job would do? This can hurt the “off-site” goal unless 2/3 off-site-at-a-time is enough or you buy lots of drives to rotate.

This would probably be best done by dividing your 10TB into smaller chunks, one per destination, which would be good anyway because a single 10TB backup with Duplicati might call for special care such as Choosing sizes in Duplicati so that performance (including that of recreate) doesn’t die from the scaling. There’s also a question of how much of the 10TB backup you want to lose at once if the backup breaks.

Some people also try to divide backup source based on use, to try to get online backup of changed files, while letting old files get a different backup. I don’t know if this fits your usage pattern, and it can be tricky.

Filter: older than x days would help with this plan, but such a filter isn’t built-in yet, so you use scripting… Possibly this would work poorly with VM images anyway (scattered changes). Can you backup in guest?

In the realm of emerging technologies that try to undercut traditional cloud storage from companies that purchase their own drives, there’s decentralized storage such as Sia, Storj, and others that rent storage from those who have extra, and resell it (in a more presentable more-available form) to those needing it. This might bring price down from $5-$6/TB/month for inexpensive traditional storage such as Backblaze B2 or Wasabi, to $2/TB/month, however cryptocurrency (and possible speculation) is typically involved. That $2 price is from their own web site, however I found other numbers on other sites that track pricing.

Sia Decentralized Cloud is the Duplicati setting, however forum reliability reports haven’t been that good, possibly due to the sometimes-there-sometimes-not nature of their backends in spite of the redundancy.

Very few companies want to lose money by providing storage below their costs. One that’s still willing is Backblaze with their own client. The catch is it’s aimed at flat-rate backup for users who favor simplicity. Large users (like you) who refer less technical friends (like yours) with less data average out acceptably. Client has some other catches that technical users might not like, such as not supporting server OSs…