Glacier, Azure or another "cold" cloud backup - recommendations?

I’m not sure if you saw the gripes I posted about Sia here around a month or so ago, but basically my complaints center around the fact that at a certain point, uploads (and then also downloads) just completely fail to work, at random. This messes up duplicati for one thing, but i also wasn’t really able to meaningfully upload or download stuff from the Sia client itself by that point. But if they ever get these and other kinks (like the enormous outlay someone needs to make to be a host for even a small bit of space) worked out, and the support becomes a bit more robust, i think it’ll be revolutionary.

Hi guys,
I have successfully backed up a folder and restored a file. So that seems to work. I looks like I should opt for B2 over Sia. :wink:
Questions:

  1. Does it look to you like Backblaze will offer B2 for a while … or should I rather stick with one of the big guns (Azure, Google…)? I read it that B2 is a good option (and I understand that nobody knows what the future holds).
  2. I will backup for several machines (daughters, mom…), is it good practice to do this to one B2 bucket each, or should I just dump everything in one bucket?
  3. And setting for the buckets I should set in B2 (i.e. I can set file lifecycles in Duplicati and in B2, and I’m assuming it’s not smart to do both)?
  4. I have a bunch of old files I keep on an external disk (MP3s, images, some movies and such; mostly it’s the lossless rips of my CDs, but my HDD is to small so I am using Apple Music in real life, which works just fine for me, until I remember this one song I loved in High School and they don’t have it). The files are not essential, but nice to have. It’s a hassle, though, to find and update the external drive every few months. Could I / should I make another bucket and just upload them directly to B2? That would be much more convenient for me, I think.

Thanks, Ulrich

Maybe OneDrive could be another option. With an Office 365 subscription you also get 1 TB for your OneDrive as an addition to all the Office apps. What’s even more interesting, if you use Office 365 Home instead of Personal sub, you actually can use this with up to 5 accounts, i.e. you get 5 x 1TB. The regular pricing is higher than B2, but I’ve never paid the regular price, I just buy an extension whenever I see a decent deal - which usually is less than 5€/month for Office 365 Home.

You can also use an extension key for 365 personal and extend your 365 home subscription but it’ll only add 9 months instead of 12 (but it’s usually easier to find a good deal for 365 personal as it’s often bundled with tablets etc.).

It seems like B2 will probably be around for a while. Since it’s not a “totally unlimited space for one price” service, this limits their potential future motivation to decide people are using up too much space for the price and discontinue the service (see: Amazon). But anything could change, which is why it’s a good idea to maybe a have fallback solution(s) in mind. With less than 1TB total backup needs like you and i both have, luckily there are a few different services where that much storage isn’t totally unreasonable, but for now I have a strong feeling about B2 - and there’s even the possibility that they might soften their prices in the future (maybe/maybe not, but as storage gets less expensive it’s plausible).

I personally have done a separate bucket for each machine, but it would probably also be acceptable to do all backups into one bucket but into different folders. Whatever you do, do NOT direct different backups into the same folder. Also keep in mind that once a B2 bucket or folder is named, it’s difficult and/or impossible to change the name.

I believe in B2 you should just set “keep all”. Duplicati deletes backup data sets that are no longer needed or redundant. I don’t believe B2 keeps deleted files so if i’m right then it shouldn’t be a worry (and if i’m wrong about that someone let me know please).

There’s no limits or penalties for having extra buckets, you just pay for your total storage size. Then again if it were me I’d just have Duplicati back them up to B2 (i currently do this with my hundreds of FLAC cd rips and DVD rip collection).

FWIW - after the CrashPlan-pocalypse, I put my wife (our only Windows machine) onto BackBlaze Personal. The initial backup of about 1.5TB is still running. It’s about 80% done. After seven weeks. I don’t think we’ll be renewing that next year.

I have since started putting most of our stuff into PCloud. It’s based in Europe and uploads are chugging along at a steady 51-53GB per day, suggesting that the limit is my 5Mbit outbound internet speed, not the provider’s throttle of inbound speed. 2TB storage and 2TB monthly download quota for $96/year

2 Likes

I’m using OneDrive. As mentioned earlier in the thread, I pay $99/year for 5 1TB logins. We are actively using 3 of them. $20/TB/year is a really good deal. Backup speed is limited by my internet connection speed of 6mbit/sec up…

Marc

I looked at that, but one of our machines needs more than 1TB. So I would be signing myself up for some really gnarly logistics.

1 Like

PCloud is located in Switzerland.
250€ Lifetime plan for 2TB sounds interesting as well (but also suspicious).
How do you upload your data to PCloud?
FTP, webdav? I did not find something on the page of PCloud how to upload data from a NAS:

I use the device driver on one of my Linux boxes, and rsync a copy of the backup daily to pCloud.

Sorry, but what means “device driver”? Could you point me to the right direction?

When you install pCloud it installs a virtual disk drive on your machine that mounts in your ~/ directory. That is your pCloud storage.

There’s also a real-time sync facility in the Linux pCloud utility program but it did not work well for me. So, daily rsync.

1 Like

Thanks. Does this work with headless Linux box as well?
I am using Openmediavault (Debian based) as NAS OS.

It’s accessible via CLI so should not be a problem.

Perfect. Thanks again.

Not sure what’s happening there. My initial 800gb backup to B2 took a few days at most - and I added portions at a time (music collection, then other stuff, etc). This was all through Duplicati of course. I haven’t used the Backblaze client so maybe there’s some sort of bottleneck there?

Hello again,
I have been uploading with Duplicati to B2 for a week now, and some questions came up:

  1. Is there any way to pause or throttle the application automatically during working hours while it’s still seeding the backup? (I understand Duplicati will run at, say 8 pm every day if I set it so, once the initial backup is done. But right now i pause it manually in the morning and forget to turn it on at night.) (Or would the "run at 8 pm option resume the pause seed as well, which would be a good enough option for me?)
  2. Can I seed a backup manually from one computer and then “take it over” on another? Case in point: 200 GB of images on one Mac. I could copy them on an external hard drive, take them to university, and upload quite fast. But how would I then “connect” the original files/machine with the backup?
  3. Can I ever unscramble the backup with any app other than Duplicati? And/or switch apps, if I wanted to? Not that I’m unhappy, I just want to understand what’s possible and what’s not. I used to use Crashplan, and about once a year I was very happy that I could access the backup elsewhere through there iPhone-App. Would anything like that be possible (with the right apps) with the backup encrypted and uploaded by Duplicati?

Thanks, Ulrich

Via the GUI your only option is to adjust the throttle options manually:
image

At least one user appears to have automated pausing of the backup here Backups only during a certain time frame?

Absolutely! There are already a few topics about it at Possible to relink an existing backup store (for pre-seeding purposes) and Initial backup to USB then WebDAV. If they can’t help you get it going let us know. :slight_smile:

Technically yes you could as Duplicati doesn’t specifically “hide” anything it’s doing, but the versioning and deduplication process involves chopping files up into smaller (usually 100k) chunks so if a third part tool wanted to access the backups it would need to:

  1. know the encryption pasphrase
  2. have access to the archive files
  3. understand how the individual file blocks are stored and reference (can be gleaned from the archive files but can also be directly looked up in the local .sqlite database)

But as far as I know there are no tools that do that at the moment. However, I’m sure you’d make some people quite happy if you started an Android or iOS app to be able to read Duplicati archives… :wink:

There is a Python script here that can restore your files without Duplicati (it is also stored on non-Duplicati accounts): duplicati/Tools/Commandline/RestoreFromPython at master · duplicati/duplicati · GitHub

3 Likes

As it’s not your tool I wouldn’t think actually documenting how to use it would make sense, but is it something that should be mentioned or referenced in the manual / documentation?

I think the tool should be mentioned in a manual.