# Use Duplicati with a cold cloud storage **URL:** \ **Category:** How-To\ **Created:** [January 5, 2018, 6:02pm UTC](https://forum.duplicati.com/t/use-duplicati-with-a-cold-cloud-storage/1988 "2018-01-05T18:02:30Z")\ **Posts on this page:** 15\ **Page:** 1
**Author:** ![Toto31](https://forum.duplicati.com/user_avatar/forum.duplicati.com/toto31/32/5566_2.png) [@Toto31](https://forum.duplicati.com/u/Toto31)\ **Post date:** [January 5, 2018, 6:02pm UTC](https://forum.duplicati.com/t/use-duplicati-with-a-cold-cloud-storage/1988/1 "2018-01-05T18:02:31Z")
Hello, I would like to use duplicati with a cold cloud storage (“OVH public cloud archive” in particular), i.e. files are stored frozen (not accessible) and a request must be done before accessing to the files. With a delay of several hours between the request and the access to the files. It is a very cheap solution. I have tried, and it seems Duplicati is not able to handle this kind of storage. Can you please confirm? The only solution I have is to send the unfreeze request manually before the backup, but it means I can’t use automatic planned backup. Thank you for your help ---
**Author:** ![samw](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/s/9de053/32.png) [@samw](https://forum.duplicati.com/u/samw)\ **Post date:** [January 6, 2018, 1:05am UTC](https://forum.duplicati.com/t/use-duplicati-with-a-cold-cloud-storage/1988/2 "2018-01-06T01:05:37Z")
According to their website, OVH supports uploading data via SFTP and HTTP so technically Duplicati should support it. Also you could get away with cold storage if you disabled the automatic verification after each job. I’m not sure how restores would work, but it would seem you would need “wake up” all your files to perform a restore. I personally wouldn’t recommend this for backups, but it seems pretty suited to file system archiving. ---
**Author:** ![JonMikelV](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/439d5e/32.png) [@JonMikelV](https://forum.duplicati.com/u/JonMikelV)\ **Post date:** [January 6, 2018, 3:58am UTC](https://forum.duplicati.com/t/use-duplicati-with-a-cold-cloud-storage/1988/3 "2018-01-06T03:58:48Z")
> [@Toto31](#): > > I would like to use duplicati with a cold cloud storage @samw is right about the cumbersome restore process cloud storage would entail. There’s some more info about it here: > [@Azure Blob - Using Archive Access Tier](https://forum.duplicati.com/t/azure-blob-using-archive-access-tier/674/6): > > There is currently no support for demoting the files to cold storage, but I don’t think it would require a big changed in terms of backup. Yes, you can add --no-backend-verification --no-auto-compact to have a setup that does not require that you can read remote files. I am not familiar enough with the feature to know if it still returns the cold-storage items in the file listing. If it does list the files, a better setup is --remote-samples=0 --no-auto-compact which will still do verificatio… ---
**Author:** ![Toto31](https://forum.duplicati.com/user_avatar/forum.duplicati.com/toto31/32/5566_2.png) [@Toto31](https://forum.duplicati.com/u/Toto31)\ **Post date:** [January 6, 2018, 9:31am UTC](https://forum.duplicati.com/t/use-duplicati-with-a-cold-cloud-storage/1988/4 "2018-01-06T09:31:03Z")
Thank you Having to “wake up” the files before doing a restore is not a problem according to me. I will do a restore only once so I can afford this manual task. I think to make the next incremental backup, Duplicati needs to access to the previous files to know what has already been backuped. This is the biggest problem according to me. I will try this [https://sites.google.com/a/duplicati.com/duplicati/news/howtouseglaciertostorebackups](https://sites.google.com/a/duplicati.com/duplicati/news/howtouseglaciertostorebackups) with amazon glacier. What do you think about it? ---
**Author:** ![samw](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/s/9de053/32.png) [@samw](https://forum.duplicati.com/u/samw)\ **Post date:** [January 6, 2018, 9:48am UTC](https://forum.duplicati.com/t/use-duplicati-with-a-cold-cloud-storage/1988/5 "2018-01-06T09:48:27Z")
If the files are stored on tape in the back end they can take up to a few days to recall. Most cold storage solutions use a combination of MAID and LTO Tape, it’s the reason they are so cheap compared to anything else. If that’s not a problem for you and you have a _very_ reliable transmission medium then it will work just fine. > [@Toto31](#): > > I think to make the next incremental backup, Duplicati needs to access to the previous files to know what has already been backuped. This is the biggest problem according to me. It doesn’t. The data that has been backed up is kept locally in a SQLite database so it knows what files have been backed up. You can use any backend that is supported by Duplicati. Personally for my remote backups I use an offsite FreeNAS box running FTP over SSH. For the money that you spend on cloud storage you can just set this up. ---
**Author:** ![Toto31](https://forum.duplicati.com/user_avatar/forum.duplicati.com/toto31/32/5566_2.png) [@Toto31](https://forum.duplicati.com/u/Toto31)\ **Post date:** [January 6, 2018, 2:42pm UTC](https://forum.duplicati.com/t/use-duplicati-with-a-cold-cloud-storage/1988/6 "2018-01-06T14:42:43Z")
> [@samw](#): > > It doesn’t. The data that has been backed up is kept locally in a SQLite database so it knows what files have been backed up. Ok great ! So it works. - I have just put the following options: --no-auto-compact and --backup-test-samples=0 - The restore process is simple. I follow the normal process, it does not work the first time obviously but as soon as Dupticati tries to access the file, OVH starts “waking up” the file. The second trial several hours after should work. I will test it. Thanks Antoine ---
**Author:** ![samw](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/s/9de053/32.png) [@samw](https://forum.duplicati.com/u/samw)\ **Post date:** [January 7, 2018, 2:33am UTC](https://forum.duplicati.com/t/use-duplicati-with-a-cold-cloud-storage/1988/7 "2018-01-07T02:33:15Z")
> [@Toto31](#): > > The restore process is simple. I follow the normal process, it does not work the first time obviously but as soon as Dupticati tries to access the file, OVH starts “waking up” the file. The second trial several hours after should work. I will test it. That depends on how the back end storage is configured. Most likely you will need to leave the restore process to run for a few hours and hope that Duplicati doesn’t timeout or anything like that. Either way test the restore process thoroughly to make sure everything is working as it should. ---
**Author:** ![Toto31](https://forum.duplicati.com/user_avatar/forum.duplicati.com/toto31/32/5566_2.png) [@Toto31](https://forum.duplicati.com/u/Toto31)\ **Post date:** [January 7, 2018, 8:10pm UTC](https://forum.duplicati.com/t/use-duplicati-with-a-cold-cloud-storage/1988/8 "2018-01-07T20:10:06Z")
I have just met an other problem: When Duplicati uploades big files, it split the file in several files, upload them and reassemble them on the backend. In case of a cold cloud, the assembly cannot be done. Therefore after the download is finished, I still have a folder “nameofthefolder\_segments” containing files xxxxx/000001, xxxxx/0000002 and so on. Is there a solution? Thank you ---
**Author:** ![JonMikelV](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/439d5e/32.png) [@JonMikelV](https://forum.duplicati.com/u/JonMikelV)\ **Post date:** [January 8, 2018, 3:35am UTC](https://forum.duplicati.com/t/use-duplicati-with-a-cold-cloud-storage/1988/9 "2018-01-08T03:35:33Z")
> [@Toto31](#): > > When Duplicati uploades big files, it split the file in several files, upload them and reassemble them on the backend. I’m not sure what’s doing that, but it isn’t Duplicati as it only uploads single files at a time as a single chunk (it doesn’t split things up). Additionally, it’s files all start with `duplicati-` (unless you’re using the `--prefix` parameter) and should end with your chosen compression type and/or encryption (so .zip, .7z, .aes, etc.). ---
**Author:** ![Toto31](https://forum.duplicati.com/user_avatar/forum.duplicati.com/toto31/32/5566_2.png) [@Toto31](https://forum.duplicati.com/u/Toto31)\ **Post date:** [January 9, 2018, 6:35pm UTC](https://forum.duplicati.com/t/use-duplicati-with-a-cold-cloud-storage/1988/10 "2018-01-09T18:35:04Z")
Ok good to know that it is not done by Duplicati. Maybe it is done by the back-end itself. I saw that the size of the xxxxxxxxxxx/0000001 files was 256Mo. I will try to limit the size of the dblock files to 200Mo. Maybe it will solve the issue. ---
**Author:** ![JonMikelV](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/439d5e/32.png) [@JonMikelV](https://forum.duplicati.com/u/JonMikelV)\ **Post date:** [January 10, 2018, 4:00am UTC](https://forum.duplicati.com/t/use-duplicati-with-a-cold-cloud-storage/1988/11 "2018-01-10T04:00:18Z")
> [@Toto31](#): > > I will try to limit the size of the dblock files to 200Mo. Maybe it will solve the issue. Sound like a good test, let us know how it goes. ---
**Author:** ![Toto31](https://forum.duplicati.com/user_avatar/forum.duplicati.com/toto31/32/5566_2.png) [@Toto31](https://forum.duplicati.com/u/Toto31)\ **Post date:** [January 15, 2018, 7:29pm UTC](https://forum.duplicati.com/t/use-duplicati-with-a-cold-cloud-storage/1988/12 "2018-01-15T19:29:50Z")
Hi, I have tested: putting the size to 200Mo removes the issue with the xxxxx/00001 files that I described above. But now I have an other issue with an upload of 37Go (i.e. upload in several times). Sometimes I get the error message "Found 1 remote files that are not recorded in local storage, please run repair" The remote file that causes the issue (dblock) is much less than 200Mo so probably the transfer has been stopped in a wrong way? I am supprized that any transfer stop is not correctly supported by Duplicati. I don’t know any “repair” button therefore I delete the file manually and then it works. Do you think this issue is linked to the fact it is a cold storage ? How to solve it? Thanks ---
**Author:** ![JonMikelV](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/439d5e/32.png) [@JonMikelV](https://forum.duplicati.com/u/JonMikelV)\ **Post date:** [January 15, 2018, 8:53pm UTC](https://forum.duplicati.com/t/use-duplicati-with-a-cold-cloud-storage/1988/13 "2018-01-15T20:53:59Z")
> [@Toto31](#): > > I have tested: putting the size to 200Mo removes the issue with the xxxxx/00001 files that I described above. Good to hear! And that makes sense if the provider’s upload tool was automatically splitting files larger than a certain size into chunks for the upload. It’s possible to have dblock files smaller than your volume size (in this case 200MB) such as at the end of a backup when there’s not a full volume’s worth of data left to upload or after a compacting operation when multiple “small” files are re-compressed into a single larger one. However, those files should still be recorded in the local Duplicati databse so if an unexpected remote dblock file is found the most likely reasons include: - upload failed but destination didn’t delete the partial file - upload succeeded but Duplicati didn’t record it in the local database for some reason - multiple backups are pointing to the same destination folder I don’t know how they handle cold storage so I suppose it’s also possible a file that Duplicati used to use and deleted (likely due to version control or compacting) never got removed out of cold storage and has somehow been moved to live again… One way to try and narrow this down might be to use the `--log-file` and `--log-level` parameters to store a detailed log file of the backup. If the error happens again, look at the previous log file for the name of the “unexpected” dblock. If it’s there then there should also be record of it being saved into the local database. ---
**Author:** ![Toto31](https://forum.duplicati.com/user_avatar/forum.duplicati.com/toto31/32/5566_2.png) [@Toto31](https://forum.duplicati.com/u/Toto31)\ **Post date:** [January 15, 2018, 10:10pm UTC](https://forum.duplicati.com/t/use-duplicati-with-a-cold-cloud-storage/1988/14 "2018-01-15T22:10:55Z")
Thanks JonMikeIV In my case the backup is running for the first time and has not been finished yet. So the small file can’t be explained by a end of back-up. Also I have disabled the campacting because of the cold storage. I have only one back up on this destination. Also because it is the first run, version control can’t explain the issue. As a summary the two possibilities from what you say are: > [@JonMikelV](#): > > - upload failed but destination didn’t delete the partial file > - upload succeeded but Duplicati didn’t record it in the local database for some reason Thank you for the idea to use the log. I will do it. ---
**Author:** ![JonMikelV](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/439d5e/32.png) [@JonMikelV](https://forum.duplicati.com/u/JonMikelV)\ **Post date:** [January 16, 2018, 11:21pm UTC](https://forum.duplicati.com/t/use-duplicati-with-a-cold-cloud-storage/1988/16 "2018-01-16T23:21:22Z")
> [@Toto31](#): > > In my case the backup is running for the first time and has not been finished yet. Indeed there go half my ideas. 🙂 (Sorry if I forgot you mentioned that & disabling compacting earlier.) Please let us know what comes out with your log. While I described what I believe Duplicati is SUPPOSED to do, that doesn’t mean that’s what it’s ACTUALLY doing (in other words, you very well might have found a bug). 😃