# Newbie question on a large backup

**URL:** https://forum.duplicati.com/t/newbie-question-on-a-large-backup/17759
**Category:** Support
**Created:** [April 10, 2024, 3:48am UTC](https://forum.duplicati.com/t/newbie-question-on-a-large-backup/17759 "2024-04-10T03:48:35Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![D4NNK](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/d/94ad74/32.png) [@D4NNK](https://forum.duplicati.com/u/D4NNK)
#### Post date: [April 10, 2024, 3:48am UTC](https://forum.duplicati.com/t/newbie-question-on-a-large-backup/17759/1 "2024-04-10T03:48:35Z")

</div>

Completely new to Duplicati, At the moment I have setup a backup to a networked drive on windows server 2022. The backup is 3.5TB large and obviously took a number of days to complete. It has now complete (status bar says (0 bytes) to go) but from the home screen looks to be stuck. I know it needs to run a deduplication on the backup and because I encrypted the backup it has stored everything locally and assume that it will then move the encrypted files to the network drive once complete. my question is, the backup has been stuck at 100% complete for a couple of days however in the live log and under “ËxplicitOnly” i can see multiple instances of

```plaintext
10 Apr 2024 11:43: Starting - ExecuteNonQuery: UPDATE "Block" SET "VolumeID" = 8 WHERE "Hash" = "9m61VcTDVT+p3v4Y4znT5qNcNBZOek4g7OGZ4HrSuCw=" AND "Size" = 102400 AND "VolumeID" = 11

```

It is also holding about 10gb of RAM (not an issue as the server has 64GB to use) so even though the backup looks stuck it is obviously doing something. I am just wondering if anyone can enlighten me on what it might be doing and how long i can expect to wait for it.

Small side note i also set the “Remote volume size” to be 5TB, i did this at the time as i misunderstood what it was doing but now realize this was probably a mistake, can i change this after/if the backup completes or am i stuck with this size now (its only going to a networked drive, not going to an offsite backup yet)

---

<div class="post-metadata">

### Author: ![ts678](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/t/8491ac/32.png) [@ts678](https://forum.duplicati.com/u/ts678)
#### Post date: [April 10, 2024, 1:41pm UTC](https://forum.duplicati.com/t/newbie-question-on-a-large-backup/17759/2 "2024-04-10T13:41:48Z")

</div>

Welcome to the forum @D4NNK

> [@D4NNK](#):
>
> status bar says (0 bytes) to go

Can you post status? Left numbers count up as files are found, then down as files are processed. Upload to destination starts sometime, and numbers on the right show its average speed. There is text status as well.

> [@D4NNK](#):
>
> Small side note i also set the “Remote volume size” to be 5TB

That’s actually a big deal, and it might be related to the slowdown.

> [@D4NNK](#):
>
> because I encrypted the backup it has stored everything locally and assume that it will then move the encrypted files to the network drive once complete.

It moves them as each remote volume (default 50 MB) fills, otherwise it could hog excessive local space, making a huge slow upload at the end. Maybe you’re in one now. What’s visible at the remote? Anything?

Sometimes Explorer is not very good at self-refresh. File size can be checked with right-click Properties.  
Duplicati About → System info will also show you where you are in the uploading, if that’s where you are.

> [@D4NNK](#):
>
> I know it needs to run a deduplication on the backup

Deduplication happens even earlier, more or less as files are read, and before even local storage of data.

> [@D4NNK](#):
>
> however in the live log and under “ËxplicitOnly” i can see multiple instances of

Presumably with a different Hash each time, but maybe the same VolumeID? If so, it’s probably updating database tables to show the final home of each block in some very large file that will go to the destination.

> [@D4NNK](#):
>
> can i change this after/if the backup completes or am i stuck with this size now (its only going to a networked drive, not going to an offsite backup yet)

You can reduce the enormous `Remote volume size` at any time, but it only applies to any future volumes. Restores will be painfully slow, as the backup-in-a-volume will likely have to be fetched for almost anything.

One thing that can only be set at start of new backup is `blocksize` which defaults to 100 KB and is OK for backups of about 100 GB before work gets slow due to too many blocks (rough estimate, result may vary).

Does backup have to be 3.5 TB, or is there an easy way to break it apart? Number of files also matters, as files add around 2 blocks each (minimum), and rough rule of thumb says to limit backup to 1 million blocks.

If you don’t want to do the math, you could increase [blocksize](https://docs.duplicati.com/en/latest/06-advanced-options/#blocksize) to 5 MB for that backup, and see how it does.

---

<div class="post-metadata">

### Author: ![D4NNK](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/d/94ad74/32.png) [@D4NNK](https://forum.duplicati.com/u/D4NNK)
#### Post date: [April 11, 2024, 7:37am UTC](https://forum.duplicati.com/t/newbie-question-on-a-large-backup/17759/3 "2024-04-11T07:37:03Z")

</div>

Hi ts678,

So i am sure it has finished the initial backup as the green bar is complete and the number of files 99088 hasnt changed in days and also shows “0 Bytes to go”

I assumue as i have set each remote volume to be 5TB thats why there is nothing on the network drive because it is still encrypting that 5TB block.

Yes as you mention there is a different hash everytime.

I am suspecting my best course of action is to stop the backup. Delete the dup-_random sting of charactes_ files from the temp folder in appdata on the C: as this is where the files seem to be kept locally and start a new backup but this time with more reasonably sized remote volume sizes. I also think i will break the job into two jobs backing up the most crucial folders first.

I’m assuming there aren’t any known issues with stopping a Duplicati job if you intend to scrap the backup files afterwards anyways?

Thanks for your reply and future help 🙂

---

<div class="post-metadata">

### Author: ![ts678](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/t/8491ac/32.png) [@ts678](https://forum.duplicati.com/u/ts678)
#### Post date: [April 11, 2024, 12:21pm UTC](https://forum.duplicati.com/t/newbie-question-on-a-large-backup/17759/4 "2024-04-11T12:21:19Z")

</div>

> [@D4NNK](#):
>
> I’m assuming there aren’t any known issues with stopping a Duplicati job if you intend to scrap the backup files afterwards anyways?

Fresh start (delete the database too) should do fine.

---

<div class="post-metadata">

### Author: ![D4NNK](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/d/94ad74/32.png) [@D4NNK](https://forum.duplicati.com/u/D4NNK)
#### Post date: [April 12, 2024, 1:40am UTC](https://forum.duplicati.com/t/newbie-question-on-a-large-backup/17759/5 "2024-04-12T01:40:18Z")

</div>

Thanks for your help.

Here we go again 🙂
