Tmp Dir fills up will compact

I have a backup on an external drive with about 74GB in 446 files.

Blocksize is 500 MB.

162 dindex.zip.aes with 57MB
159 dblock.zip.aes with 73,7 GB
124 dlist.zip.aes with 431 MB
1 file with the checksum

Now I purged a directory inside the backup and as second step I wanted to compact the backup.

On my machine where Duplicati is running I have about 30 GB of free space.

Before starting the compact I cleaned the %TEMP% folder but the 30 GB of space are not enough! Duplicati fills this space with files and shows an error.

28.03.2020 18:58 524.288.852 dup-d8944ba8-69a1-46c1-9b00-4345ae648601
28.03.2020 19:16 204.905 dup-dbe5b18e-e5a7-44cf-8746-3215177e58af
28.03.2020 19:20 203.612 dup-e301b956-9258-4575-a31c-5f59cbca9100
28.03.2020 18:52 189.095 dup-e5df6e12-f6b8-4d17-8d8a-3ce8414c7bc7
28.03.2020 18:33 524.327.206 dup-e7f18ee5-428a-4d2e-a751-c90295498183
28.03.2020 18:53 524.295.886 dup-e8308154-b72f-4d8f-a0ac-d03c8abc3d04
28.03.2020 19:03 267.108 dup-e8abf54f-abb7-4526-ad9a-e273d0795313
28.03.2020 19:49 524.301.733 dup-e9acb566-2044-4362-a859-62e504fc0f57
28.03.2020 19:53 524.350.881 dup-ea960a6c-5720-4d3d-a169-432cc67d9b3d
28.03.2020 19:08 218.509 dup-eb0d155f-96d4-4038-ade0-dba5e1800a3c
28.03.2020 18:38 227.177 dup-ecc542c4-9605-4b09-97cd-a2a6a7f1a470
28.03.2020 19:53 181.076 dup-ed7e0897-cb9b-4e43-9adb-7fb0d4bcb40e
28.03.2020 19:50 715.791 dup-ee9d17c2-8097-4f81-9c0b-79280108ec47
28.03.2020 18:44 181.406 dup-eee9b524-0a9f-4770-9886-85f22c88958b
28.03.2020 19:56 524.358.687 dup-f4f282a7-258d-4059-8ec2-24a44d0dbf6e
28.03.2020 18:42 524.366.988 dup-f5ff367d-2571-4110-9fca-241bad45bbe6
28.03.2020 19:32 524.378.864 dup-f68db0fd-ab60-4c64-8b22-4dd572dd9fd2
28.03.2020 19:34 246.142 dup-f7eff7bf-ebf2-4e29-85e5-3a080273468f
28.03.2020 19:51 524.330.921 dup-fa62af88-1e2b-479a-8e6d-0062b239b0f7
28.03.2020 19:18 203.981 dup-fa735a42-3014-4319-8b8e-bba1073e3a76
28.03.2020 19:17 524.370.573 dup-fdb752d4-d83f-4a8a-bd56-242bcf68ac28
28.03.2020 19:36 524.331.063 dup-fe28a806-e67a-4583-bb61-9f70283f6ac0
28.03.2020 19:55 183.244 dup-fe50ec4a-8874-4446-b14f-bb6dfdabc7d7
28.03.2020 18:40 524.314.058 dup-febb9298-7767-40ee-a4df-109877ca8da3
28.03.2020 20:25 916 dupl-usagereport-3164-20200328192410.json

Deleting file duplicati-b47d7f228f4374d7b80887e8d0818dd62.dblock.zip.aes (499,94 MB) …
Deleting file duplicati-ibaee6034bc9d451a89c5fa0b1838d6aa.dindex.zip.aes (701,93 KB) …
Downloading file (499,91 MB) …

System.IO.IOException: There is not enough space on the disk.

at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
at System.IO.FileStream.WriteCore(Byte buffer, Int32 offset, Int32 count)
at System.Security.Cryptography.CryptoStream.Write(Byte buffer, Int32 offset, Int32 count)
at System.Security.Cryptography.CryptoStream.Write(Byte buffer, Int32 offset, Int32 count)
at SharpAESCrypt.SharpAESCrypt.Write(Byte buffer, Int32 offset, Int32 count)
at Duplicati.Library.Utility.Utility.CopyStream(Stream source, Stream target, Boolean tryRewindSource, Byte buf)
at Duplicati.Library.Encryption.EncryptionBase.Encrypt(Stream input, Stream output)
at Duplicati.Library.Encryption.EncryptionBase.Encrypt(String inputfile, String outputfile)
at Duplicati.Library.Main.BackendManager.FileEntryItem.Encrypt(IEncryption encryption, IBackendWriter stat)
at Duplicati.Library.Main.BackendManager.Put(VolumeWriterBase item, IndexVolumeWriter indexfile, Boolean synchronous)
at Duplicati.Library.Main.Operation.CompactHandler.DoCompact(LocalDeleteDatabase db, Boolean hasVerifiedBackend, IDbTransaction& transaction,
at Duplicati.Library.Main.Operation.CompactHandler.Run()
at Duplicati.Library.Main.Controller.RunAction[T](T result, String& paths, IFilter& filter, Action1 method) at Duplicati.Library.Main.Controller.Compact() at Duplicati.CommandLine.Commands.Compact(TextWriter outwriter, Action1 setup, List1 args, Dictionary2 options, IFilter filter)
at Duplicati.CommandLine.Program.ParseCommandLine(TextWriter outwriter, Action1 setup, Boolean& verboseErrors, String[] args) at Duplicati.CommandLine.Program.RunCommandLine(TextWriter outwriter, TextWriter errwriter, Action1 setup, String args)

My command line has this arguments:

"C:\Program Files\Duplicati 2\Duplicati.CommandLine.exe" 
compact 
"file://\\..." 
--backup-name="..." 
--dbpath="......sqlite" 
--encryption-module="aes" 
--compression-module="zip" 
--dblock-size="500MB" 
--passphrase="xxxxxxxx" 
--disable-module="console-password-input"  
--small-file-max-count=0 
--small-file-size=0b 
--threshold=0 
--send-mail-any-operation=false 

Why are 30GB not enough to compact a backup with just 500 MB blocksize? In My optinion a little bit more than 1,5 GB should be enough!

Is it necessary to provide the complete size of a backup for a compact run?

I started a new run (after repair) and I still do not understand why there are files that are not deleted? We see in the left part that files are downloaded, uploaded aso. But there are still “old” files on the right side. 22:05 => 12 minutes old? Why?

I got it successfull to an end by running this command in a separat cmd box:

sfk.exe delete -before 45m %temp% -yes +sleep 60000 +loop

SwissFileKnife
delete => delete command
-before 45m => only files older than 45 minutes
%temp% => where to delete
-yes => do not ask for confirmation, just delete
+sleep 60000 => sleep 60 seconds
+loop => repeat the whole command endless

So the files that are 45 minutes old are deleted while the compact is running. Not nice but it worked for me and compact came to a successfull end!

1 Like

What version of Duplicati are you using?

C:\Program Files\Duplicati 2>Duplicati.CommandLine.exe

See duplicati.commandline.exe help for more information.
General: example, changelog
Commands: backup, find, restore, delete, compact, test, compare, purge,
vacuum
Repair: repair, affected, list-broken-files, purge-broken-files
Debug: debug, logging, create-report, test-filters, system-info, send-mail
Targets: aftp, azure, b2, box, cloudfiles, dropbox, file, ftp, googledrive,
gcs, hubic, jottacloud, mega, msgroup, onedrivev2, sharepoint, openstack,
rclone, s3, od4b, mssp, sia, ssh, tahoe, webdav
Modules: aes, gpg, zip, 7z, console-password-input, mssql-options,
hyperv-options, http-options, sendhttp, sendmail, runscript, sendxmpp,
check-mono-ssl
Formats: date, time, size, encryption, compression
Advanced: mail, advanced, returncodes, filter, filter-groups,

http://www.duplicati.com/ Version: - 2.0.5.1_beta_2020-01-18