Backup stuck (?) at "Waiting for upload"

Support
1

Hi,
I am on Ubuntu 16.04 with the latest canary (2.0.3.6_canary_2018-04-23). I use Duplicati to do backups on a Wasabi account.
My job starts, and judging from the log in About/Show log/Live/Profiling, it sends the blocks, and performs verification, and ends without errors.
“4 mag 2018 15:57: Running Backup took 0:00:18:07.701”
I verified that the blocks that are mentioned in the log are also present on Wasabi.

However, the GUI is stuck at "Waiting for upload … ". If I restart the service, the GUI tells me that the last successful run has been done yesterday, however I can find today’s backup in the Restore menu.

I also find some big dup-… files in the Duplicati temporary directory, that have not been deleted. Yesterday I also found a few GB of such temporary files, so it seems that I constantly had such problem of “unfinished” backups, without realizing it.

Could you help me please to solve this issue? Yesterday I also tried to use the beta version instead of the latest canary, by removing the canary update folder, however I had more or less the same problems.

Thank you!

2

Hi @gianlucabertaina, welcome to the forum!

Since the backup is appearing in the Restore list my guess is something is happening on steps that happen after the backup, like retention role version cleanup.

  • Are you using a retention policy other than “Keep all”?
  • Do any errors / warnings appear on the job “show log” page? (Most likely a few lines in the “Result” log entry.)
3

Hi, thanks for the reply.
My retention policy is 7D:0s,4W:1D,6M:1W,10Y:1M .
Below I attach the last item il the job log. The only warning seems to be “The supplied option --default-filters is not supported and will be ignored”. Could this be related to the fact that I switched from canary to beta to canary again, since I had so many unfinished backups?
Thanks, Gianluca

`DeletedFiles: 11 DeletedFolders: 1 ModifiedFiles: 131 ExaminedFiles: 791206 OpenedFiles: 144 AddedFiles: 13 SizeOfModifiedFiles: 0 SizeOfAddedFiles: 0 SizeOfExaminedFiles: 161820199863 SizeOfOpenedFiles: 1441853551 NotProcessedFiles: 0 AddedFolders: 1 TooLargeFiles: 0 FilesWithError: 0 ModifiedFolders: 0 ModifiedSymlinks: 0 AddedSymlinks: 0 DeletedSymlinks: 1 PartialBackup: False Dryrun: False MainOperation: Backup CompactResults: null DeleteResults: DeletedSets: [] Dryrun: False MainOperation: Delete CompactResults: null ParsedResult: Warning EndTime: 04/05/2018 22:26:27 (1525465587) BeginTime: 04/05/2018 22:26:09 (1525465569) Duration: 00:00:17.3715120 Messages: [ 2018-05-04 21:44:21 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started, 2018-05-04 21:47:18 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: (), 2018-05-04 21:47:32 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (4,21 KB), 2018-05-04 21:58:25 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b10c59d490bd248d098472a7cee7f7442.dblock.zip.aes (5,04 MB), 2018-05-04 22:01:18 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b10c59d490bd248d098472a7cee7f7442.dblock.zip.aes (5,04 MB), ... ] Warnings: [ 2018-05-04 21:44:21 +02 - [Warning-Duplicati.Library.Main.Controller-UnsupportedOption]: The supplied option --default-filters is not supported and will be ignored ] Errors: [] TaskReader: null BackendStatistics: RemoteCalls: 8 BytesUploaded: 53048215 BytesDownloaded: 53965815 FilesUploaded: 3 FilesDownloaded: 3 FilesDeleted: 0 FoldersCreated: 0 RetryAttempts: 0 UnknownFileSize: 0 UnknownFileCount: 0 KnownFileCount: 4319 KnownFileSize: 111701392531 LastBackupDate: 04/05/2018 21:44:21 (1525463061) BackupListCount: 17 TotalQuotaSpace: 0 FreeQuotaSpace: 0 AssignedQuotaSpace: -1 ReportedQuotaError: False ReportedQuotaWarning: False ParsedResult: Warning Messages: [ 2018-05-04 21:44:21 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started, 2018-05-04 21:47:18 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: (), 2018-05-04 21:47:32 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (4,21 KB), 2018-05-04 21:58:25 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b10c59d490bd248d098472a7cee7f7442.dblock.zip.aes (5,04 MB), 2018-05-04 22:01:18 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b10c59d490bd248d098472a7cee7f7442.dblock.zip.aes (5,04 MB), ... ] Warnings: [ 2018-05-04 21:44:21 +02 - [Warning-Duplicati.Library.Main.Controller-UnsupportedOption]: The supplied option --default-filters is not supported and will be ignored ] Errors: [] TaskReader: null RepairResults: null TestResults: MainOperation: Test Verifications: [ Key: duplicati-20180504T194421Z.dlist.zip.aes Value: [], Key: duplicati-ib97263ca45184849804783bc8d08683d.dindex.zip.aes Value: [], Key: duplicati-b19c60a6454da45269c955f1a95f837f6.dblock.zip.aes Value: [] ] ParsedResult: Warning EndTime: 04/05/2018 22:28:45 (1525465725) BeginTime: 04/05/2018 22:26:37 (1525465597) Duration: 00:02:07.0615670 Messages: [ 2018-05-04 21:44:21 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started, 2018-05-04 21:47:18 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: (), 2018-05-04 21:47:32 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (4,21 KB), 2018-05-04 21:58:25 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b10c59d490bd248d098472a7cee7f7442.dblock.zip.aes (5,04 MB), 2018-05-04 22:01:18 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b10c59d490bd248d098472a7cee7f7442.dblock.zip.aes (5,04 MB), ... ] Warnings: [ 2018-05-04 21:44:21 +02 - [Warning-Duplicati.Library.Main.Controller-UnsupportedOption]: The supplied option --default-filters is not supported and will be ignored ] Errors: [] TaskReader: null ParsedResult: Warning EndTime: 04/05/2018 22:28:45 (1525465725) BeginTime: 04/05/2018 21:44:21 (1525463061) Duration: 00:44:23.9236890 Messages: [ 2018-05-04 21:44:21 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started, 2018-05-04 21:47:18 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: (), 2018-05-04 21:47:32 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (4,21 KB), 2018-05-04 21:58:25 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b10c59d490bd248d098472a7cee7f7442.dblock.zip.aes (5,04 MB), 2018-05-04 22:01:18 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b10c59d490bd248d098472a7cee7f7442.dblock.zip.aes (5,04 MB), ... ] Warnings: [ 2018-05-04 21:44:21 +02 - [Warning-Duplicati.Library.Main.Controller-UnsupportedOption]: The supplied option --default-filters is not supported and will be ignored ] Errors: [] TaskReader: ProgressAsync: Result: True Factory: CancellationToken: IsCancellationRequested: False CanBeCanceled: False WaitHandle: Handle: 27307856 SafeWaitHandle: IsInvalid: False IsClosed: False Scheduler: null CreationOptions: None ContinuationOptions: None Id: 3 Exception: null Status: RanToCompletion IsCanceled: False IsCompleted: True IsCompletedSuccessfully: True CreationOptions: None AsyncState: null IsFaulted: False TransferProgressAsync: Result: True Id: 4 Exception: null Status: RanToCompletion IsCanceled: False IsCompleted: True IsCompletedSuccessfully: True CreationOptions: None AsyncState: null IsFaulted: False `
4

I ended up purging Duplicati and reinstalling beta, and resetting also the job properties. However I still got the same problem, even with a single small file to backup.

Then I found that, even if I installed the Linux service, I also had a .config/Duplicati/ directory in my home folder. There were both files owned by me, and files owned by root. I think I mistakenly created that directory when trying to use the CLI instead of the GUI. It still confuses me how to correctly use the CLI.

Since I removed that directory, the jobs now complete correctly.

To sum up, if one wants to cleanly reinstall Duplicati (as root):

apt purge duplicati*
updatedb
locate duplicati
locate Duplicati

The above commands give a list of files and directories that are still in the system, in my case I still had to:

rm -r /usr/share/Duplicati 
rm -r /home/myuser/.config/Duplicati

Gianluca

5

That warning is expected when moving to the 2.0.3.5 canary (or later) as that is when the legacy --default-filters parameter was replaced with a Default excludes filter group, but it should not cause the problem you’re seeing.

Duplicati tends to work in the user environment in which it is run, so if you ran the CLI as yourself then it likely created the ~/.config/Duplicati/ at that time.

(Thanks for the tips on a clean Linux reinstall! I went ahead and edited your post by putting “~~~” around the CLI text to help it stand out better.)

6

Any luck? I hit same issue

7

At that time I solved by purging duplicati and reinstalling as described above (no need to recreate the backup). Notice there is now a more recent beta.

-------- Messaggio originale --------