String of Errors on backup with seemingly little explanation

Support
1

I am receiving a string of errors everytime I attempt to backup that, to me at least, is providing very little insight into what the issue is. The errors I am receiving are

  • 2025-02-05 13:11:24 -06 - [Error-Duplicati.Library.Main.Operation.BackupHandler-FatalError]: Fatal error AggregateException: One or more errors occurred. (Failure) (Failure)
  • 2025-02-05 13:11:24 -06 - [Error-Duplicati.Library.Main.Controller-FailedOperation]: The operation Backup has failed with error: One or more errors occurred. (One or more errors occurred. (Failure) (Failure) (One or more errors occurred. (Failure) (Failure)) (One or more errors occurred. (One or more errors occurred. (Failure) (Failure)))) AggregateException: One or more errors occurred. (One or more errors occurred. (Failure) (Failure) (One or more errors occurred. (Failure) (Failure)) (One or more errors occurred. (One or more errors occurred. (Failure) (Failure))))

I checked the logs, but I unable to determine what the issue is. The Logs are:

        {

“DeletedFiles”: 0,
“DeletedFolders”: 0,
“ModifiedFiles”: 0,
“ExaminedFiles”: 257,
“OpenedFiles”: 255,
“AddedFiles”: 255,
“SizeOfModifiedFiles”: 0,
“SizeOfAddedFiles”: 501876419,
“SizeOfExaminedFiles”: 713774536,
“SizeOfOpenedFiles”: 501876419,
“NotProcessedFiles”: 0,
“AddedFolders”: 21,
“TooLargeFiles”: 0,
“FilesWithError”: 0,
“ModifiedFolders”: 0,
“ModifiedSymlinks”: 0,
“AddedSymlinks”: 0,
“DeletedSymlinks”: 0,
“PartialBackup”: false,
“Dryrun”: false,
“MainOperation”: “Backup”,
“CompactResults”: null,
“VacuumResults”: null,
“DeleteResults”: null,
“RepairResults”: null,
“TestResults”: null,
“ParsedResult”: “Fatal”,
“Interrupted”: false,
“Version”: “2.1.0.3 (2.1.0.3_beta_2025-01-22)”,
“EndTime”: “2025-02-05T19:11:24.84541Z”,
“BeginTime”: “2025-02-05T19:10:26.4609479Z”,
“Duration”: “00:00:58.3844621”,
“MessagesActualLength”: 145,
“WarningsActualLength”: 1,
“ErrorsActualLength”: 2,
“Messages”: [
“2025-02-05 13:10:26 -06 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started”,
“2025-02-05 13:10:26 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (27 bytes)”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-RemoteUnwantedMissingFile]: removing file listed as Temporary: duplicati-20250205T082854Z.dlist.zip.aes”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-KeepIncompleteFile]: keeping protected incomplete remote file listed as Uploading: duplicati-20250205T190000Z.dlist.zip.aes”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-SchedulingMissingFileForDelete]: scheduling missing file for deletion, currently listed as Uploading: duplicati-b72367f852fda46d7a7c53a71110eb22d.dblock.zip.aes”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-SchedulingMissingFileForDelete]: scheduling missing file for deletion, currently listed as Uploading: duplicati-b3ed75c35ff0148a9bfb92ec8384adef9.dblock.zip.aes”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-SchedulingMissingFileForDelete]: scheduling missing file for deletion, currently listed as Uploading: duplicati-b45d5f686700f42f4a52c3d424da3c7d6.dblock.zip.aes”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-SchedulingMissingFileForDelete]: scheduling missing file for deletion, currently listed as Uploading: duplicati-bbbdc60ffccb34593b79a089c9b006456.dblock.zip.aes”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-SchedulingMissingFileForDelete]: scheduling missing file for deletion, currently listed as Uploading: duplicati-b88f99a4a729548fe91e6e500a50a7295.dblock.zip.aes”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-SchedulingMissingFileForDelete]: scheduling missing file for deletion, currently listed as Uploading: duplicati-b92c1c73869744429a10fe046296c3b74.dblock.zip.aes”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-SchedulingMissingFileForDelete]: scheduling missing file for deletion, currently listed as Uploading: duplicati-b764f5842a12c4d409de684f1a23b1edc.dblock.zip.aes”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-SchedulingMissingFileForDelete]: scheduling missing file for deletion, currently listed as Uploading: duplicati-b288f733010864efba9e405dea878dd6a.dblock.zip.aes”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-SchedulingMissingFileForDelete]: scheduling missing file for deletion, currently listed as Uploading: duplicati-bff79223603924419b15cd9356c69420a.dblock.zip.aes”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-SchedulingMissingFileForDelete]: scheduling missing file for deletion, currently listed as Uploading: duplicati-bbbbcbd2c90f142418ba251dc8b5349ad.dblock.zip.aes”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-SchedulingMissingFileForDelete]: scheduling missing file for deletion, currently listed as Uploading: duplicati-b9ce7bd89cf314ad98b92a19ad72907b3.dblock.zip.aes”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-SchedulingMissingFileForDelete]: scheduling missing file for deletion, currently listed as Uploading: duplicati-b049523a0f17e4fc5aad148da31c7604a.dblock.zip.aes”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-RemoteUnwantedMissingFile]: removing file listed as Deleting: duplicati-b65226f447aef4953b690aa2f7aa53147.dblock.zip.aes”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-RemoteUnwantedMissingFile]: removing file listed as Deleting: duplicati-b43283db0a07f43e6b50270efc230cffb.dblock.zip.aes”,
“2025-02-05 13:10:27 -06 - [Information-Duplicati.Library.Main.Operation.FilelistProcessor-RemoteUnwantedMissingFile]: removing file listed as Deleting: duplicati-be362098eb509422dac42d92cd201da45.dblock.zip.aes”
],
“Warnings”: [
“2025-02-05 13:10:27 -06 - [Warning-Duplicati.Library.Main.Operation.Backup.UploadSyntheticFilelist-MissingTemporaryFilelist]: Expected there to be a temporary fileset for synthetic filelist (1, duplicati-20250205T190000Z.dlist.zip.aes), but none was found?”
],
“Errors”: [
“2025-02-05 13:11:24 -06 - [Error-Duplicati.Library.Main.Operation.BackupHandler-FatalError]: Fatal error\nAggregateException: One or more errors occurred. (Failure) (Failure)”,
“2025-02-05 13:11:24 -06 - [Error-Duplicati.Library.Main.Controller-FailedOperation]: The operation Backup has failed with error: One or more errors occurred. (One or more errors occurred. (Failure) (Failure) (One or more errors occurred. (Failure) (Failure)) (One or more errors occurred. (One or more errors occurred. (Failure) (Failure))))\nAggregateException: One or more errors occurred. (One or more errors occurred. (Failure) (Failure) (One or more errors occurred. (Failure) (Failure)) (One or more errors occurred. (One or more errors occurred. (Failure) (Failure))))”
],
“BackendStatistics”: {
“RemoteCalls”: 25,
“BytesUploaded”: 0,
“BytesDownloaded”: 0,
“FilesUploaded”: 0,
“FilesDownloaded”: 0,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 20,
“UnknownFileSize”: 5509,
“UnknownFileCount”: 27,
“KnownFileCount”: 0,
“KnownFileSize”: 0,
“LastBackupDate”: “0001-01-01T00:00:00”,
“BackupListCount”: 1,
“TotalQuotaSpace”: 0,
“FreeQuotaSpace”: 0,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Interrupted”: false,
“Version”: “2.1.0.3 (2.1.0.3_beta_2025-01-22)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2025-02-05T19:10:26.4609515Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
}

2

To what Destination Storage Type (or describe further if willing). Maybe it’s not working properly.

suggests that too. These would be retries on storage work like upload, download, delete, and list.

Anything relevent in About → Show log → Stored? If so, click on the line to see if it has the detail.

There’s a lot more logging that can be turned on, but might as well try ones already available first.

3

destination is SFTP, test connection worked fine. When running the backup and monitoring the live log, this is the first error that appears with verbose logging

Feb 5, 2025 4:03 PM: Operation Put with file duplicati-bbaf83a012e9b4997aff1e270bff3e228.dblock.zip.aes attempt 1 of 6 failed with message: Failure
Renci.SshNet.Common.SshException: Failure
at Renci.SshNet.Sftp.SftpSession.RequestOpen(String path, Flags flags, Boolean nullOnError)
at Renci.SshNet.SftpClient.InternalUploadFile(Stream input, String path, Flags flags, SftpUploadAsyncResult asyncResult, Action1 uploadCallback) at Renci.SshNet.SftpClient.<>c__DisplayClass56_0.<BeginUploadFile>b__0() --- End of stack trace from previous location --- at System.Threading.Tasks.TaskFactory1.FromAsyncCoreLogic(IAsyncResult iar, Func2 endFunction, Action1 endAction, Task1 promise, Boolean requiresSynchronization) --- End of stack trace from previous location --- at Duplicati.Library.Main.Operation.Backup.BackendUploader.DoPut(FileEntryItem item, IBackend backend, CancellationToken cancelToken) at Duplicati.Library.Main.Operation.Backup.BackendUploader.<>c__DisplayClass20_0.<<UploadFileAsync>b__0>d.MoveNext() --- End of stack trace from previous location --- at Duplicati.Library.Main.Operation.Backup.BackendUploader.DoWithRetry(Func1 method, FileEntryItem item, Worker worker, CancellationToken cancelToken)

4

here is the last stored log

System.AggregateException: One or more errors occurred. (Failure (Failure) (One or more errors occurred. (Failure)))
—> System.AggregateException: Failure (Failure) (One or more errors occurred. (Failure))
—> Renci.SshNet.Common.SshException: Failure
at Renci.SshNet.Sftp.SftpSession.RequestOpen(String path, Flags flags, Boolean nullOnError)
at Renci.SshNet.SftpClient.InternalUploadFile(Stream input, String path, Flags flags, SftpUploadAsyncResult asyncResult, Action1 uploadCallback) at Renci.SshNet.SftpClient.<>c__DisplayClass56_0.<BeginUploadFile>b__0() --- End of stack trace from previous location --- at System.Threading.Tasks.TaskFactory1.FromAsyncCoreLogic(IAsyncResult iar, Func2 endFunction, Action1 endAction, Task1 promise, Boolean requiresSynchronization) --- End of stack trace from previous location --- at Duplicati.Library.Main.Operation.Backup.BackendUploader.DoPut(FileEntryItem item, IBackend backend, CancellationToken cancelToken) at Duplicati.Library.Main.Operation.Backup.BackendUploader.<>c__DisplayClass20_0.<<UploadFileAsync>b__0>d.MoveNext() --- End of stack trace from previous location --- at Duplicati.Library.Main.Operation.Backup.BackendUploader.DoWithRetry(Func1 method, FileEntryItem item, Worker worker, CancellationToken cancelToken)
at Duplicati.Library.Main.Operation.Backup.BackendUploader.DoWithRetry(Func1 method, FileEntryItem item, Worker worker, CancellationToken cancelToken) at Duplicati.Library.Main.Operation.Backup.BackendUploader.UploadFileAsync(FileEntryItem item, Worker worker, CancellationToken cancelToken) at Duplicati.Library.Main.Operation.Backup.BackendUploader.UploadBlockAndIndexAsync(VolumeUploadRequest upload, Worker worker, CancellationToken cancelToken) at Duplicati.Library.Main.Operation.Backup.BackendUploader.<Run>b__13_0(<>f__AnonymousType21 self)
at Duplicati.Library.Main.Operation.Backup.BackendUploader.b__13_0(<>f__AnonymousType21 self) at CoCoL.AutomationExtensions.RunTask[T](T channels, Func2 method, Boolean catchRetiredExceptions)
at Duplicati.Library.Main.Operation.BackupHandler.FlushBackend(BackupResults result, IWriteChannel1 uploadtarget, Task uploader) at Duplicati.Library.Main.Operation.BackupHandler.RunAsync(String[] sources, IFilter filter, CancellationToken token) --- End of inner exception stack trace --- at Duplicati.Library.Main.Operation.BackupHandler.RunAsync(String[] sources, IFilter filter, CancellationToken token) ---> (Inner Exception #1) System.AggregateException: One or more errors occurred. (Failure) ---> Renci.SshNet.Common.SshException: Failure at Renci.SshNet.Sftp.SftpSession.RequestOpen(String path, Flags flags, Boolean nullOnError) at Renci.SshNet.SftpClient.InternalUploadFile(Stream input, String path, Flags flags, SftpUploadAsyncResult asyncResult, Action1 uploadCallback)
at Renci.SshNet.SftpClient.<>c__DisplayClass56_0.b__0()
— End of stack trace from previous location —
at System.Threading.Tasks.TaskFactory1.FromAsyncCoreLogic(IAsyncResult iar, Func2 endFunction, Action1 endAction, Task1 promise, Boolean requiresSynchronization)
— End of stack trace from previous location —
at Duplicati.Library.Main.Operation.Backup.BackendUploader.DoPut(FileEntryItem item, IBackend backend, CancellationToken cancelToken)
at Duplicati.Library.Main.Operation.Backup.BackendUploader.<>c__DisplayClass20_0.<b__0>d.MoveNext()
— End of stack trace from previous location —
at Duplicati.Library.Main.Operation.Backup.BackendUploader.DoWithRetry(Func1 method, FileEntryItem item, Worker worker, CancellationToken cancelToken) at Duplicati.Library.Main.Operation.Backup.BackendUploader.DoWithRetry(Func1 method, FileEntryItem item, Worker worker, CancellationToken cancelToken)
at Duplicati.Library.Main.Operation.Backup.BackendUploader.UploadFileAsync(FileEntryItem item, Worker worker, CancellationToken cancelToken)
at Duplicati.Library.Main.Operation.Backup.BackendUploader.UploadBlockAndIndexAsync(VolumeUploadRequest upload, Worker worker, CancellationToken cancelToken)
at Duplicati.Library.Main.Operation.Backup.BackendUploader.b__13_0(<>f__AnonymousType21 self) at Duplicati.Library.Main.Operation.Backup.BackendUploader.<Run>b__13_0(<>f__AnonymousType21 self)
at CoCoL.AutomationExtensions.RunTask[T](T channels, Func2 method, Boolean catchRetiredExceptions) at Duplicati.Library.Main.Operation.BackupHandler.FlushBackend(BackupResults result, IWriteChannel1 uploadtarget, Task uploader)
at Duplicati.Library.Main.Operation.BackupHandler.RunAsync(String sources, IFilter filter, CancellationToken token)
— End of inner exception stack trace —<—

— End of inner exception stack trace —
at CoCoL.ChannelExtensions.WaitForTaskOrThrow(Task task)
at Duplicati.Library.Main.Operation.BackupHandler.Run(String sources, IFilter filter, CancellationToken token)
at Duplicati.Library.Main.Controller.<>c__DisplayClass17_0.b__0(BackupResults result)
at Duplicati.Library.Main.Controller.RunAction[T](T result, String& paths, IFilter& filter, Action`1 method)
at Duplicati.Library.Main.Controller.Backup(String inputsources, IFilter filter)
at Duplicati.Server.Runner.Run(IRunnerData data, Boolean fromQueue)

5

How much free space is there for the SFTP server to use? If you can’t assess, you could probably upload some 50 MB file (whose name doesn’t start with duplicati- to avoid confusion) to test it.

50 MB would be the default Remote volume size on Options screen. Are you using that?

Duplicati freezes during backup or fails with unknown error due to Remote (SSH) Disk Full #4675

Renci.SshNet.Common.SshException: Failure
at Renci.SshNet.Sftp.SftpSession.RequestOpen
at Renci.SshNet.SftpClient.InternalUploadFile

(simplified, but looks like the end of both of yours)

That’s probably just testing that a file listing doesn’t error. You might have an uploading problem.
Your list of cleanup attempts is also talking about a lot of files that tried uploads, but aren’t there.

Although any SFTP client should be able to test uploads, Duplicati has two testers you could try:

BackendTool is run manually. BackendTester does an automated test that uses an empty folder.

Export As Command-line can get a URL to start the test with your server.

6

So I managed to get it to run by changing the destination directory, but now at the very end of the backup I get this error in the logs and it says that it was not successful

System.Exception: Unexpected number of remote volumes marked as deleted. Found 0 filesets, but 1 volumes
at Duplicati.Library.Main.Database.LocalDeleteDatabase.DropFilesetsFromTable(DateTime toDelete, IDbTransaction transaction)+MoveNext()
at System.Collections.Generic.LargeArrayBuilder1.AddRange(IEnumerable1 items)
at System.Collections.Generic.EnumerableHelpers.ToArray[T](IEnumerable1 source) at System.Linq.Enumerable.ToArray[TSource](IEnumerable1 source)
at Duplicati.Library.Main.Operation.DeleteHandler.DoRun(LocalDeleteDatabase db, IDbTransaction& transaction, Boolean hasVerifiedBackend, Boolean forceCompact, BackendManager sharedManager)
at Duplicati.Library.Main.Operation.BackupHandler.CompactIfRequired(BackendManager backend, Int64 lastVolumeSize)
at Duplicati.Library.Main.Operation.BackupHandler.RunAsync(String sources, IFilter filter, CancellationToken token)
at CoCoL.ChannelExtensions.WaitForTaskOrThrow(Task task)
at Duplicati.Library.Main.Operation.BackupHandler.Run(String sources, IFilter filter, CancellationToken token)
at Duplicati.Library.Main.Controller.<>c__DisplayClass17_0.b__0(BackupResults result)
at Duplicati.Library.Main.Controller.RunAction[T](T result, String& paths, IFilter& filter, Action`1 method)
at Duplicati.Library.Main.Controller.Backup(String inputsources, IFilter filter)
at Duplicati.Server.Runner.Run(IRunnerData data, Boolean fromQueue)

7

Any idea how it helped? Did it seem likely that first destination filled?

Error message about remote volumes marked as deleted had workaround of version deletes.
That’s a little surprising to me, as the failure comes from a surprise in the version deletions…

Getting more information would be helpful, so that the problem can be understood then fixed.
Unfortunately it’s not guaranteed easy. Some methods are kind of technical. One such one is:

Look at Database screen to find its path. Make a copy or be riskier and open it read-only with
DB Browser for SQLite that you install. State in Remotevolume table might be of interest.

File states can also be found by adding upload-verification-file advanced option which uploads a duplicati-verification.json file which has the destination files and their states.
There’s not anything particularly secret about the information there. You can look, zip, post it.

Another way is to run Create bug report which (maybe slowly) makes a sanitized DB copy. Frequently a job DB is bigger than one can post, so you’d use cloud storage, and share a link.

Preferably there will be developer help interpreting. If you like, you can probably avoid issues temporarily by changing retention policy to keep all versions, and put the setting back later on.

Maybe the dev can give thoughts. Yours had more volumes than filesets. This went other way:

8

I think it was a permissions issue with the directory I was using, I just deleted the entire backup and database, started fresh with the new directory, and now dont seem to be having any issues

1 Like