Backup Job suddently failed, System.AggregateExecption thrown

PanPan · August 2, 2019, 1:26pm

Hello,

I have a very strange Problem with Duplicati 2.0.4.22_canary_2019-06-30. (Ubuntu 18.04 LTS Server VM)
A Backup Job with was working fine for Months is currently throwing expetions. Everything worked fine, and from one Day to another Day without System changes or Updates, there is now the following error:

I dont know what the cause is, maybe the path length is too long ?

error.zip (3.8 KB)

The Strange thing is, that another Job with another Backup Target is working without any Problems, and it has the same source Files.
I already deleted the Job which is failing and recreated it from scratch. It works for several Days and it now starts to throw expeptions again.

Best Regards from Germany.

Failed: One or more errors occurred.
Details: System.AggregateException: One or more errors occurred. —> System.AggregateException: Could not find file “/tmp/dup-c15067ac-3c11-4e20-b8cf-e432b4b25b8b”. —> System.IO.FileNotFoundException: Could not find file “/tmp/dup-c15067ac-3c11-4e20-b8cf-e432b4b25b8b”.
at System.IO.FileStream…ctor (System.String path, System.IO.FileMode mode, System.IO.FileAccess access, System.IO.FileShare share, System.Int32 bufferSize, System.Boolean anonymous, System.IO.FileOptions options) [0x0021a] in <8f2c484307284b51944a1a13a14c0266>:0
at System.IO.FileStream…ctor (System.String path, System.IO.FileMode mode, System.IO.FileAccess access, System.IO.FileShare share) [0x00000] in <8f2c484307284b51944a1a13a14c0266>:0
at (wrapper remoting-invoke-with-check) System.IO.FileStream:.ctor (string,System.IO.FileMode,System.IO.FileAccess,System.IO.FileShare)
at Duplicati.Library.Main.Volumes.VolumeReaderBase.LoadCompressor (System.String compressor, System.String file, Duplicati.Library.Main.Options options, System.IO.Stream& stream) [0x00000] in <63172ad53f6940c395d5db05d1717049>:0
at Duplicati.Library.Main.Volumes.VolumeReaderBase…ctor (System.String compressor, System.String file, Duplicati.Library.Main.Options options) [0x00007] in <63172ad53f6940c395d5db05d1717049>:0
at Duplicati.Library.Main.Volumes.BlockVolumeReader…ctor (System.String compressor, System.String file, Duplicati.Library.Main.Options options) [0x00010] in <63172ad53f6940c395d5db05d1717049>:0
at Duplicati.Library.Main.Operation.Backup.SpillCollectorProcess+<>c__DisplayClass0_0+<b__0>d.MoveNext () [0x0023c] in <63172ad53f6940c395d5db05d1717049>:0
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <8f2c484307284b51944a1a13a14c0266>:0
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <8f2c484307284b51944a1a13a14c0266>:0
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <8f2c484307284b51944a1a13a14c0266>:0
at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <8f2c484307284b51944a1a13a14c0266>:0
at System.Runtime.CompilerServices.TaskAwaiter.GetResult () [0x00000] in <8f2c484307284b51944a1a13a14c0266>:0
at CoCoL.AutomationExtensions+d__10`1[T].MoveNext () [0x0007a] in <6973ce2780de4b28aaa2c5ffc59993b1>:0
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <8f2c484307284b51944a1a13a14c0266>:0
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <8f2c484307284b51944a1a13a14c0266>:0
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <8f2c484307284b51944a1a13a14c0266>:0
at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <8f2c484307284b51944a1a13a14c0266>:0
at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () [0x00000] in <8f2c484307284b51944a1a13a14c0266>:0
at Duplicati.Library.Main.Operation.BackupHandler+d__12.MoveNext () [0x00349] in <63172ad53f6940c395d5db05d1717049>:0
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <8f2c484307284b51944a1a13a14c0266>:0
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <8f2c484307284b51944a1a13a14c0266>:0
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <8f2c484307284b51944a1a13a14c0266>:0
at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <8f2c484307284b51944a1a13a14c0266>:0
at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () [0x00000] in <8f2c484307284b51944a1a13a14c0266>:0
at Duplicati.Library.Main.Operation.BackupHandler+d__19.MoveNext () [0x00a3a] in <63172ad53f6940c395d5db05d1717049>:0
— End of inner exception stack trace —
at Duplicati.Library.Main.Operation.BackupHandler+d__19.MoveNext () [0x0103c] in <63172ad53f6940c395d5db05d1717049>:0
— End of inner exception stack trace —

ts678 · August 5, 2019, 1:24pm

Welcome to the forum @PanPan

Kind of strange… It looks like a tmp file with blocks in it was not produced. On Windows sometimes one wonders whether an antivirus ate it. On Linux the chances of an AV are lower, but I guess I’ll ask anyway.

Looking further back at error.log in error.zip (thanks for sending that), I wonder if things were thrown off at:

2019-08-02 15:17:44 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: /home/veronika/mwn_storage_cloud/PhDvonLRZ/Results/_PAXgene_TrafuS/PCR/GenEx/PAX_PCR_refGenes.mdf
System.IO.FileNotFoundException: Could not find file "/home/veronika/mwn_storage_cloud/PhDvonLRZ/Results/_PAXgene_TrafuS/PCR/GenEx/PAX_PCR_refGenes.mdf"
File name: '/home/veronika/mwn_storage_cloud/PhDvonLRZ/Results/_PAXgene_TrafuS/PCR/GenEx/PAX_PCR_refGenes.mdf'
  at System.IO.FileStream..ctor (System.String path, System.IO.FileMode mode, System.IO.FileAccess access, System.IO.FileShare share, System.Int32 bufferSize, System.Boolean anonymous, System.IO.FileOptions options) [0x0025f] in <8f2c484307284b51944a1a13a14c0266>:0 
  at System.IO.FileStream..ctor (System.String path, System.IO.FileMode mode, System.IO.FileAccess access, System.IO.FileShare share) [0x00000] in <8f2c484307284b51944a1a13a14c0266>:0 
  at (wrapper remoting-invoke-with-check) System.IO.FileStream:.ctor (string,System.IO.FileMode,System.IO.FileAccess,System.IO.FileShare)
  at System.IO.File.Open (System.String path, System.IO.FileMode mode, System.IO.FileAccess access, System.IO.FileShare share) [0x00000] in <8f2c484307284b51944a1a13a14c0266>:0 
  at Duplicati.Library.Snapshots.SnapshotBase.OpenRead (System.String localPath) [0x00000] in <042bfe691f1f4eb1b58f7cddf85bb4e8>:0 
  at Duplicati.Library.Main.Operation.Backup.FileBlockProcessor+<>c__DisplayClass1_0+<<Run>b__0>d.MoveNext () [0x00205] in <63172ad53f6940c395d5db05d1717049>:0

which https://fileinfo.com/extension/mdf suggests is SQL Server DB. Do you know anything about the file? Perhaps you can observe its timestamp for changes, or (less likely) spot it actually being not found by you.

You could also perhaps create a second backup (export and import) to a different storage location to see whether final problem seems related to presence or absence of “Could not find file” for some source file. You might also find that the message on the source file doesn’t always turn into an actual failure later on.

2019-08-02 15:18:19 +02 - [Error-Duplicati.Library.Main.Operation.BackupHandler-FatalError]: Fatal error
System.IO.FileNotFoundException: Could not find file "/tmp/dup-c15067ac-3c11-4e20-b8cf-e432b4b25b8b".
File name: '/tmp/dup-c15067ac-3c11-4e20-b8cf-e432b4b25b8b'
  at System.IO.FileStream..ctor (System.String path, System.IO.FileMode mode, System.IO.FileAccess access, System.IO.FileShare share, System.Int32 bufferSize, System.Boolean anonymous, System.IO.FileOptions options) [0x0021a] in <8f2c484307284b51944a1a13a14c0266>:0 
  at System.IO.FileStream..ctor (System.String path, System.IO.FileMode mode, System.IO.FileAccess access, System.IO.FileShare share) [0x00000] in <8f2c484307284b51944a1a13a14c0266>:0 
  at (wrapper remoting-invoke-with-check) System.IO.FileStream:.ctor (string,System.IO.FileMode,System.IO.FileAccess,System.IO.FileShare)
  at Duplicati.Library.Main.Volumes.VolumeReaderBase.LoadCompressor (System.String compressor, System.String file, Duplicati.Library.Main.Options options, System.IO.Stream& stream) [0x00000] in <63172ad53f6940c395d5db05d1717049>:0 
  at Duplicati.Library.Main.Volumes.VolumeReaderBase..ctor (System.String compressor, System.String file, Duplicati.Library.Main.Options options) [0x00007] in <63172ad53f6940c395d5db05d1717049>:0 
  at Duplicati.Library.Main.Volumes.BlockVolumeReader..ctor (System.String compressor, System.String file, Duplicati.Library.Main.Options options) [0x00010] in <63172ad53f6940c395d5db05d1717049>:0 
  at Duplicati.Library.Main.Operation.Backup.SpillCollectorProcess+<>c__DisplayClass0_0+<<Run>b__0>d.MoveNext () [0x0023c] in <63172ad53f6940c395d5db05d1717049>:0

is possibly the next thing to go wrong, but “The channel is retired” is just a secondary result of the earlier.