I’m currently running 2.0.4.5_beta_2018-11-28.
I’ve been backing up to Azure for a while (several months) and over the past few days, I’ve started getting some weird exceptions thrown by Duplicati when it runs the backup.
The backup will run on its normal schedule and throw this error:
stack trace
System.NullReferenceException: Object reference not set to an instance of an object.
at SharpCompress.Readers.AbstractReader`2.get_Entry()
at SharpCompress.Readers.AbstractReader`2.LoadStreamForReading(Stream stream)
at Duplicati.Library.Compression.FileArchiveZip.LoadEntryTable()
at Duplicati.Library.Compression.FileArchiveZip.GetEntry(String file)
at Duplicati.Library.Compression.FileArchiveZip.OpenRead(String file)
at Duplicati.Library.Main.Volumes.VolumeReaderBase.ReadManifests(Options options)
at Duplicati.Library.Main.Operation.CompactHandler.DoCompact(LocalDeleteDatabase db, Boolean hasVerifiedBackend, IDbTransaction& transaction, BackendManager sharedBackend)
at Duplicati.Library.Main.Operation.DeleteHandler.DoRun(LocalDeleteDatabase db, IDbTransaction& transaction, Boolean hasVerifiedBacked, Boolean forceCompact, BackendManager sharedManager)
at Duplicati.Library.Main.Operation.BackupHandler.CompactIfRequired(BackendManager backend, Int64 lastVolumeSize) at Duplicati.Library.Main.Operation.BackupHandler.<RunAsync>d__19.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at CoCoL.ChannelExtensions.WaitForTaskOrThrow(Task task)
at Duplicati.Library.Main.Controller.<>c__DisplayClass13_0.<Backup>b__0(BackupResults result)
at Duplicati.Library.Main.Controller.RunAction[T](T result, String[]& paths, IFilter& filter, Action`1 method)
at Duplicati.Library.Main.Controller.Backup(String[] inputsources, IFilter filter)
at Duplicati.Server.Runner.Run(IRunnerData data, Boolean fromQueue)
log
[Warning-Duplicati.Library.Compression.FileArchiveZip-BrokenCentralHeaderFallback]: Zip archive appears to have a broken Central Record Header, switching to stream mode
System.InvalidOperationException: Cannot determine compressed stream type. Supported Archive Formats: Zip, GZip, Tar, Rar, 7Zip, LZip
at SharpCompress.Archives.ArchiveFactory.Open(Stream stream, ReaderOptions readerOptions)
at Duplicati.Library.Compression.FileArchiveZip.get_Archive()
at Duplicati.Library.Compression.FileArchiveZip.LoadEntryTable()
So, I’ll run the backup again, whereupon it complains that there are missing files:
stack trace
Duplicati.Library.Interface.UserInformationException: Found 7 files that are missing from the remote storage, please run repair
at Duplicati.Library.Main.Operation.FilelistProcessor.VerifyRemoteList(BackendManager backend, Options options, LocalDatabase database, IBackendWriter log, String protectedfile)
at Duplicati.Library.Main.Operation.BackupHandler.PreBackupVerify(BackendManager backend, String protectedfile)
at Duplicati.Library.Main.Operation.BackupHandler.<RunAsync>d__19.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at CoCoL.ChannelExtensions.WaitForTaskOrThrow(Task task)
at Duplicati.Library.Main.Controller.<>c__DisplayClass13_0.<Backup>b__0(BackupResults result)
at Duplicati.Library.Main.Controller.RunAction[T](T result, String[]& paths, IFilter& filter, Action`1 method)
at Duplicati.Library.Main.Controller.Backup(String[] inputsources, IFilter filter)
at Duplicati.Server.Runner.Run(IRunnerData data, Boolean fromQueue)
log
[Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingFile]: Missing file: duplicati-ia846ebfde512437c9b426d068a6e950d.dindex.zip.aes
[Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingFile]: Missing file: duplicati-ib5f18426218341c2aeb76d473e9b483b.dindex.zip.aes
[Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingFile]: Missing file: duplicati-i8392b9ad3a0b44a3a66e8c191f1730ee.dindex.zip.aes
[Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingFile]: Missing file: duplicati-icaec8fcd779e4243a36f6334571f1680.dindex.zip.aes
[Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingFile]: Missing file: duplicati-icb9f8c3b272d445f94812066cf00a8f4.dindex.zip.aes
[Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingFile]: Missing file: duplicati-i57da8b503c974a708a103b3337eb7a2b.dindex.zip.aes
[Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingFile]: Missing file: duplicati-i4ace5f19d3174356b3cf355f36b525fc.dindex.zip.aes
So, I’ll run the repair:
log
[Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Repair has started
[Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()
[Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (16.23 KB)
[Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-ia846ebfde512437c9b426d068a6e950d.dindex.zip.aes (541 bytes)
[Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-ia846ebfde512437c9b426d068a6e950d.dindex.zip.aes (541 bytes)
...
Then I re-run the backup, and everything will succeed…only to repeat in full the next day when the backup runs again.
This scenario has been playing out daily for the past 4 days, and so far I haven’t been able to figure out what’s causing it. Can anyone offer any suggestions?
Thanks.