Broken backup / Object reference not set to an instance of an object / More

Support
1

Hi All,

I really like Duplicati but have pretty often errors while backuping data. One thing about which this post is about happened just yesterday. I have a large set of photos (about 450GB), which take about two weeks to upload. After uploading for about 10 days, I had to restart my server and therefore interrupted the backup. So far everything went fine. While the backup was running, I added, changed, removed files of the backuped folder. After rebooting, I restarted the backup and it found new files and started to upload them. Then I went to bed. When I got up, I saw that at one point while backuping the following error happened:

System.NullReferenceException: Object reference not set to an instance of an object at Duplicati.Library.Main.Volumes.BlockVolumeWriter.AddBlock (System.String hash, System.Byte[] data, System.Int32 offset, System.Int32 size, Duplicati.Library.Interface.CompressionHint hint) [0x00032] in &lt;fbbeda0cad134e648d781c1357bdba9c&gt;:0 at Duplicati.Library.Main.Operation.Backup.SpillCollectorProcess+&lt;&gt;c__DisplayClass0_0.&lt;Run&gt;b__0 (&lt;&gt;f__AnonymousType92[<Input>j__TPar,<Output>j__TPar] self) [0x003df] in <fbbeda0cad134e648d781c1357bdba9c>:0 at CoCoL.AutomationExtensions.RunTask[T] (T channels, System.Func2[T,TResult] method, System.Boolean catchRetiredExceptions) [0x000cc] in &lt;6973ce2780de4b28aaa2c5ffc59993b1&gt;:0 at Duplicati.Library.Main.Operation.BackupHandler.RunMainOperation (System.Collections.Generic.IEnumerable1[T] sources, Duplicati.Library.Snapshots.ISnapshotService snapshot, Duplicati.Library.Snapshots.UsnJournalService journalService, Duplicati.Library.Main.Operation.Backup.BackupDatabase database, Duplicati.Library.Main.Operation.Backup.BackupStatsCollector stats, Duplicati.Library.Main.Options options, Duplicati.Library.Utility.IFilter sourcefilter, Duplicati.Library.Utility.IFilter filter, Duplicati.Library.Main.BackupResults result, Duplicati.Library.Main.Operation.Common.ITaskReader taskreader, System.Int64 lastfilesetid) [0x00349] in <fbbeda0cad134e648d781c1357bdba9c>:0 at Duplicati.Library.Main.Operation.BackupHandler.RunAsync (System.String sources, Duplicati.Library.Utility.IFilter filter) [0x01017] in <fbbeda0cad134e648d781c1357bdba9c>:0 at CoCoL.ChannelExtensions.WaitForTaskOrThrow (System.Threading.Tasks.Task task) [0x00050] in <6973ce2780de4b28aaa2c5ffc59993b1>:0 at Duplicati.Library.Main.Operation.BackupHandler.Run (System.String sources, Duplicati.Library.Utility.IFilter filter) [0x00008] in <fbbeda0cad134e648d781c1357bdba9c>:0 at Duplicati.Library.Main.Controller+<>c__DisplayClass13_0.<Backup>b__0 (Duplicati.Library.Main.BackupResults result) [0x00035] in <fbbeda0cad134e648d781c1357bdba9c>:0 at Duplicati.Library.Main.Controller.RunAction[T] (T result, System.String& paths, Duplicati.Library.Utility.IFilter& filter, System.Action1[T] method) [0x00271] in &lt;fbbeda0cad134e648d781c1357bdba9c&gt;:0 at Duplicati.Library.Main.Controller.Backup (System.String[] inputsources, Duplicati.Library.Utility.IFilter filter) [0x00068] in &lt;fbbeda0cad134e648d781c1357bdba9c&gt;:0 at Duplicati.Server.Runner.Run (Duplicati.Server.Runner+IRunnerData data, System.Boolean fromQueue) [0x002f7] in &lt;75bfd5a73aa341feaf69df24cfa473d4&gt;:0``> System.NullReferenceException: Object reference not set to an instance of an object at Duplicati.Library.Main.Volumes.BlockVolumeWriter.AddBlock (System.String hash, System.Byte[] data, System.Int32 offset, System.Int32 size, Duplicati.Library.Interface.CompressionHint hint) [0x00032] in &lt;fbbeda0cad134e648d781c1357bdba9c&gt;:0 at Duplicati.Library.Main.Operation.Backup.SpillCollectorProcess+&lt;&gt;c__DisplayClass0_0.&lt;Run&gt;b__0 (&lt;&gt;f__AnonymousType92[<Input>j__TPar,<Output>j__TPar] self) [0x003df] in <fbbeda0cad134e648d781c1357bdba9c>:0 at CoCoL.AutomationExtensions.RunTask[T] (T channels, System.Func2[T,TResult] method, System.Boolean catchRetiredExceptions) [0x000cc] in &lt;6973ce2780de4b28aaa2c5ffc59993b1&gt;:0 at Duplicati.Library.Main.Operation.BackupHandler.RunMainOperation (System.Collections.Generic.IEnumerable1[T] sources, Duplicati.Library.Snapshots.ISnapshotService snapshot, Duplicati.Library.Snapshots.UsnJournalService journalService, Duplicati.Library.Main.Operation.Backup.BackupDatabase database, Duplicati.Library.Main.Operation.Backup.BackupStatsCollector stats, Duplicati.Library.Main.Options options, Duplicati.Library.Utility.IFilter sourcefilter, Duplicati.Library.Utility.IFilter filter, Duplicati.Library.Main.BackupResults result, Duplicati.Library.Main.Operation.Common.ITaskReader taskreader, System.Int64 lastfilesetid) [0x00349] in <fbbeda0cad134e648d781c1357bdba9c>:0 at Duplicati.Library.Main.Operation.BackupHandler.RunAsync (System.String sources, Duplicati.Library.Utility.IFilter filter) [0x01017] in <fbbeda0cad134e648d781c1357bdba9c>:0 at CoCoL.ChannelExtensions.WaitForTaskOrThrow (System.Threading.Tasks.Task task) [0x00050] in <6973ce2780de4b28aaa2c5ffc59993b1>:0 at Duplicati.Library.Main.Operation.BackupHandler.Run (System.String sources, Duplicati.Library.Utility.IFilter filter) [0x00008] in <fbbeda0cad134e648d781c1357bdba9c>:0 at Duplicati.Library.Main.Controller+<>c__DisplayClass13_0.<Backup>b__0 (Duplicati.Library.Main.BackupResults result) [0x00035] in <fbbeda0cad134e648d781c1357bdba9c>:0 at Duplicati.Library.Main.Controller.RunAction[T] (T result, System.String& paths, Duplicati.Library.Utility.IFilter& filter, System.Action1[T] method) [0x00271] in &lt;fbbeda0cad134e648d781c1357bdba9c&gt;:0 at Duplicati.Library.Main.Controller.Backup (System.String[] inputsources, Duplicati.Library.Utility.IFilter filter) [0x00068] in &lt;fbbeda0cad134e648d781c1357bdba9c&gt;:0 at Duplicati.Server.Runner.Run (Duplicati.Server.Runner+IRunnerData data, System.Boolean fromQueue) [0x002f7] in &lt;75bfd5a73aa341feaf69df24cfa473d4&gt;:0

I restarted again and soon it threw the following error:

Duplicati.Library.Interface.UserInformationException: Unexpected difference in fileset version 1: 15.02.2019 08:40:52 (database id: 1), found 31017 entries, but expected 31018 at Duplicati.Library.Main.Database.LocalDatabase.VerifyConsistency (System.Int64 blocksize, System.Int64 hashsize, System.Boolean verifyfilelists, System.Data.IDbTransaction transaction) [0x00370] in <fbbeda0cad134e648d781c1357bdba9c>:0 at Duplicati.Library.Main.Operation.Backup.BackupDatabase+<>c__DisplayClass33_0.<VerifyConsistencyAsync>b__0 () [0x00000] in <fbbeda0cad134e648d781c1357bdba9c>:0 at Duplicati.Library.Main.Operation.Common.SingleRunner+<>c__DisplayClass3_0.<RunOnMain>b__0 () [0x00000] in <fbbeda0cad134e648d781c1357bdba9c>:0 at Duplicati.Library.Main.Operation.Common.SingleRunner.DoRunOnMain[T] (System.Func1[TResult] method) [0x000b0] in &lt;fbbeda0cad134e648d781c1357bdba9c&gt;:0 at Duplicati.Library.Main.Operation.BackupHandler.RunAsync (System.String[] sources, Duplicati.Library.Utility.IFilter filter) [0x01017] in &lt;fbbeda0cad134e648d781c1357bdba9c&gt;:0 at CoCoL.ChannelExtensions.WaitForTaskOrThrow (System.Threading.Tasks.Task task) [0x00050] in &lt;6973ce2780de4b28aaa2c5ffc59993b1&gt;:0 at Duplicati.Library.Main.Operation.BackupHandler.Run (System.String[] sources, Duplicati.Library.Utility.IFilter filter) [0x00008] in &lt;fbbeda0cad134e648d781c1357bdba9c&gt;:0 at Duplicati.Library.Main.Controller+&lt;&gt;c__DisplayClass13_0.&lt;Backup&gt;b__0 (Duplicati.Library.Main.BackupResults result) [0x00035] in &lt;fbbeda0cad134e648d781c1357bdba9c&gt;:0 at Duplicati.Library.Main.Controller.RunAction[T] (T result, System.String[]&amp; paths, Duplicati.Library.Utility.IFilter&amp; filter, System.Action1[T] method) [0x00271] in <fbbeda0cad134e648d781c1357bdba9c>:0 at Duplicati.Library.Main.Controller.Backup (System.String inputsources, Duplicati.Library.Utility.IFilter filter) [0x00068] in <fbbeda0cad134e648d781c1357bdba9c>:0 at Duplicati.Server.Runner.Run (Duplicati.Server.Runner+IRunnerData data, System.Boolean fromQueue) [0x002f7] in <75bfd5a73aa341feaf69df24cfa473d4>:0

So my questions:

  • What went wrong?
  • Can I somehow rescue my backup without starting the upload from scratch (as I did about 3 times now because of every backup attempt had errors before)?
  • How can I avoid such situations in the future?

I’m glad to help in every way to solve this problems.

Thanks
Oliver

2

Ah sorry and some missing information:

  • APIVersion : 1
  • PasswordPlaceholder : **********
  • ServerVersion : 2.0.4.15
  • ServerVersionName : - 2.0.4.15_canary_2019-02-06
  • ServerVersionType : Canary
  • StartedBy : Server
  • BaseVersionName : 2.0.4.4_canary_2018-11-14
  • DefaultUpdateChannel : Canary
  • DefaultUsageReportLevel : Information
  • ServerTime : 2019-02-22T07:41:57.924615+01:00
  • OSType : Linux
  • DirectorySeparator : /
  • PathSeparator : :
  • CaseSensitiveFilesystem : true
  • MonoVersion : 5.18.0.240
  • MachineName : xxxx
  • UserName : xxxx
  • NewLine :
  • CLRVersion : 4.0.30319.42000
  • CLROSInfo : {“Platform”:“Unix”,“ServicePack”:"",“Version”:“4.19.0.0”,“VersionString”:“Unix 4.19.0.0”}
  • ServerModules :
  • UsingAlternateUpdateURLs : false
  • LogLevels : [“ExplicitOnly”,“Profiling”,“Verbose”,“Retry”,“Information”,“DryRun”,“Warning”,“Error”]
  • SuppressDonationMessages : false
  • SpecialFolders : [{“ID”:"%MY_DOCUMENTS%",“Path”:"/root"},{“ID”:"%HOME%",“Path”:"/root"}]
  • BrowserLocale : {“Code”:“de-DE”,“EnglishName”:“German (Germany)”,“DisplayName”:“Deutsch (Deutschland)”}
  • SupportedLocales : [{“Code”:“bn”,“EnglishName”:“Bangla”,“DisplayName”:“বাংলা”},{“Code”:“ca”,“EnglishName”:“Catalan”,“DisplayName”:“català”},{“Code”:“cs”,“EnglishName”:“Czech”,“DisplayName”:“čeština”},{“Code”:“da”,“EnglishName”:“Danish”,“DisplayName”:“dansk”},{“Code”:“de”,“EnglishName”:“German”,“DisplayName”:“Deutsch”},{“Code”:“en”,“EnglishName”:“English”,“DisplayName”:“English”},{“Code”:“es”,“EnglishName”:“Spanish”,“DisplayName”:“español”},{“Code”:“fi”,“EnglishName”:“Finnish”,“DisplayName”:“suomi”},{“Code”:“fr”,“EnglishName”:“French”,“DisplayName”:“français”},{“Code”:“hu”,“EnglishName”:“Hungarian”,“DisplayName”:“magyar”},{“Code”:“it”,“EnglishName”:“Italian”,“DisplayName”:“italiano”},{“Code”:“ja-JP”,“EnglishName”:“Japanese (Japan)”,“DisplayName”:“日本語 (日本)”},{“Code”:“ko”,“EnglishName”:“Korean”,“DisplayName”:“한국어”},{“Code”:“lt”,“EnglishName”:“Lithuanian”,“DisplayName”:“lietuvių”},{“Code”:“lv”,“EnglishName”:“Latvian”,“DisplayName”:“latviešu”},{“Code”:“nl-NL”,“EnglishName”:“Dutch (Netherlands)”,“DisplayName”:“Nederlands (Nederland)”},{“Code”:“pl”,“EnglishName”:“Polish”,“DisplayName”:“polski”},{“Code”:“pt”,“EnglishName”:“Portuguese”,“DisplayName”:“português”},{“Code”:“pt-BR”,“EnglishName”:“Portuguese (Brazil)”,“DisplayName”:“português (Brasil)”},{“Code”:“ro”,“EnglishName”:“Romanian”,“DisplayName”:“română”},{“Code”:“ru”,“EnglishName”:“Russian”,“DisplayName”:“русский”},{“Code”:“sk”,“EnglishName”:“Slovak”,“DisplayName”:“slovenčina”},{“Code”:“sk-SK”,“EnglishName”:“Slovak (Slovakia)”,“DisplayName”:“slovenčina (Slovensko)”},{“Code”:“sv-SE”,“EnglishName”:“Swedish (Sweden)”,“DisplayName”:“svenska (Sverige)”},{“Code”:“th”,“EnglishName”:“Thai”,“DisplayName”:“ไทย”},{“Code”:“zh-CN”,“EnglishName”:“Chinese (Simplified)”,“DisplayName”:“中文 (中国)”},{“Code”:“zh-HK”,“EnglishName”:“Chinese (Traditional, Hong Kong SAR China)”,“DisplayName”:“中文 (中国香港特别行政区)”},{“Code”:“zh-TW”,“EnglishName”:“Chinese (Traditional)”,“DisplayName”:“中文 (台湾)”}]
  • BrowserLocaleSupported : true
  • backendgroups : {“std”:{“ftp”:null,“ssh”:null,“webdav”:null,“openstack”:“OpenStack Object Storage / Swift”,“s3”:“S3 Kompatibel”,“aftp”:“FTP (Alternativ)”},“local”:{“file”:null},“prop”:{“s3”:null,“azure”:null,“googledrive”:null,“onedrive”:null,“onedrivev2”:null,“sharepoint”:null,“msgroup”:null,“cloudfiles”:null,“gcs”:null,“openstack”:null,“hubic”:null,“amzcd”:null,“b2”:null,“mega”:null,“box”:null,“od4b”:null,“mssp”:null,“dropbox”:null,“sia”:null,“jottacloud”:null,“rclone”:null}}
  • GroupTypes : [“Lokaler Speicher”,“Standardprotokolle”,“Proprietär”,“Weitere”]
  • Backend-Module: aftp amzcd azure b2 box cloudfiles dropbox ftp file googledrive gcs hubic jottacloud mega msgroup onedrivev2 sharepoint openstack rclone s3 ssh od4b mssp siatahoe webdav
  • Kompression: zip 7z
  • Verschlüsselungen: aes gpg