Onedrive vs Object reference not set to an instanc

[Peter_Bielik]

Dear,
A bit fighting with backup from OpenMediaVault NAS to Onedrive.
I have several tasks /for several NAS users/ for backup to Onedrive, task are working normally. On Onedrive side it is one account with several folder for separate tasks.

With one task /about 16GB of data / i still have problems. Logs is below.
Also tried to start with empty folder / that task works/, later copy part of data to folder and initated backup tasks again. After several backups it stops with error

System.NullReferenceException: Object reference not set to an instance of an object
at Duplicati.Library.Main.Volumes.BlockVolumeWriter.AddBlock (System.String hash, System.Byte data, System.Int32 offset, System.Int32 size, Duplicati.Library.Interface.CompressionHint hint) [0x00032] in :0
at Duplicati.Library.Main.Operation.Backup.SpillCollectorProcess+<>c__DisplayClass0_0+<b__0>d.MoveNext () [0x003df] in :0
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <8f2c484307284b51944a1a13a14c0266>:0
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <8f2c484307284b51944a1a13a14c0266>:0
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <8f2c484307284b51944a1a13a14c0266>:0
at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <8f2c484307284b51944a1a13a14c0266>:0
at System.Runtime.CompilerServices.TaskAwaiter.GetResult () [0x00000] in <8f2c484307284b51944a1a13a14c0266>:0
at CoCoL.AutomationExtensions+d__101[T].MoveNext () [0x0007a] in <6973ce2780de4b28aaa2c5ffc59993b1>:0 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <8f2c484307284b51944a1a13a14c0266>:0 at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <8f2c484307284b51944a1a13a14c0266>:0 at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <8f2c484307284b51944a1a13a14c0266>:0 at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <8f2c484307284b51944a1a13a14c0266>:0 at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () [0x00000] in <8f2c484307284b51944a1a13a14c0266>:0 at Duplicati.Library.Main.Operation.BackupHandler+<RunMainOperation>d__12.MoveNext () [0x00349] in <e2da9713f0974e76879d9f9aa7ce0e36>:0 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <8f2c484307284b51944a1a13a14c0266>:0 at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <8f2c484307284b51944a1a13a14c0266>:0 at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <8f2c484307284b51944a1a13a14c0266>:0 at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <8f2c484307284b51944a1a13a14c0266>:0 at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () [0x00000] in <8f2c484307284b51944a1a13a14c0266>:0 at Duplicati.Library.Main.Operation.BackupHandler+<RunAsync>d__19.MoveNext () [0x00a43] in <e2da9713f0974e76879d9f9aa7ce0e36>:0 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <8f2c484307284b51944a1a13a14c0266>:0 at CoCoL.ChannelExtensions.WaitForTaskOrThrow (System.Threading.Tasks.Task task) [0x00050] in <6973ce2780de4b28aaa2c5ffc59993b1>:0 at Duplicati.Library.Main.Operation.BackupHandler.Run (System.String[] sources, Duplicati.Library.Utility.IFilter filter) [0x00008] in <e2da9713f0974e76879d9f9aa7ce0e36>:0 at Duplicati.Library.Main.Controller+<>c__DisplayClass13_0.<Backup>b__0 (Duplicati.Library.Main.BackupResults result) [0x00035] in <e2da9713f0974e76879d9f9aa7ce0e36>:0 at Duplicati.Library.Main.Controller.RunAction[T] (T result, System.String[]& paths, Duplicati.Library.Utility.IFilter& filter, System.Action1[T] method) [0x0011d] in :0

System Properties

• APIVersion : 1
• PasswordPlaceholder : **********
• ServerVersion : 2.0.4.23
• ServerVersionName : - 2.0.4.23_beta_2019-07-14
• ServerVersionType : Beta
• StartedBy : Server
• BaseVersionName : 2.0.3.3_beta_2018-04-02
• DefaultUpdateChannel : Beta
• DefaultUsageReportLevel : Information
• ServerTime : 2019-09-29T19:21:05.658497+02:00
• OSType : Linux
• DirectorySeparator : /
• PathSeparator : :
• CaseSensitiveFilesystem : true
• MonoVersion : 4.6.2
• MachineName : odroidxu4
• UserName : root
• NewLine :
• CLRVersion : 4.0.30319.42000
• CLROSInfo : {“Platform”:“Unix”,“ServicePack”:"",“Version”:“4.14.144.4”,“VersionString”:“Unix 4.14.144.4”}
• ServerModules :
• UsingAlternateUpdateURLs : false
• LogLevels : [“ExplicitOnly”,“Profiling”,“Verbose”,“Retry”,“Information”,“DryRun”,“Warning”,“Error”]
• SuppressDonationMessages : false
• SpecialFolders : [{“ID”:"%MY_DOCUMENTS%",“Path”:"/root"},{“ID”:"%DESKTOP%",“Path”:"/root/Desktop"},{“ID”:"%HOME%",“Path”:"/root"}]
• BrowserLocale : {“Code”:“sk-SK”,“EnglishName”:“Slovak (Slovakia)”,“DisplayName”:“slovenčina (Slovensko)”}
• SupportedLocales : [{“Code”:“bn”,“EnglishName”:“Bengali”,“DisplayName”:“বাংলা”},{“Code”:“ca”,“EnglishName”:“Catalan”,“DisplayName”:“català”},{“Code”:“cs”,“EnglishName”:“Czech”,“DisplayName”:“čeština”},{“Code”:“da”,“EnglishName”:“Danish”,“DisplayName”:“dansk”},{“Code”:“de”,“EnglishName”:“German”,“DisplayName”:“Deutsch”},{“Code”:“en”,“EnglishName”:“English”,“DisplayName”:“English”},{“Code”:“es”,“EnglishName”:“Spanish”,“DisplayName”:“español”},{“Code”:“fi”,“EnglishName”:“Finnish”,“DisplayName”:“suomi”},{“Code”:“fr”,“EnglishName”:“French”,“DisplayName”:“français”},{“Code”:“hu”,“EnglishName”:“Hungarian”,“DisplayName”:“magyar”},{“Code”:“it”,“EnglishName”:“Italian”,“DisplayName”:“italiano”},{“Code”:“ja-JP”,“EnglishName”:“Japanese (Japan)”,“DisplayName”:“日本語 (日本)”},{“Code”:“ko”,“EnglishName”:“Korean”,“DisplayName”:“한국어”},{“Code”:“lt”,“EnglishName”:“Lithuanian”,“DisplayName”:“lietuvių”},{“Code”:“lv”,“EnglishName”:“Latvian”,“DisplayName”:“latviešu”},{“Code”:“nl-NL”,“EnglishName”:“Dutch (Netherlands)”,“DisplayName”:“Nederlands (Nederland)”},{“Code”:“pl”,“EnglishName”:“Polish”,“DisplayName”:“polski”},{“Code”:“pt”,“EnglishName”:“Portuguese”,“DisplayName”:“português”},{“Code”:“pt-BR”,“EnglishName”:“Portuguese (Brazil)”,“DisplayName”:“português (Brasil)”},{“Code”:“ro”,“EnglishName”:“Romanian”,“DisplayName”:“română”},{“Code”:“ru”,“EnglishName”:“Russian”,“DisplayName”:“русский”},{“Code”:“sk”,“EnglishName”:“Slovak”,“DisplayName”:“slovenčina”},{“Code”:“sk-SK”,“EnglishName”:“Slovak (Slovakia)”,“DisplayName”:“slovenčina (Slovensko)”},{“Code”:“sv-SE”,“EnglishName”:“Swedish (Sweden)”,“DisplayName”:“svenska (Sverige)”},{“Code”:“th”,“EnglishName”:“Thai”,“DisplayName”:“ไทย”},{“Code”:“zh-CN”,“EnglishName”:“Chinese (Simplified)”,“DisplayName”:“中文 (中国)”},{“Code”:“zh-HK”,“EnglishName”:“Chinese (Traditional, Hong Kong SAR China)”,“DisplayName”:“中文 (中国香港特别行政区)”},{“Code”:“zh-TW”,“EnglishName”:“Chinese (Traditional)”,“DisplayName”:“中文 (台湾)”}]
• BrowserLocaleSupported : true
• backendgroups : {“std”:{“ftp”:null,“ssh”:null,“webdav”:null,“openstack”:“OpenStack Object Storage / Swift”,“s3”:“S3 Compatible”,“aftp”:“FTP (Alternative)”},“local”:{“file”:null},“prop”:{“s3”:null,“azure”:null,“googledrive”:null,“onedrive”:null,“onedrivev2”:null,“sharepoint”:null,“msgroup”:null,“cloudfiles”:null,“gcs”:null,“openstack”:null,“hubic”:null,“amzcd”:null,“b2”:null,“mega”:null,“box”:null,“od4b”:null,“mssp”:null,“dropbox”:null,“sia”:null,“jottacloud”:null,“rclone”:null}}
• GroupTypes : [“Local storage”,“Standard protocols”,“Proprietary”,“Others”]
• Backend modules: aftp amzcd azure b2 box cloudfiles dropbox ftp file googledrive gcs hubic jottacloud mega msgroup onedrive onedrivev2 sharepoint openstack rclone s3 ssh od4b mssp sia tahoe webdav
• Compression modules: zip 7z
• Encryption modules: aes gpg

Thanks for advice

[greg.ewing]

I’m having a very similar issue with OneDrive. i’ve created a new backup job using Duplicati running in a docker. In total I have 2 backup jobs, with identical configuration apart from the fact the one used ssh to back up to a local server, the other uses OneDriveV2 as the destination. There’s plenty of space in Onedrive for my 200GB of data, and I started with a new folder, but still get the same error message, then the backup fails and on the next attempt I get messages about different numbers of files etc…

Logs:

System.NullReferenceException: Object reference not set to an instance of an object
at Duplicati.Library.Main.Volumes.BlockVolumeWriter.AddBlock (System.String hash, System.Byte data, System.Int32 offset, System.Int32 size, Duplicati.Library.Interface.CompressionHint hint) [0x00032] in :0
at Duplicati.Library.Main.Operation.Backup.SpillCollectorProcess+<>c__DisplayClass0_0.b__0 (<>f__AnonymousType92[<Input>j__TPar,<Output>j__TPar] self) [0x003df] in <e2da9713f0974e76879d9f9aa7ce0e36>:0 at CoCoL.AutomationExtensions.RunTask[T] (T channels, System.Func2[T,TResult] method, System.Boolean catchRetiredExceptions) [0x000cc] in <6973ce2780de4b28aaa2c5ffc59993b1>:0
at Duplicati.Library.Main.Operation.BackupHandler.RunMainOperation (System.Collections.Generic.IEnumerable1[T] sources, Duplicati.Library.Snapshots.ISnapshotService snapshot, Duplicati.Library.Snapshots.UsnJournalService journalService, Duplicati.Library.Main.Operation.Backup.BackupDatabase database, Duplicati.Library.Main.Operation.Backup.BackupStatsCollector stats, Duplicati.Library.Main.Options options, Duplicati.Library.Utility.IFilter sourcefilter, Duplicati.Library.Utility.IFilter filter, Duplicati.Library.Main.BackupResults result, Duplicati.Library.Main.Operation.Common.ITaskReader taskreader, System.Int64 lastfilesetid) [0x00349] in <e2da9713f0974e76879d9f9aa7ce0e36>:0 at Duplicati.Library.Main.Operation.BackupHandler.RunAsync (System.String[] sources, Duplicati.Library.Utility.IFilter filter) [0x01031] in <e2da9713f0974e76879d9f9aa7ce0e36>:0 at CoCoL.ChannelExtensions.WaitForTaskOrThrow (System.Threading.Tasks.Task task) [0x00050] in <6973ce2780de4b28aaa2c5ffc59993b1>:0 at Duplicati.Library.Main.Operation.BackupHandler.Run (System.String[] sources, Duplicati.Library.Utility.IFilter filter) [0x00008] in <e2da9713f0974e76879d9f9aa7ce0e36>:0 at Duplicati.Library.Main.Controller+<>c__DisplayClass13_0.<Backup>b__0 (Duplicati.Library.Main.BackupResults result) [0x00035] in <e2da9713f0974e76879d9f9aa7ce0e36>:0 at Duplicati.Library.Main.Controller.RunAction[T] (T result, System.String[]& paths, Duplicati.Library.Utility.IFilter& filter, System.Action1[T] method) [0x00271] in :0
at Duplicati.Library.Main.Controller.Backup (System.String inputsources, Duplicati.Library.Utility.IFilter filter) [0x00068] in :0
at Duplicati.Server.Runner.Run (Duplicati.Server.Runner+IRunnerData data, System.Boolean fromQueue) [0x00307] in :0

System Properties:

System properties

• APIVersion : 1
• PasswordPlaceholder : **********
• ServerVersion : 2.0.4.23
• ServerVersionName : - 2.0.4.23_beta_2019-07-14
• ServerVersionType : Beta
• StartedBy : Server
• BaseVersionName : 2.0.4.23_beta_2019-07-14
• DefaultUpdateChannel : Beta
• DefaultUsageReportLevel : Information
• ServerTime : 2019-12-12T08:21:57.411754+00:00
• OSType : Linux
• DirectorySeparator : /
• PathSeparator : :
• CaseSensitiveFilesystem : true
• MonoVersion : 5.20.1.34
• MachineName : 2434e6b59ae9
• UserName : root
• NewLine :
• CLRVersion : 4.0.30319.42000
• CLROSInfo : {“Platform”:“Unix”,“ServicePack”:"",“Version”:“4.4.0.170”,“VersionString”:“Unix 4.4.0.170”}
• ServerModules :
• UsingAlternateUpdateURLs : false
• LogLevels : [“ExplicitOnly”,“Profiling”,“Verbose”,“Retry”,“Information”,“DryRun”,“Warning”,“Error”]
• SuppressDonationMessages : false
• SpecialFolders : [{“ID”:"%MY_DOCUMENTS%",“Path”:"/config"},{“ID”:"%HOME%",“Path”:"/config"}]
• BrowserLocale : {“Code”:“en-GB”,“EnglishName”:“English (United Kingdom)”,“DisplayName”:“English (United Kingdom)”}
• SupportedLocales : [{“Code”:“bn”,“EnglishName”:“Bangla”,“DisplayName”:“বাংলা”},{“Code”:“ca”,“EnglishName”:“Catalan”,“DisplayName”:“català”},{“Code”:“cs”,“EnglishName”:“Czech”,“DisplayName”:“čeština”},{“Code”:“da”,“EnglishName”:“Danish”,“DisplayName”:“dansk”},{“Code”:“de”,“EnglishName”:“German”,“DisplayName”:“Deutsch”},{“Code”:“en”,“EnglishName”:“English”,“DisplayName”:“English”},{“Code”:“es”,“EnglishName”:“Spanish”,“DisplayName”:“español”},{“Code”:“fi”,“EnglishName”:“Finnish”,“DisplayName”:“suomi”},{“Code”:“fr”,“EnglishName”:“French”,“DisplayName”:“français”},{“Code”:“hu”,“EnglishName”:“Hungarian”,“DisplayName”:“magyar”},{“Code”:“it”,“EnglishName”:“Italian”,“DisplayName”:“italiano”},{“Code”:“ja-JP”,“EnglishName”:“Japanese (Japan)”,“DisplayName”:“日本語 (日本)”},{“Code”:“ko”,“EnglishName”:“Korean”,“DisplayName”:“한국어”},{“Code”:“lt”,“EnglishName”:“Lithuanian”,“DisplayName”:“lietuvių”},{“Code”:“lv”,“EnglishName”:“Latvian”,“DisplayName”:“latviešu”},{“Code”:“nl-NL”,“EnglishName”:“Dutch (Netherlands)”,“DisplayName”:“Nederlands (Nederland)”},{“Code”:“pl”,“EnglishName”:“Polish”,“DisplayName”:“polski”},{“Code”:“pt”,“EnglishName”:“Portuguese”,“DisplayName”:“português”},{“Code”:“pt-BR”,“EnglishName”:“Portuguese (Brazil)”,“DisplayName”:“português (Brasil)”},{“Code”:“ro”,“EnglishName”:“Romanian”,“DisplayName”:“română”},{“Code”:“ru”,“EnglishName”:“Russian”,“DisplayName”:“русский”},{“Code”:“sk”,“EnglishName”:“Slovak”,“DisplayName”:“slovenčina”},{“Code”:“sk-SK”,“EnglishName”:“Slovak (Slovakia)”,“DisplayName”:“slovenčina (Slovensko)”},{“Code”:“sv-SE”,“EnglishName”:“Swedish (Sweden)”,“DisplayName”:“svenska (Sverige)”},{“Code”:“th”,“EnglishName”:“Thai”,“DisplayName”:“ไทย”},{“Code”:“zh-CN”,“EnglishName”:“Chinese (Simplified)”,“DisplayName”:“中文 (中国)”},{“Code”:“zh-HK”,“EnglishName”:“Chinese (Traditional, Hong Kong SAR China)”,“DisplayName”:“中文 (中国香港特别行政区)”},{“Code”:“zh-TW”,“EnglishName”:“Chinese (Traditional)”,“DisplayName”:“中文 (台湾)”}]
• BrowserLocaleSupported : true
• backendgroups : {“std”:{“ftp”:null,“ssh”:null,“webdav”:null,“openstack”:“OpenStack Object Storage / Swift”,“s3”:“S3 Compatible”,“aftp”:“FTP (Alternative)”},“local”:{“file”:null},“prop”:{“s3”:null,“azure”:null,“googledrive”:null,“onedrive”:null,“onedrivev2”:null,“sharepoint”:null,“msgroup”:null,“cloudfiles”:null,“gcs”:null,“openstack”:null,“hubic”:null,“amzcd”:null,“b2”:null,“mega”:null,“box”:null,“od4b”:null,“mssp”:null,“dropbox”:null,“sia”:null,“jottacloud”:null,“rclone”:null}}
• GroupTypes : [“Local storage”,“Standard protocols”,“Proprietary”,“Others”]
• Backend modules: aftp amzcd azure b2 box cloudfiles dropbox ftp file googledrive gcs hubic jottacloud mega msgroup onedrive onedrivev2 sharepoint openstack rclone s3 ssh od4b mssp sia tahoe webdav
• Compression modules: zip 7z
• Encryption modules: aes gpg

Server State Properties

Server state properties

• lastEventId : 474
• lastDataUpdateId : 50
• lastNotificationUpdateId : 16
• estimatedPauseEnd : 0001-01-01T00:00:00
• activeTask :
• programState : Running
• lastErrorMessage :
• connectionState : connected
• xsfrerror : false
• connectionAttemptTimer : 0
• failedConnectionAttempts : 0
• lastPgEvent :
• updaterState : Waiting
• updatedVersion :
• updateReady : false
• updateDownloadProgress : 0
• proposedSchedule : [{“Item1”:“6”,“Item2”:“2019-12-12T13:00:00Z”},{“Item1”:“5”,“Item2”:“2019-12-13T02:00:00Z”},{“Item1”:“1”,“Item2”:“2019-12-13T03:00:00Z”}]
• schedulerQueueIds :
• pauseTimeRemain : 0

[greg.ewing]

Seems we are not alone… here are 3 other related posts I found, with no responses as yet:

Backup fails with onedrive V2 - Object reference not set to an instance of an object

Hi there, my backup fails with apparent systems issue. Connection to onedrive works, some uploads as well. Any suggestions? pls let me know which other information is required. Tried complete reinstall, windows checks / updates, .net reinstallation… Best Timmo System.NullReferenceException: Object reference not set to an instance of an object. at Duplicati.Library.Main.Volumes.BlockVolumeWriter.AddBlock(String hash, Byte data, Int32 offset, Int32 size, CompressionHint hint) at Duplicati.L…

Broken backup / Object reference not set to an instance of an object / More

Hi All, I really like Duplicati but have pretty often errors while backuping data. One thing about which this post is about happened just yesterday. I have a large set of photos (about 450GB), which take about two weeks to upload. After uploading for about 10 days, I had to restart my server and therefore interrupted the backup. So far everything went fine. While the backup was running, I added, changed, removed files of the backuped folder. After rebooting, I restarted the backup and it found …

Backups fail with error: Object reference not set to an instance of an object

For rookies like me, here is what the delete command looked like for my situation: [Selection_062] My first attempts at running the command were flawed by the fact that I cleared out too many of the advanced options. I needed to keep in the dppath and passphrase options. I also recommend using the --dry-run option first to make sure the command will delete what you think it will! The command logs looked like this for anyone curious: Jan 10, 2019 10:00 PM: Result DeletedSets: [ Item1: 7…

[greg.ewing]

I’ve noticed that if I start with a small backup set, that I don’t get this error. If I grow the size of the backup set by adding files/folders into the configuration, then I don’t get this error. However if I add too many files, or too much data to the backup set then I start getting this error again.

I’m not clear on whether the problem comes when I add too many files, or too much in terms of the volume of data, or if its time elapsed sending the data to OneDrive, but I felt it important to post my findings.

So I think i’ll be able to grow to the full size of the data that I need backed up, but its a problem that I have to manually grow the backup set (200 Gig in chunks is likely to be a lot of chunks!)

Please let me know if there is any other information you would like me to test for, or logs I can post.

[Peter_Bielik]

As i wrote, i am trying to upload 16GB of several folders. I tested same way - manually increased backup set by adding folders- only difference to greg.ewing is that it collapsed everytime. I tested changed order of uploaded folder, still same.
On Onedrive Bussines in company it works nice, also tested with recovery from backup.
Just onedrive personal it doesnt work as expected

[ts678]

I started looking into this yesterday, but didn’t have a comment until today’s similar ending. I suggest:

@ts678

What does live log show leading up to the failure? I’d suggest About → Show log → Live → Retry

–log-file and –log-file-log-level=retry can be set for unattended capture, if you prefer to log that way.

OneDrive also has a somewhat short timeout of 100 seconds, and I wonder if the work link runs faster.
–http-operation-timeout can increase it, if that turns out to be the problem (the logs above may reveal).

[greg.ewing]

So I gave it a few months and I tried this again and it has been working flawlessly for the past couple of weeks.

I’m mystified as to what changed, I’m only sorry that I didn’t see the reply above until now as I may have been able to provide some interesting diagnostics.