)
at System.Threading.Tasks.Task`1.InnerInvoke()
at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)
--- End of stack trace from previous location ---
at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(Thread threadPoolThread, ExecutionContext executionContext, ContextCallback callback, Object state)
at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot, Thread threadPoolThread)
--- End of stack trace from previous location ---
at Duplicati.Library.Utility.Utility.CopyStreamAsync(Stream source, Stream target, Boolean tryRewindSource, CancellationToken cancelToken, Byte[] buf)
at Duplicati.Library.Utility.Utility.CopyStreamAsync(Stream source, Stream target, CancellationToken cancelToken)
at Duplicati.Library.Backend.MicrosoftGraphBackend.GetAsync(String remotename, Stream stream, CancellationToken cancelToken)
at Duplicati.Library.Main.BackendManager.DoGetFile(FileEntryItem item, IEncryption useDecrypter, CancellationToken cancellationToken)
at Duplicati.Library.Main.BackendManager.DoGetAsync(FileEntryItem item, CancellationToken cancellationToken)
at Duplicati.Library.Utility.Utility.Await(Task task)
at Duplicati.Library.Main.BackendManager.ThreadRun()
```
---
### Author:  [@ollibraun](https://forum.duplicati.com/u/ollibraun)
#### Post date: [December 14, 2024, 6:54am UTC](https://forum.duplicati.com/t/release-2-1-0-102-canary-2024-12-12/19669/8 "2024-12-14T06:54:15Z")
I was just wondering if cancellation requests that were registered at some point in the past are suddenly being processed. Past means - in an older version, and despite server restarts in the meantime.
---
### Author:  [@ollibraun](https://forum.duplicati.com/u/ollibraun)
#### Post date: [December 14, 2024, 7:29am UTC](https://forum.duplicati.com/t/release-2-1-0-102-canary-2024-12-12/19669/9 "2024-12-14T07:29:27Z")
At the end of a backup job, during the check:
---
### Author:  [@Folgore101](https://forum.duplicati.com/u/Folgore101)
#### Post date: [December 14, 2024, 10:54am UTC](https://forum.duplicati.com/t/release-2-1-0-102-canary-2024-12-12/19669/10 "2024-12-14T10:54:25Z")
It tells me there is a version 2.1.0.103 but it can’t find it.
---
### Author:  [@Hannes3](https://forum.duplicati.com/u/Hannes3)
#### Post date: [December 14, 2024, 11:11am UTC](https://forum.duplicati.com/t/release-2-1-0-102-canary-2024-12-12/19669/11 "2024-12-14T11:11:44Z")
The same here:
[Not Found](https://updates.duplicati.com/canary/duplicati-2.1.0.103_canary_2024-12-12-win-x64-gui.msi)
There is something strange in the name of the subdirectory (çanary)
---
### Author:  [@ts678](https://forum.duplicati.com/u/ts678)
#### Post date: [December 14, 2024, 12:24pm UTC](https://forum.duplicati.com/t/release-2-1-0-102-canary-2024-12-12/19669/12 "2024-12-14T12:24:21Z")
I’m still a Canary behind this one, but it looks like the CLI updater broke.
Also confirming a similar issue with the mystery release announcement.
```plaintext
C:\Duplicati\duplicati-2.0.9.106_canary_2024-09-03-win-x64-gui>Duplicati.CommandLine.AutoUpdater check
New version is available: Duplicati v2.1.0.103 - Canary
C:\Duplicati\duplicati-2.0.9.106_canary_2024-09-03-win-x64-gui>cd ..\*2.0.9.107_*
C:\Duplicati\duplicati-2.0.9.107_canary_2024-09-11-win-x64-gui>Duplicati.CommandLine.AutoUpdater check
Error detected: System.NullReferenceException: Object reference not set to an instance of an object.
at Duplicati.Library.Utility.HttpClientExtensions.DownloadFile(HttpClient client, HttpRequestMessage request, String filename, Action`1 progressReportingAction, CancellationToken cancellationToken)
at Duplicati.Library.AutoUpdater.UpdaterManager.CheckForUpdate(ReleaseType channel)
Error detected: System.NullReferenceException: Object reference not set to an instance of an object.
at Duplicati.Library.Utility.HttpClientExtensions.DownloadFile(HttpClient client, HttpRequestMessage request, String filename, Action`1 progressReportingAction, CancellationToken cancellationToken)
at Duplicati.Library.AutoUpdater.UpdaterManager.CheckForUpdate(ReleaseType channel)
No updates found
C:\Duplicati\duplicati-2.0.9.107_canary_2024-09-11-win-x64-gui>
```
EDIT:
```plaintext
C:\Duplicati\duplicati-2.1.0.102_canary_2024-12-12-win-x64-gui>Duplicati.CommandLine.AutoUpdater check
Error detected: System.NullReferenceException: Object reference not set to an instance of an object.
at Duplicati.Library.Utility.HttpClientExtensions.DownloadFile(HttpClient client, HttpRequestMessage request, String filename, Action`1 progressReportingAction, CancellationToken cancellationToken)
at Duplicati.Library.AutoUpdater.UpdaterManager.CheckForUpdate(ReleaseType channel)
Error detected: System.NullReferenceException: Object reference not set to an instance of an object.
at Duplicati.Library.Utility.HttpClientExtensions.DownloadFile(HttpClient client, HttpRequestMessage request, String filename, Action`1 progressReportingAction, CancellationToken cancellationToken)
at Duplicati.Library.AutoUpdater.UpdaterManager.CheckForUpdate(ReleaseType channel)
No updates found
C:\Duplicati\duplicati-2.1.0.102_canary_2024-12-12-win-x64-gui>cd ..\*2.1.0.2_*
C:\Duplicati\duplicati-2.1.0.2_beta_2024-11-29-win-x64-gui>Duplicati.CommandLine.AutoUpdater check
Error detected: System.NullReferenceException: Object reference not set to an instance of an object.
at Duplicati.Library.Utility.HttpClientExtensions.DownloadFile(HttpClient client, HttpRequestMessage request, String filename, Action`1 progressReportingAction, CancellationToken cancellationToken)
at Duplicati.Library.AutoUpdater.UpdaterManager.CheckForUpdate(ReleaseType channel)
Error detected: System.NullReferenceException: Object reference not set to an instance of an object.
at Duplicati.Library.Utility.HttpClientExtensions.DownloadFile(HttpClient client, HttpRequestMessage request, String filename, Action`1 progressReportingAction, CancellationToken cancellationToken)
at Duplicati.Library.AutoUpdater.UpdaterManager.CheckForUpdate(ReleaseType channel)
No updates found
C:\Duplicati\duplicati-2.1.0.2_beta_2024-11-29-win-x64-gui>
```
`https://updates.duplicati.com/canary/latest-v2.manifest` does indeed talk about 2.1.0.103.
---
### Author:  [@Hannes3](https://forum.duplicati.com/u/Hannes3)
#### Post date: [December 14, 2024, 2:15pm UTC](https://forum.duplicati.com/t/release-2-1-0-102-canary-2024-12-12/19669/13 "2024-12-14T14:15:21Z")
I have the same problem. It happens after a period of “sleep”.
(no windows service)
---
### Author:  [@ollibraun](https://forum.duplicati.com/u/ollibraun)
#### Post date: [December 15, 2024, 2:20pm UTC](https://forum.duplicati.com/t/release-2-1-0-102-canary-2024-12-12/19669/14 "2024-12-15T14:20:28Z")
So, here’s what it looks like for me (Windows service, destination almost always SharePoint, upgrade from 2.1.0.101 to 2.1.0.102):
Some jobs work. Others no longer work, and you get a message saying that a task has been canceled, whatever that means – I didn’t click Cancel):
---
### Author:  [@ts678](https://forum.duplicati.com/u/ts678)
#### Post date: [December 15, 2024, 2:29pm UTC](https://forum.duplicati.com/t/release-2-1-0-102-canary-2024-12-12/19669/15 "2024-12-15T14:29:35Z")
> [@ollibraun](#):
>
> Some jobs work. Others no longer work
> [@ollibraun](#):
>
> destination almost always SharePoint
Is there a relationship between that and this problem? Unfortunately, I don’t have SharePoint.
EDIT:
> [@ollibraun](#):
>
> ` at Duplicati.Library.Backend.MicrosoftGraphBackend.GetAsync(String remotename, Stream stream, CancellationToken cancelToken)`
shows it failing on some MS destination (now revealed). Does it fail similarly on other storage?
---
### Author:  [@ollibraun](https://forum.duplicati.com/u/ollibraun)
#### Post date: [December 15, 2024, 2:59pm UTC](https://forum.duplicati.com/t/release-2-1-0-102-canary-2024-12-12/19669/16 "2024-12-15T14:59:02Z")
Approximate numbers: I have about 20 targets, 75 percent of which are SharePoint or OneDrive.
The non-Microsoft targets work, but most of the Microsoft targets work too.
Only five Microsoft targets don’t work.
Unfortunately, this is not enough to make a statistical statement as to whether it only affects MS targets.
What does “TaskCanceledException: A task was canceled.” mean?
---
### Author:  [@ts678](https://forum.duplicati.com/u/ts678)
#### Post date: [December 15, 2024, 3:39pm UTC](https://forum.duplicati.com/t/release-2-1-0-102-canary-2024-12-12/19669/17 "2024-12-15T15:39:23Z")
> [@ollibraun](#):
>
> What does “TaskCanceledException: A task was canceled.” mean?
It’s an internal thing. Single process has many tasks inside it. Microsoft:
[Task cancellation](https://learn.microsoft.com/en-us/dotnet/standard/parallel-programming/task-cancellation) (but I’m guessing a bit because I don’t write the code)
[How to: Cancel a Task and Its Children](https://learn.microsoft.com/en-us/dotnet/standard/parallel-programming/how-to-cancel-a-task-and-its-children) links to [TaskCanceledException](https://learn.microsoft.com/en-us/dotnet/api/system.threading.tasks.taskcanceledexception?view=net-8.0)
> [@ollibraun](#):
>
> Only five Microsoft targets don’t work.
Still looking for anything they might share. You can certainly try more tests with them.
Easy is `Verify files` button, which (in addition to DB tests) downloads a file sample.
Harder would be GUI `Export As Command-line` then run BackendTool `get` some files.
[BackendTester](https://docs.duplicati.com/duplicati-programs/command-line-interface-cli-1/backendtester) is automatic, but you’d have to modify the URL to use an empty folder.
Ultimately this is going to need dev help, but we can poke around to get the first clues.
---
### Author:  [@ollibraun](https://forum.duplicati.com/u/ollibraun)
#### Post date: [December 16, 2024, 7:25am UTC](https://forum.duplicati.com/t/release-2-1-0-102-canary-2024-12-12/19669/18 "2024-12-16T07:25:06Z")
In between:
1. I think it only happens when compacting SharePoint backups.
2. On a device with three non-working jobs, I went back to.101. This works for backing up, compacting and rebuilding the database.
Here is the error that apparently occurs during compacting:
---
### Author:  [@kenkendk](https://forum.duplicati.com/u/kenkendk)
#### Post date: [December 16, 2024, 10:07pm UTC](https://forum.duplicati.com/t/release-2-1-0-102-canary-2024-12-12/19669/19 "2024-12-16T22:07:58Z")
> [@Hannes3](#):
>
> I have the same problem. It happens after a period of “sleep”.
And @Taomyn , I have created [an issue for the crash message](https://github.com/duplicati/duplicati/issues/5776).
> [@ollibraun](#):
>
> ```plaintext
> 14. Dez. 2024 07:49: Operation Get with file duplicati-b8f3bd1d27b2f4bed8b609b283f1e9cee.dblock.zip attempt 1 of 5 failed with message: A task was canceled.
> System.Threading.Tasks.TaskCanceledException: A task was canceled.
> at Duplicati.StreamUtil.TimeoutObservingStream.WriteImplAsync(Byte[] buffer, Int32 offset, Int32 count, CancellationToken cancellationToken)
>
> ```
This looks like a problem with the new timeout detection feature. Looking at the code, it might be caused by the retry-backoff feature in SharePoint. If there is a retry wait period, nothing will happen in this period, so the timeout will kick in.
Can you try to set the option `--read-write-timeout=1h` to allow it to wait 1 hour (as opposed to 30s) ? I would imagine this would fix the issue. I have created [an issue to track the premature timeout](https://github.com/duplicati/duplicati/issues/5777).
> [@ollibraun](#):
>
> What does “TaskCanceledException: A task was canceled.” mean?
In short it means: a task was started, but then cancelled (read: stopped) before it could complete.
---
### Author:  [@ollibraun](https://forum.duplicati.com/u/ollibraun)
#### Post date: [December 17, 2024, 5:27am UTC](https://forum.duplicati.com/t/release-2-1-0-102-canary-2024-12-12/19669/20 "2024-12-17T05:27:35Z")
Unfortunately, the read-write-timeout option does not change this behavior. It may well be that the abort message always comes after 30 seconds, even if the option is set to one hour.
[Next page](https://forum.duplicati.com/t/release-2-1-0-102-canary-2024-12-12/19669.md?page=2)