Jottacloud Error 401 (Unauthorized)

Please test today’s Canary. It replaces the 3 DLL workaround posted above that some were using.
There are later potential Jottacloud changes, but this is the change in-but-unreleased since Aug 7.

@ts678
Once this particular bug is known to be rooted out, could you consider changing the forum configuration to close automatically the threads without changes since one month ? This kind of eternal threads that have no relation to the original first post are tiresome - even impossible - to read, and quite often can be used by spammers. It may be that you don’t have the necessary rights of course.

Even though this topic is an example of an ultra-long one, I’m not sure it’s the place to discuss policy.
Got a sample site that does this? Closing topics could lead to topic proliferation which may be worse.
Information gets spread across lots of topics (making a mess), instead of down one (making a mess).

I think the Mar 2022 return of activity here actually fits this original post and topic title well, doesn’t it?
Possibly it could have been forked then, but you’d still have May 2022 to April 2023 on the same bug.

If we can get to faster fixes, that would help shorten long topics, but forum is still a poor issue tracker.
What to do about antique GitHub Issues is another question, but also doesn’t belong under this topic.

Let’s Encrypt forum

this kind of feature is best used with forums with high level of complaints with repetitive subjects, such as ‘can’t renew certificate’, that can potentially lead to hundreds of ‘me too’ follow-ups although a generic problem can happen for many different reasons.
For Duplicati, it could be ‘cannot backup’. It’s tidier when new threads are created because otherwise opportunistic posters feel free to not post any details (‘I have the same problem !’ is the whole of the problem report).

If the thread is continuously kept alive, it’s usually the same problem. It’s always possible to bump a post by editing it if one still cares about it.

And yes I know that’s off topic but it’s the whole point that long threads always get off topic :slight_smile:

Does anybody on Jottacloud have feedback from the below April 10 requests or from May 25 Beta?

Jottacloud backend oauth authentication #4699 was merged in on June 12, 2022.
Disable automatic use of v2 authid for Jottacloud #4779 was merged in on Aug 7, 2022.
2.0.6.105_canary_2023-04-09 made both of them available to any willing to run Canary.

One disappointing report on Beta is below. Anyone else have updates on Duplicati or rclone method?

i am using Jottacloud and its running great on my mac
currently running 2.0.7.2_canary_2023-05-25

1 Like

Im also running the canary version in docker on linux, it’s working great for me.

1 Like

How much data are we talking about?

I’d guess it failed for me around the 1TB mark, maybe a bit less.

Jotta still going strong here, amount to backup is totally 20 ish tb. Now I’m at maybe 6.

Hmm… What else could be different? What is your up/down speed like? I’m on gigabit.

Yep, and two different servers backing up.

For what it’s worth I didn’t charge the key, rclone uses the same one.

Maybe the issue is that Duplicati doesn’t re-authenticate when needed. Every call to rclone starts a new session.

After two days of backup i now got "The remote server returned an error: (500) Internal Server Error. (The remote server returned an error: Then when i try to start it again it comes “Failed to authorize using the OAuth service: Server error. If the problem persists, try generating a new authid token from: https://duplicati-oauth-handler.appspot.com?type=jottacloud:woozy_face:

(both servers)

One of my servers was running “old” duplicati V. maybe that was the problem? anyway i continue now with fresh keys, so lets se how it goes…

What does key mean here? If it means AuthID, rclone doesn’t use that.

I’m not following the thought here even after peeking at the rclone code.

Are you talking about 1 TB uploaded (unlikely unless it’s a new backup), or 1 TB seen another way? Finding out the uploaded amount after a failure could be guessed at by file dates on Jottacloud files.

I hope both of you have a large blocksize. The default 100 KB is good for about a 100 GB backup…
Same question here – what do 20 and 6 TB mean? A non-initial backup uploads only changed data.

Attempting to find what makes Jottacloud do that saw mostly rclone issues, some including data loss. Their support was not being responsive, which is sort of understandable, as this isn’t their software…
You’re certainly welcome to ask, but might have more traction if they actually published an API to use.

Jottacloud does still fail on latest canary. :confused:

Since I am using Duplicati on QNAP as qkpg I had to wait for an update.
I somehow fucked up the update and had to restore the databases from Jottacloud.

So, since three days I am constantly restoring databases and making backups from/to Jottacloud without any issues for ~14TB across different jobs.

2 Likes

A big backup (~11TB, probably ~500GB new data) failed today because of a socket error.
The token still works, so this seems to be a new problem.
Anybody encountered it yet?

System.AggregateException: One or more errors occurred. (The socket has been shut down (The socket has been shut down) (One or more errors occurred. (The socket has been shut down))) ---> System.AggregateException: The socket has been shut down (The socket has been shut down) (One or more errors occurred. (The socket has been shut down)) ---> System.Net.Sockets.SocketException: The socket has been shut down
  at Duplicati.Library.Main.Operation.Backup.BackendUploader.<Run>b__13_0 (<>f__AnonymousType12`1[<Input>j__TPar] self) [0x005ac] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at Duplicati.Library.Main.Operation.Backup.BackendUploader.<Run>b__13_0 (<>f__AnonymousType12`1[<Input>j__TPar] self) [0x007d7] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at CoCoL.AutomationExtensions.RunTask[T] (T channels, System.Func`2[T,TResult] method, System.Boolean catchRetiredExceptions) [0x000d5] in <9a758ff4db6c48d6b3d4d0e5c2adf6d1>:0 
  at Duplicati.Library.Main.Operation.BackupHandler.FlushBackend (Duplicati.Library.Main.BackupResults result, CoCoL.IWriteChannel`1[T] uploadtarget, System.Threading.Tasks.Task uploader) [0x000f2] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at Duplicati.Library.Main.Operation.BackupHandler.RunAsync (System.String[] sources, Duplicati.Library.Utility.IFilter filter, System.Threading.CancellationToken token) [0x00cb2] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
   --- End of inner exception stack trace ---
  at Duplicati.Library.Main.Operation.BackupHandler.RunAsync (System.String[] sources, Duplicati.Library.Utility.IFilter filter, System.Threading.CancellationToken token) [0x01048] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
   --- End of inner exception stack trace ---
  at CoCoL.ChannelExtensions.WaitForTaskOrThrow (System.Threading.Tasks.Task task) [0x0005d] in <9a758ff4db6c48d6b3d4d0e5c2adf6d1>:0 
  at Duplicati.Library.Main.Operation.BackupHandler.Run (System.String[] sources, Duplicati.Library.Utility.IFilter filter, System.Threading.CancellationToken token) [0x00009] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at Duplicati.Library.Main.Controller+<>c__DisplayClass14_0.<Backup>b__0 (Duplicati.Library.Main.BackupResults result) [0x0004b] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at Duplicati.Library.Main.Controller.RunAction[T] (T result, System.String[]& paths, Duplicati.Library.Utility.IFilter& filter, System.Action`1[T] method) [0x0026f] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at Duplicati.Library.Main.Controller.Backup (System.String[] inputsources, Duplicati.Library.Utility.IFilter filter) [0x00074] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at Duplicati.Server.Runner.Run (Duplicati.Server.Runner+IRunnerData data, System.Boolean fromQueue) [0x00349] in <306c32faec924783a772c3698ead5f62>:0 
---> (Inner Exception #0) System.AggregateException: The socket has been shut down (The socket has been shut down) (One or more errors occurred. (The socket has been shut down)) ---> System.Net.Sockets.SocketException: The socket has been shut down
  at Duplicati.Library.Main.Operation.Backup.BackendUploader.<Run>b__13_0 (<>f__AnonymousType12`1[<Input>j__TPar] self) [0x005ac] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at Duplicati.Library.Main.Operation.Backup.BackendUploader.<Run>b__13_0 (<>f__AnonymousType12`1[<Input>j__TPar] self) [0x007d7] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at CoCoL.AutomationExtensions.RunTask[T] (T channels, System.Func`2[T,TResult] method, System.Boolean catchRetiredExceptions) [0x000d5] in <9a758ff4db6c48d6b3d4d0e5c2adf6d1>:0 
  at Duplicati.Library.Main.Operation.BackupHandler.FlushBackend (Duplicati.Library.Main.BackupResults result, CoCoL.IWriteChannel`1[T] uploadtarget, System.Threading.Tasks.Task uploader) [0x000f2] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at Duplicati.Library.Main.Operation.BackupHandler.RunAsync (System.String[] sources, Duplicati.Library.Utility.IFilter filter, System.Threading.CancellationToken token) [0x00cb2] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
   --- End of inner exception stack trace ---
  at Duplicati.Library.Main.Operation.BackupHandler.RunAsync (System.String[] sources, Duplicati.Library.Utility.IFilter filter, System.Threading.CancellationToken token) [0x01048] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
---> (Inner Exception #0) System.Net.Sockets.SocketException (0x80004005): The socket has been shut down
  at Duplicati.Library.Main.Operation.Backup.BackendUploader.<Run>b__13_0 (<>f__AnonymousType12`1[<Input>j__TPar] self) [0x005ac] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at Duplicati.Library.Main.Operation.Backup.BackendUploader.<Run>b__13_0 (<>f__AnonymousType12`1[<Input>j__TPar] self) [0x007d7] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at CoCoL.AutomationExtensions.RunTask[T] (T channels, System.Func`2[T,TResult] method, System.Boolean catchRetiredExceptions) [0x000d5] in <9a758ff4db6c48d6b3d4d0e5c2adf6d1>:0 
  at Duplicati.Library.Main.Operation.BackupHandler.FlushBackend (Duplicati.Library.Main.BackupResults result, CoCoL.IWriteChannel`1[T] uploadtarget, System.Threading.Tasks.Task uploader) [0x000f2] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at Duplicati.Library.Main.Operation.BackupHandler.RunAsync (System.String[] sources, Duplicati.Library.Utility.IFilter filter, System.Threading.CancellationToken token) [0x00cb2] in <ff3b636831af46889c4f1bdb0f8f446c>:0 <---

---> (Inner Exception #1) System.AggregateException: One or more errors occurred. (The socket has been shut down) ---> System.Net.Sockets.SocketException: The socket has been shut down
  at Duplicati.Library.Main.Operation.Backup.BackendUploader.<Run>b__13_0 (<>f__AnonymousType12`1[<Input>j__TPar] self) [0x005ac] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at Duplicati.Library.Main.Operation.Backup.BackendUploader.<Run>b__13_0 (<>f__AnonymousType12`1[<Input>j__TPar] self) [0x007d7] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at CoCoL.AutomationExtensions.RunTask[T] (T channels, System.Func`2[T,TResult] method, System.Boolean catchRetiredExceptions) [0x000d5] in <9a758ff4db6c48d6b3d4d0e5c2adf6d1>:0 
  at Duplicati.Library.Main.Operation.BackupHandler.FlushBackend (Duplicati.Library.Main.BackupResults result, CoCoL.IWriteChannel`1[T] uploadtarget, System.Threading.Tasks.Task uploader) [0x000f2] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at Duplicati.Library.Main.Operation.BackupHandler.RunAsync (System.String[] sources, Duplicati.Library.Utility.IFilter filter, System.Threading.CancellationToken token) [0x00cb2] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
   --- End of inner exception stack trace ---
---> (Inner Exception #0) System.Net.Sockets.SocketException (0x80004005): The socket has been shut down
  at Duplicati.Library.Main.Operation.Backup.BackendUploader.<Run>b__13_0 (<>f__AnonymousType12`1[<Input>j__TPar] self) [0x005ac] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at Duplicati.Library.Main.Operation.Backup.BackendUploader.<Run>b__13_0 (<>f__AnonymousType12`1[<Input>j__TPar] self) [0x007d7] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at CoCoL.AutomationExtensions.RunTask[T] (T channels, System.Func`2[T,TResult] method, System.Boolean catchRetiredExceptions) [0x000d5] in <9a758ff4db6c48d6b3d4d0e5c2adf6d1>:0 
  at Duplicati.Library.Main.Operation.BackupHandler.FlushBackend (Duplicati.Library.Main.BackupResults result, CoCoL.IWriteChannel`1[T] uploadtarget, System.Threading.Tasks.Task uploader) [0x000f2] in <ff3b636831af46889c4f1bdb0f8f446c>:0 
  at Duplicati.Library.Main.Operation.BackupHandler.RunAsync (System.String[] sources, Duplicati.Library.Utility.IFilter filter, System.Threading.CancellationToken token) [0x00cb2] in <ff3b636831af46889c4f1bdb0f8f446c>:0 <---
<---
<---