Failed: The remote server returned an error: (403) Forbidden Google Drive

[LBDtyfCI]

Hello,

Getting the following error trying to backup on Google Drive:

Details: System.Net.WebException: The remote server returned an error: (403) Forbidden.
   at Duplicati.Library.Main.Operation.BackupHandler.HandleFilesystemEntry(ISnapshotService snapshot, BackendManager backend, String path, FileAttributes attributes)
   at Duplicati.Library.Main.Operation.BackupHandler.RunMainOperation(ISnapshotService snapshot, BackendManager backend)
   at Duplicati.Library.Main.Operation.BackupHandler.Run(String[] sources, IFilter filter)
   at Duplicati.Library.Main.Controller.<>c__DisplayClass16_0.<Backup>b__0(BackupResults result)
   at Duplicati.Library.Main.Controller.RunAction[T](T result, String[]& paths, IFilter& filter, Action`1 method)

[JonMikelV]

Welcome to the forum, @LBDtyfCI!

Is this a new backup or one that used to work?

[LBDtyfCI]

This backup used to work and it suddenly stopped working with this error. I re-created the AuthID same result. I created another backup with the exact same settings but different directory on Google Drive and same result. I’m at a loss.

[JonMikelV]

I think there’s a general issue with Google Drive going on as others have reported previously working backups suddenly failing.

Since I don’t know of anything changing on the Duplicati side my guess is something has changed on Google’s side.

Backup to Google Drive now failing

I had a backup to Google Drive working. It stopped working after I was trying to get the SMTP send mail advanced option working (I never did get it to work). But now I can’t get any backups to Google Drive to work. Using the test connection, I get a “GetResponse time out” error. I have tried recreating the AuthID, but I don’t know what else to try. Here is the log from last nights attempt to backup: Operation List with file attempt 5 of 5 failed with message: GetResponse timed out System.N…

Unfortunately, if that’s correct it means we don’t yet have a way to resolve the issue.

[kenkendk]

I have been contacted by Google, saying that I need to give them some information relating to the use of OAuth. I have sent them most of it, but I do not yet have a privacy policy document, so Duplicati appears as “unverified”.

The messages from Google do not indicate that there should be any effect on the service, so it might be unrelated.

[SunToday]

Hello All,
my first post,
This may help someone - my apologies if it’s already been mentioned.
Duplicati oath with gdrive works ok in a personal gmail account.
However, using G-Suite for Business/Education oath is not allowed to access gdrive by default.
In the G-Suite admin console (admin. permissions required), click on,
Admin,apps,gsuite, gdrive,general settings, Features and Applications,
check on the right and change OU if required
Tick the box for DRIVE SDK
Save the change and test.

I think Google made a change to this option (some time last yesr?) which may have caused the problem as I’m pretty sure it used to work sometime ago.

[JonMikelV]

Hello @SunToday, and welcome to the forum!

My memory isn’t great, but I don’t recall reading anything about personal gmail vs g-suite stuff so thanks for sharing your workaround!

[Paolo_Ucchino]

Hi
I see it’s an old post but the problem comes back to me with Google. I have a business account.

Also I see a strange thing in the logs: attempt 6 of 5 failed with message: The remote server returned an error: (403) Forbidden.

This 6 of 5 is weird.

Also after the error on the GUI (a message in red) it seems that duplicati continue to work but without traffic on the network. The throughtput remains at 1bytes / sec strangely.

I add the log I got :

---

2020-10-02 04:03:21 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Retrying: ppu-b3e6ae2eacbcc451f86a3e1a0d992dc4a.dblock.zip.aes (50,00 MB)
2020-10-02 04:03:21 +02 - [Retry-Duplicati.Library.Main.Operation.Backup.BackendUploader-RetryPut]: Operation Put with file ppu-i06c1df3c677d4709a26ea14bf312d686.dindex.zip.aes attempt 6 of 5 failed with message: The remote server returned an error: (403) Forbidden.
System.Net.WebException: The remote server returned an error: (403) Forbidden.
at System.Net.HttpWebRequest.GetResponseFromData (System.Net.WebResponseStream stream, System.Threading.CancellationToken cancellationToken) [0x0017e] in :0
at System.Net.HttpWebRequest.RunWithTimeoutWorker[T] (System.Threading.Tasks.Task1[TResult] workerTask, System.Int32 timeout, System.Action abort, System.Func1[TResult] aborted, System.Threading.CancellationTokenSource cts) [0x00118] in :0
at Duplicati.Library.Utility.AsyncHttpRequest+AsyncWrapper.GetResponseOrStream () [0x0004d] in :0
at Duplicati.Library.Utility.AsyncHttpRequest.GetResponse () [0x00044] in :0
at Duplicati.Library.JSONWebHelper.GetResponse (Duplicati.Library.Utility.AsyncHttpRequest req, System.Object requestdata) [0x000c9] in <13d5e7013bfa43fea2736c6f372a6cef>:0
at Duplicati.Library.JSONWebHelper.ReadJSONResponse[T] (Duplicati.Library.Utility.AsyncHttpRequest req, System.Object requestdata) [0x00000] in <13d5e7013bfa43fea2736c6f372a6cef>:0
at Duplicati.Library.JSONWebHelper.GetJSONData[T] (System.String url, System.Action1[T] setup, System.Action1[T] setupbodyreq) [0x00024] in <13d5e7013bfa43fea2736c6f372a6cef>:0
at Duplicati.Library.Backend.GoogleDrive.GoogleDrive+d__42.MoveNext () [0x000fd] in <07138b3eb08a4b7d84cf8c11a8c6e95c>:0
at Duplicati.Library.Backend.GoogleDrive.GoogleDrive+d__17.MoveNext () [0x001a1] in <07138b3eb08a4b7d84cf8c11a8c6e95c>:0
at Duplicati.Library.Backend.GoogleDrive.GoogleDrive.PutAsync (System.String remotename, System.IO.Stream stream, System.Threading.CancellationToken cancelToken) [0x001c9] in <07138b3eb08a4b7d84cf8c11a8c6e95c>:0
at Duplicati.Library.Main.Operation.Backup.BackendUploader.DoPut (Duplicati.Library.Main.Operation.Common.BackendHandler+FileEntryItem item, Duplicati.Library.Interface.IBackend backend, System.Threading.CancellationToken cancelToken) [0x00426] in <8f1de655bd1240739a78684d845cecc8>:0
at Duplicati.Library.Main.Operation.Backup.BackendUploader+<>c__DisplayClass17_0.b__0 () [0x0010a] in <8f1de655bd1240739a78684d845cecc8>:0
at Duplicati.Library.Main.Operation.Backup.BackendUploader.DoWithRetry (System.Func1[TResult] method, Duplicati.Library.Main.Operation.Common.BackendHandler+FileEntryItem item, Duplicati.Library.Main.Operation.Backup.BackendUploader+Worker worker, System.Threading.CancellationToken cancelToken) [0x0017c] in <8f1de655bd1240739a78684d845cecc8>:0 2020-10-02 04:03:21 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Failed: ppu-i06c1df3c677d4709a26ea14bf312d686.dindex.zip.aes (39,12 KB) 2020-10-02 04:03:21 +02 - [Retry-Duplicati.Library.Main.Operation.Backup.BackendUploader-RetryPut]: Operation Put with file ppu-ibda2a3d6e4c54956aa2d9292278de67d.dindex.zip.aes attempt 5 of 5 failed with message: The remote server returned an error: (403) Forbidden. System.Net.WebException: The remote server returned an error: (403) Forbidden. at System.Net.HttpWebRequest.GetResponseFromData (System.Net.WebResponseStream stream, System.Threading.CancellationToken cancellationToken) [0x0017e] in <a85c1a570f9a4f9f9c3d2cfa5504e34f>:0 at System.Net.HttpWebRequest.RunWithTimeoutWorker[T] (System.Threading.Tasks.Task1[TResult] workerTask, System.Int32 timeout, System.Action abort, System.Func1[TResult] aborted, System.Threading.CancellationTokenSource cts) [0x00118] in <a85c1a570f9a4f9f9c3d2cfa5504e34f>:0 at Duplicati.Library.Utility.AsyncHttpRequest+AsyncWrapper.GetResponseOrStream () [0x0004d] in <b0ec73cdc8b845289fe2e9bdf696ccd0>:0 at Duplicati.Library.Utility.AsyncHttpRequest.GetResponse () [0x00044] in <b0ec73cdc8b845289fe2e9bdf696ccd0>:0 at Duplicati.Library.JSONWebHelper.GetResponse (Duplicati.Library.Utility.AsyncHttpRequest req, System.Object requestdata) [0x000c9] in <13d5e7013bfa43fea2736c6f372a6cef>:0 at Duplicati.Library.JSONWebHelper.ReadJSONResponse[T] (Duplicati.Library.Utility.AsyncHttpRequest req, System.Object requestdata) [0x00000] in <13d5e7013bfa43fea2736c6f372a6cef>:0 at Duplicati.Library.JSONWebHelper.GetJSONData[T] (System.String url, System.Action1[T] setup, System.Action1[T] setupbodyreq) [0x00024] in <13d5e7013bfa43fea2736c6f372a6cef>:0 at Duplicati.Library.Backend.GoogleDrive.GoogleDrive+<ListFolder>d__42.MoveNext () [0x000fd] in <07138b3eb08a4b7d84cf8c11a8c6e95c>:0 at Duplicati.Library.Backend.GoogleDrive.GoogleDrive+<List>d__17.MoveNext () [0x001a1] in <07138b3eb08a4b7d84cf8c11a8c6e95c>:0 at Duplicati.Library.Backend.GoogleDrive.GoogleDrive.PutAsync (System.String remotename, System.IO.Stream stream, System.Threading.CancellationToken cancelToken) [0x001c9] in <07138b3eb08a4b7d84cf8c11a8c6e95c>:0 at Duplicati.Library.Main.Operation.Backup.BackendUploader.DoPut (Duplicati.Library.Main.Operation.Common.BackendHandler+FileEntryItem item, Duplicati.Library.Interface.IBackend backend, System.Threading.CancellationToken cancelToken) [0x00426] in <8f1de655bd1240739a78684d845cecc8>:0 at Duplicati.Library.Main.Operation.Backup.BackendUploader+<>c__DisplayClass17_0.<UploadFileAsync>b__0 () [0x0010a] in <8f1de655bd1240739a78684d845cecc8>:0 at Duplicati.Library.Main.Operation.Backup.BackendUploader.DoWithRetry (System.Func1[TResult] method, Duplicati.Library.Main.Operation.Common.BackendHandler+FileEntryItem item, Duplicati.Library.Main.Operation.Backup.BackendUploader+Worker worker, System.Threading.CancellationToken cancelToken) [0x0017c] in <8f1de655bd1240739a78684d845cecc8>:0
2020-10-02 04:03:21 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Retrying: ppu-ibda2a3d6e4c54956aa2d9292278de67d.dindex.zip.aes (17,93 KB)
2020-10-02 04:03:22 +02 - [Retry-Duplicati.Library.Main.Operation.Backup.BackendUploader-RetryPut]: Operation Put with file ppu-b9e7cba319ec9443da9374bc3082c3c78.dblock.zip.aes attempt 6 of 5 failed with message: The remote server returned an error: (403) Forbidden.
System.Net.WebException: The remote server returned an error: (403) Forbidden.
at System.Net.HttpWebRequest.GetResponseFromData (System.Net.WebResponseStream stream, System.Threading.CancellationToken cancellationToken) [0x0017e] in :0
at System.Net.HttpWebRequest.RunWithTimeoutWorker[T] (System.Threading.Tasks.Task1[TResult] workerTask, System.Int32 timeout, System.Action abort, System.Func1[TResult] aborted, System.Threading.CancellationTokenSource cts) [0x00118] in :0
at Duplicati.Library.Utility.AsyncHttpRequest+AsyncWrapper.GetResponseOrStream () [0x0004d] in :0
at Duplicati.Library.Utility.AsyncHttpRequest.GetResponse () [0x00044] in :0
at Duplicati.Library.JSONWebHelper.GetResponse (Duplicati.Library.Utility.AsyncHttpRequest req, System.Object requestdata) [0x000c9] in <13d5e7013bfa43fea2736c6f372a6cef>:0
at Duplicati.Library.JSONWebHelper.ReadJSONResponse[T] (Duplicati.Library.Utility.AsyncHttpRequest req, System.Object requestdata) [0x00000] in <13d5e7013bfa43fea2736c6f372a6cef>:0
at Duplicati.Library.JSONWebHelper.GetJSONData[T] (System.String url, System.Action1[T] setup, System.Action1[T] setupbodyreq) [0x00024] in <13d5e7013bfa43fea2736c6f372a6cef>:0
at Duplicati.Library.Backend.GoogleDrive.GoogleDrive+d__42.MoveNext () [0x000fd] in <07138b3eb08a4b7d84cf8c11a8c6e95c>:0
at Duplicati.Library.Backend.GoogleDrive.GoogleDrive+d__17.MoveNext () [0x001a1] in <07138b3eb08a4b7d84cf8c11a8c6e95c>:0
at Duplicati.Library.Backend.GoogleDrive.GoogleDrive.PutAsync (System.String remotename, System.IO.Stream stream, System.Threading.CancellationToken cancelToken) [0x001c9] in <07138b3eb08a4b7d84cf8c11a8c6e95c>:0
at Duplicati.Library.Main.Operation.Backup.BackendUploader.DoPut (Duplicati.Library.Main.Operation.Common.BackendHandler+FileEntryItem item, Duplicati.Library.Interface.IBackend backend, System.Threading.CancellationToken cancelToken) [0x00426] in <8f1de655bd1240739a78684d845cecc8>:0
at Duplicati.Library.Main.Operation.Backup.BackendUploader+<>c__DisplayClass17_0.b__0 () [0x0010a] in <8f1de655bd1240739a78684d845cecc8>:0
at Duplicati.Library.Main.Operation.Backup.BackendUploader.DoWithRetry (System.Func`1[TResult] method, Duplicati.Library.Main.Operation.Common.BackendHandler+FileEntryItem item, Duplicati.Library.Main.Operation.Backup.BackendUploader+Worker worker, System.Threading.CancellationToken cancelToken) [0x0017c] in <8f1de655bd1240739a78684d845cecc8>:0

[philae]

same situation here! Backup used to work back in time.

[ts678]

@Paolo_Ucchino

the problem comes back to me with Google

@philae

Backup used to work back in time.

Can anyone clarify timing and whether anything changed (especially in Duplicati) when the issue began?
Two people almost simultaneously jumping onto this old topic makes me wonder if Google had an issue.
One issue that Google always has (which you should be careful about) is their 750 GB daily upload limit
Resolve a 403 error: Usage limit exceeded starts a series of paragraphs on why Google might 403 error. There’s some additional information in HTTP response, I think, but Duplicati doesn’t put it in its message.

[philae]

I have two Backup’s with target google drive. But there is just one that return 403 - Forbidden when scheduled automatic. If I launch the Backup manually, it runs through! The other one never have any issues and runs through. So I doubt, that the problem is serverside.

[ts678]

@philae

I have two Backup’s with target google drive

Are they the same Duplicati AuthID on the same account, both created initially to Google Drive (not copied into Google Drive folder from other location – Google has special policies about the handling of such files)?

Are the scheduled and manual backups both using GUI (not CLI), coming from same Duplicati, and so on?
I suppose a way to get more opinions is to run Commandline backup or even try Export As Command-line.

In terms of analysis, it would help to figure out what exact action got the 403 - Forbidden. Easiest is to run About → Show log → Retry where I assume it will fail after retries. You might need to click on failure line.
For CLI (or CLI-in-GUI) you can add console-log-level=retry to get it on screen. Log files are also possible.

The other poster with this problem got their 403 while trying to upload a dindex file, it appears. Could there be any sort of quota problem here? Of course that doesn’t explain manual-versus-scheduled weirdness…

[lcsneil]

Identical problem here. Used to be fine but after a re-install due to machine crash I now have the same problem. TWO Backup’s with target google drive. But there is just one that return 403 - Forbidden when scheduled automatic. If I launch the Backup manually, it runs through!

[philae]

Are they the same Duplicati AuthID on the same account, both created initially to Google Drive (not copied into Google Drive folder from other location – Google has special policies about the handling of such files)?

yes. Both job setup manually and equaly in the gui. no special configurations or CLI. Backup job used to work for years. (and as I mentioned, the other one is still running without any issue.)

Here is my failure log:

System.Net.WebException: The remote server returned an error: (403) Forbidden.
at Duplicati.Library.Main.BackendManager.List()
at Duplicati.Library.Main.Operation.FilelistProcessor.RemoteListAnalysis(BackendManager backend, Options options, LocalDatabase database, IBackendWriter log, String protectedfile)
at Duplicati.Library.Main.Operation.FilelistProcessor.VerifyRemoteList(BackendManager backend, Options options, LocalDatabase database, IBackendWriter log, String protectedfile)
at Duplicati.Library.Main.Operation.BackupHandler.PreBackupVerify(BackendManager backend, String protectedfile)
at Duplicati.Library.Main.Operation.BackupHandler.d__20.MoveNext()
— End of stack trace from previous location where exception was thrown –
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at CoCoL.ChannelExtensions.WaitForTaskOrThrow(Task task)
at Duplicati.Library.Main.Controller.<>c__DisplayClass14_0.b__0(BackupResults result)
at Duplicati.Library.Main.Controller.RunAction[T](T result, String& paths, IFilter& filter, Action`1 method)
at Duplicati.Library.Main.Controller.Backup(String inputsources, IFilter filter)
at Duplicati.Server.Runner.Run(IRunnerData data, Boolean fromQueue)

So it looks in my opinion, that the Exception is thrown by building the containers local and not on remote site?

[ts678]

@philae

thrown by building the containers local and not on remote site?

I’m not certain what you mean. Are you using Docker containers?
I’m also not sure what “building” refers to in the container context.

From an HTTP point of view, a 403 is always from the server site.
From an exception point of view, it’s local response to server 403.
WebException Class is how the response controls the exception.
This is handled by .NET Framework or mono. What OS is used?

@philae

Both job setup manually and equaly in the gui.

Is not clear regarding AuthID. If you went through the create-an-AuthID twice, you got different ones.
I would suggest looking at AuthID to compare, or alternatively please create a new, to see if it helps.
If that doesn’t do it, you can try a Google Drive (full access) login here for testing purposes.
These may go unsupported by Google as having too much access, so it’s safer to not rely on them.

Is this a simple personal Google account, or something more complicated like a business account?

I still do not know why way of GUI-starting matters, but Commandline and CLI tests may give a clue.
Because error was on a list, you can also try Destination Test connection button. It does a list
which you should be able to watch in About → Show log → Live → Retry. 3 get operations follow it.

@philae

same situation here! Backup used to work back in time.

When was the last success? This should be in your job logs, and probably also on your home screen.

@lcsneil

If I launch the Backup manually, it runs through!

Welcome to the forum @lcsneil

So same weird behavior as @philae except you mention a reinstall. @philae any similar changes?
I’m not going to repeat everything to everybody, but please feel free to use same questions and advice.
Everybody please also say what Duplicati version you’re on, what OS, and any clues to what changed.

[LiquidHog]

Hi,

I am also receiving this error but as far as I can tell it’s random.

I deployed a new docker container on October 1st on Unraid running Duplicati version 2.0.5.1_beta_2020-01-18.

I created a backup set with the gui - approximately 25k files/550GB and manually started the backup job via the gui. It was backing up fine and then randomly was interrupted part way through with the 403 error. This happened a couple of times along with a couple of other errors which I think were caused by the 403 error until it finally completed on Oct. 4th. The next scheduled job (Oct 5th) failed with the 403 error. Oct 6th it ran fine. This morning it failed with the 403 error.

Here is the last error I received:>

Oct 7, 2020 1:02 AM: Failed while executing "Backup" with id: 1
System.Net.WebException: The remote server returned an error: (403) Forbidden.
  at System.Net.HttpWebRequest.GetResponseFromData (System.Net.WebResponseStream stream, System.Threading.CancellationToken cancellationToken) [0x00146] in <91935ad653254a93b9d73a9f8f2f7a2d>:0 
  at System.Net.HttpWebRequest.RunWithTimeoutWorker[T] (System.Threading.Tasks.Task`1[TResult] workerTask, System.Int32 timeout, System.Action abort, System.Func`1[TResult] aborted, System.Threading.CancellationTokenSource cts) [0x000f8] in <91935ad653254a93b9d73a9f8f2f7a2d>:0 
  at Duplicati.Library.Main.BackendManager.List () [0x00049] in <8f1de655bd1240739a78684d845cecc8>:0 
  at Duplicati.Library.Main.Operation.FilelistProcessor.RemoteListAnalysis (Duplicati.Library.Main.BackendManager backend, Duplicati.Library.Main.Options options, Duplicati.Library.Main.Database.LocalDatabase database, Duplicati.Library.Main.IBackendWriter log, System.String protectedfile) [0x0000d] in <8f1de655bd1240739a78684d845cecc8>:0 
  at Duplicati.Library.Main.Operation.FilelistProcessor.VerifyRemoteList (Duplicati.Library.Main.BackendManager backend, Duplicati.Library.Main.Options options, Duplicati.Library.Main.Database.LocalDatabase database, Duplicati.Library.Main.IBackendWriter log, System.String protectedfile) [0x00000] in <8f1de655bd1240739a78684d845cecc8>:0 
  at Duplicati.Library.Main.Operation.BackupHandler.PreBackupVerify (Duplicati.Library.Main.BackendManager backend, System.String protectedfile) [0x0010b] in <8f1de655bd1240739a78684d845cecc8>:0 
  at Duplicati.Library.Main.Operation.BackupHandler.RunAsync (System.String[] sources, Duplicati.Library.Utility.IFilter filter, System.Threading.CancellationToken token) [0x01033] in <8f1de655bd1240739a78684d845cecc8>:0 
  at CoCoL.ChannelExtensions.WaitForTaskOrThrow (System.Threading.Tasks.Task task) [0x00050] in <9a758ff4db6c48d6b3d4d0e5c2adf6d1>:0 
  at Duplicati.Library.Main.Operation.BackupHandler.Run (System.String[] sources, Duplicati.Library.Utility.IFilter filter, System.Threading.CancellationToken token) [0x00009] in <8f1de655bd1240739a78684d845cecc8>:0 
  at Duplicati.Library.Main.Controller+<>c__DisplayClass14_0.<Backup>b__0 (Duplicati.Library.Main.BackupResults result) [0x0004b] in <8f1de655bd1240739a78684d845cecc8>:0 
  at Duplicati.Library.Main.Controller.RunAction[T] (T result, System.String[]& paths, Duplicati.Library.Utility.IFilter& filter, System.Action`1[T] method) [0x0026f] in <8f1de655bd1240739a78684d845cecc8>:0 
  at Duplicati.Library.Main.Controller.Backup (System.String[] inputsources, Duplicati.Library.Utility.IFilter filter) [0x00074] in <8f1de655bd1240739a78684d845cecc8>:0 
  at Duplicati.Server.Runner.Run (Duplicati.Server.Runner+IRunnerData data, System.Boolean fromQueue) [0x00349] in <c5f097a49c0a4f1fb0f93cf3f5f218b1>:0 

I think I’m going to try temporarily increasing the log level to see if I can get some more details.

[ts678]

@LiquidHog

I am also receiving this error but as far as I can tell it’s random.

My Google Drive throws occasional random 403. Today, it threw several 500 Internal Server Error:

Failed: The remote server returned an error: (500) Internal Server Error.
Details: System.Net.WebException: The remote server returned an error: (500) Internal Server Error.
   at Duplicati.Library.Utility.AsyncHttpRequest.AsyncWrapper.GetResponseOrStream()
   at Duplicati.Library.Utility.AsyncHttpRequest.GetResponse()
   at Duplicati.Library.JSONWebHelper.GetResponse(AsyncHttpRequest req, Object requestdata)
   at Duplicati.Library.JSONWebHelper.ReadJSONResponse[T](AsyncHttpRequest req, Object requestdata)
   at Duplicati.Library.Backend.GoogleDrive.GoogleDrive.<ListFolder>d__42.MoveNext()
   at System.Linq.Buffer`1..ctor(IEnumerable`1 source)
   at System.Linq.Enumerable.ToArray[TSource](IEnumerable`1 source)
   at Duplicati.Library.Backend.GoogleDrive.GoogleDrive.GetFolderId(String path, Boolean autocreate)
   at Duplicati.Library.Backend.GoogleDrive.GoogleDrive.get_CurrentFolderId()
   at Duplicati.Library.Backend.GoogleDrive.GoogleDrive.<List>d__17.MoveNext()
   at Duplicati.Library.Backend.GoogleDrive.GoogleDrive.<PutAsync>d__15.MoveNext()

OneDrive today threw a random StatusCode: 502, ReasonPhrase: ‘Bad Gateway’

I’ve got my backup set to be very sensitive to these things so I see them and test some error handling.
number-of-retries for both jobs was set down from default 5 to 1. Others might work around by raising.

[Paolo_Ucchino]

Update. The problem starts to get annoying.

It comes back. I restart the backup but since it double-checks everything it takes a long time. I’m at 50% of 3TB. I know getting it started where it left off is complex. But with Google there seems to be quite a big problem. As you can see, I only took a few GB.

[ts678]

@Paolo_Ucchino

Update. The problem starts to get annoying.

Please also see the other responses for possible workarounds, such as raising number-of-retries.
There are also ideas about AuthID, creating new ones, testing “full access”, quota, maybe more…

What have you tried from workarounds/checks given? If none, please start trying (same to others).

Thank you for the original log that at least shows that your 403 Forbidden error was from an upload.

@Paolo_Ucchino

I’m at 50% of 3TB.

Where is that from? I see “Dimensione sorgente 55.92 GB” for source size, and backup size is less.

@Paolo_Ucchino

It comes back. I restart the backup but since it double-checks everything it takes a long time.

Are you saying it does a bit more uploading after a restart (after check)? Does Drive show new files?

@Paolo_Ucchino

As you can see, I only took a few GB.

What does “took” mean? I see about 1 GB incoming and 56 GB outgoing, and have no context at all.

What would help greatly is more logs of remote action, even an About → Show log → Live → Retry.
That will show you the list/get/put activity, the amount of transfer, and the retries or eventual 403 error.

When in backup process (e.g. watching status bar state) does the "Could not find file "/tmp happen?
That’s been a mystery for awhile, possibly a result of transfer failures, but nobody has posted the log.

The best log for any of this (to avoid difficult GUI cut-and-paste, maybe after clicking on failure line) is advanced options log-file=<path> and log-file-log-level=retry (there is higher, but with privacy suffers).

[Paolo_Ucchino]

Thanks for your kind reply.

I’ll try to do some “tuning” perhaps by changing some parameters.

I turned on the logs for details but it doesn’t say much. The first message after two years in the forum is mine: “I see a strange thing in the logs: attempt 6 of 5 failed with message: The remote server returned an error: (403) Forbidden.”

I’ll try to increase the attempts and better monitor if they are in the 750GB (in the 24 hours since I start the backup to be sure)

The: “Source size 55.92 GB” for the source size and the backup size is less. "This is a message from a previous successful backup, it has not changed due to subsequent errors.

Restarting the backup after 403 takes a long time, Duplicates double-check and recount all the backup files and since there are 3 million it takes a lot of time rightly.

“Took” in the sense that after the previous 403 error I restarted and the error reappeared after a few GB. I will investigate the limit of 750GB.

I’ll see if in: About -> Show log -> Live -> Retry. I see something more.

The logs are currently active, I will use the option you recommend: log-file-log-level = retry

I’m happy with Duplicati, it’s very fast and I can confidently say it’s the best product I’ve tried so far (I’ve tried them all).

Great job, really!