Failure when verifying files

Adrian3810 · August 23, 2024, 12:15am

Hi Guys, I am getting 401 errors when Duplicati is verifying files. The backup works and files are uploaded to Backblaze. I can restore the files from a different PC. I suspect there is an issue with file permissions on the Local SQL DB. I have checked the permissions and granted full permissions on C:\Users<Username>\AppData\Local\Duplicati\ but still getting errors. Any help would be greatly appreciated. Full log file below:

“MainOperation”: “Test”,
“VerificationsActualLength”: 3,
“Verifications”: [
{
“Key”: “duplicati-20240822T231810Z.dlist.zip.aes”,
“Value”: [
{
“Key”: “Error”,
“Value”: "401 - unauthorized: "
}
]
},
{
“Key”: “duplicati-i05019ccd71134b3791a27b4b23ef8e44.dindex.zip.aes”,
“Value”: [
{
“Key”: “Error”,
“Value”: "401 - unauthorized: "
}
]
},
{
“Key”: “duplicati-b214cbbf298ed4f2abd229b2d407cc81e.dblock.zip.aes”,
“Value”: [
{
“Key”: “Error”,
“Value”: "401 - unauthorized: "
}
]
}
],
“ParsedResult”: “Error”,
“Interrupted”: false,
“Version”: “2.0.8.1 (2.0.8.1_beta_2024-05-07)”,
“EndTime”: “2024-08-23T00:06:12.6720704Z”,
“BeginTime”: “2024-08-23T00:03:19.7951504Z”,
“Duration”: “00:02:52.8769200”,
“MessagesActualLength”: 33,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 7,
“Messages”: [
“2024-08-23 10:03:19 +10 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Test has started”,
“2024-08-23 10:03:20 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2024-08-23 10:03:22 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (15 bytes)”,
“2024-08-23 10:03:22 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20240822T231810Z.dlist.zip.aes (1.20 KB)”,
“2024-08-23 10:03:24 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Retrying: duplicati-20240822T231810Z.dlist.zip.aes (1.20 KB)”,
“2024-08-23 10:03:34 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20240822T231810Z.dlist.zip.aes (1.20 KB)”,
“2024-08-23 10:03:38 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Retrying: duplicati-20240822T231810Z.dlist.zip.aes (1.20 KB)”,
“2024-08-23 10:03:48 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20240822T231810Z.dlist.zip.aes (1.20 KB)”,
“2024-08-23 10:03:51 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Retrying: duplicati-20240822T231810Z.dlist.zip.aes (1.20 KB)”,
“2024-08-23 10:04:01 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20240822T231810Z.dlist.zip.aes (1.20 KB)”,
“2024-08-23 10:04:05 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Retrying: duplicati-20240822T231810Z.dlist.zip.aes (1.20 KB)”,
“2024-08-23 10:04:15 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20240822T231810Z.dlist.zip.aes (1.20 KB)”,
“2024-08-23 10:04:19 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Failed: duplicati-20240822T231810Z.dlist.zip.aes (1.20 KB)”,
“2024-08-23 10:04:19 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-i05019ccd71134b3791a27b4b23ef8e44.dindex.zip.aes (69.28 KB)”,
“2024-08-23 10:04:20 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Retrying: duplicati-i05019ccd71134b3791a27b4b23ef8e44.dindex.zip.aes (69.28 KB)”,
“2024-08-23 10:04:31 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-i05019ccd71134b3791a27b4b23ef8e44.dindex.zip.aes (69.28 KB)”,
“2024-08-23 10:04:34 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Retrying: duplicati-i05019ccd71134b3791a27b4b23ef8e44.dindex.zip.aes (69.28 KB)”,
“2024-08-23 10:04:44 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-i05019ccd71134b3791a27b4b23ef8e44.dindex.zip.aes (69.28 KB)”,
“2024-08-23 10:04:48 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Retrying: duplicati-i05019ccd71134b3791a27b4b23ef8e44.dindex.zip.aes (69.28 KB)”,
“2024-08-23 10:04:58 +10 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-i05019ccd71134b3791a27b4b23ef8e44.dindex.zip.aes (69.28 KB)”
],
“Warnings”: ,
“Errors”: [
"2024-08-23 10:04:19 +10 - [Error-Duplicati.Library.Main.AsyncDownloader-FailedToRetrieveFile]: Failed to retrieve file duplicati-20240822T231810Z.dlist.zip.aes\r\nException: 401 - unauthorized: ",
"2024-08-23 10:04:19 +10 - [Error-Duplicati.Library.Main.Operation.TestHandler-RemoteFileProcessingFailed]: Failed to process file duplicati-20240822T231810Z.dlist.zip.aes\r\nException: 401 - unauthorized: ",
"2024-08-23 10:05:15 +10 - [Error-Duplicati.Library.Main.AsyncDownloader-FailedToRetrieveFile]: Failed to retrieve file duplicati-i05019ccd71134b3791a27b4b23ef8e44.dindex.zip.aes\r\nException: 401 - unauthorized: ",
"2024-08-23 10:05:15 +10 - [Error-Duplicati.Library.Main.Operation.TestHandler-RemoteFileProcessingFailed]: Failed to process file duplicati-i05019ccd71134b3791a27b4b23ef8e44.dindex.zip.aes\r\nException: 401 - unauthorized: ",
"2024-08-23 10:06:12 +10 - [Error-Duplicati.Library.Main.AsyncDownloader-FailedToRetrieveFile]: Failed to retrieve file duplicati-b214cbbf298ed4f2abd229b2d407cc81e.dblock.zip.aes\r\nException: 401 - unauthorized: ",
"2024-08-23 10:06:12 +10 - [Error-Duplicati.Library.Main.Operation.TestHandler-RemoteFileProcessingFailed]: Failed to process file duplicati-b214cbbf298ed4f2abd229b2d407cc81e.dblock.zip.aes\r\nException: 401 - unauthorized: ",
“2024-08-23 10:06:12 +10 - [Error-Duplicati.Library.Main.Operation.TestHandler-Test results]: Verified 3 remote files with 3 problem(s)”
],
“BackendStatistics”: {
“RemoteCalls”: 16,
“BytesUploaded”: 0,
“BytesDownloaded”: 0,
“FilesUploaded”: 0,
“FilesDownloaded”: 0,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 12,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 15,
“KnownFileSize”: 1365058531,
“LastBackupDate”: “2024-08-23T09:18:10+10:00”,
“BackupListCount”: 1,
“TotalQuotaSpace”: 0,
“FreeQuotaSpace”: 0,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Test”,
“ParsedResult”: “Success”,
“Interrupted”: false,
“Version”: “2.0.8.1 (2.0.8.1_beta_2024-05-07)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2024-08-23T00:03:19.7951504Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
}

ts678 · August 23, 2024, 1:36pm

Welcome to the forum @Adrian3810

401 Unauthorized

is generic information on this HTTP error. Specific Backblaze information is at link below.

HTTP Status Codes

Although both distinguish between 401 Unauthorized and 403 Forbidden, I’ll ask anyway:

Application Keys let you get very specific about permissions. Do you set any restrictions?

Do you use the same (what Duplicati calls) B2 Application ID?

Direct restore from backup files can be tested from the original PC to see if it can read files.

For a low-level CLI test, get your destination URL from Export As Command-line and test in Duplicati.CommandLine.BackendTool.exe. For example see if you can get (download) files.

Adrian3810 · August 25, 2024, 11:32pm

Hi and thanks for your reply.
The same B2 Application Id, passphrase etc were used.
When I run a Direct restore from backup files I get the following errors:
Aug 26, 2024 9:19 AM: Failed while executing List “” (id: e0bfda70-7692-4312-b404-fedf00950f15)
System.Exception: 401 - unauthorized:
at Duplicati.Library.Main.AsyncDownloader.AsyncDownloaderEnumerator.AsyncDownloadedFile.get_TempFile()
at Duplicati.Library.Main.Operation.ListFilesHandler.CreateResultSequence(IEnumerable1 filteredList, BackendManager backendManager, Options options) at Duplicati.Library.Main.Operation.ListFilesHandler.Run(IEnumerable1 filterstrings, IFilter compositefilter)
at Duplicati.Library.Main.Controller.RunAction[T](T result, String& paths, IFilter& filter, Action1 method) at Duplicati.Library.Main.Controller.List(IEnumerable1 filterstrings, IFilter filter)
at Duplicati.Server.Runner.Run(IRunnerData data, Boolean fromQueue)

Aug 26, 2024 9:19 AM: Request for http://localhost:8200/api/v1/backup/e0bfda70-7692-4312-b404-fedf00950f15/filesets gave error
System.Exception: 401 - unauthorized:
at Duplicati.Library.Main.AsyncDownloader.AsyncDownloaderEnumerator.AsyncDownloadedFile.get_TempFile()
at Duplicati.Library.Main.Operation.ListFilesHandler.CreateResultSequence(IEnumerable1 filteredList, BackendManager backendManager, Options options) at Duplicati.Library.Main.Operation.ListFilesHandler.Run(IEnumerable1 filterstrings, IFilter compositefilter)
at Duplicati.Library.Main.Controller.RunAction[T](T result, String& paths, IFilter& filter, Action1 method) at Duplicati.Library.Main.Controller.List(IEnumerable1 filterstrings, IFilter filter)
at Duplicati.Server.Runner.Run(IRunnerData data, Boolean fromQueue)
at Duplicati.Server.WebServer.RESTMethods.Backup.ListFileSets(IBackup backup, RequestInfo info)
at Duplicati.Server.WebServer.RESTHandler.DoProcess(RequestInfo info, String method, String module, String key)

Aug 26, 2024 9:19 AM: Reporting error gave error
System.ObjectDisposedException: Cannot write to a closed TextWriter.
at System.IO.__Error.WriterClosed()
at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder)
at Duplicati.Server.WebServer.RESTHandler.DoProcess(RequestInfo info, String method, String module, String key)

Thanks again for taking the time to help me.
Adrian

ts678 · August 26, 2024, 9:56am

Any differences between the PCs? There was once an odd report (which I can’t find now) of differences due to (I think) different networking. Are these PCs on the same network? Is the networking environment anything potentially complex, or just the typical home router setup?

People see DNS problems, network problems, antimalware problems, proxy problems, etc., however this one is a little unusual because it seems like B2 sometimes won’t authenticate.

would be the next level down. You might also want to just try access with a new application ID.