Unable to backup, repair, or recreate--persistent error

1

Hello - I am getting a persistent error and have tried everything to no avail. I have “recreated”, “deleted” and “repaired” the database and keep getting this error. Any ideas of what to do?

2020-08-03 18:55:11 -06 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-IndexFileProcessingFailed]: Failed to process index file: duplicati-i9ad1b3a175dc45a7856cbf7503008753.dindex.zip

Full Log:
{
“MainOperation”: “Repair”,
“RecreateDatabaseResults”: {
“MainOperation”: “Repair”,
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “2020-08-04T01:39:13.519458Z”,
“BeginTime”: “2020-08-03T23:51:05.904929Z”,
“Duration”: “01:48:07.6145290”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null,
“BackendStatistics”: {
“RemoteCalls”: 7673,
“BytesUploaded”: 0,
“BytesDownloaded”: 808567952,
“FilesUploaded”: 0,
“FilesDownloaded”: 7672,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 0,
“KnownFileSize”: 0,
“LastBackupDate”: “0001-01-01T00:00:00”,
“BackupListCount”: 0,
“TotalQuotaSpace”: 0,
“FreeQuotaSpace”: 0,
“AssignedQuotaSpace”: 0,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Repair”,
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2020-08-03T23:51:05.722137Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
},
“ParsedResult”: “Error”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “2020-08-04T01:39:18.605312Z”,
“BeginTime”: “2020-08-03T23:51:05.722125Z”,
“Duration”: “01:48:12.8831870”,
“MessagesActualLength”: 15352,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 1,
“Messages”: [
“2020-08-03 17:51:05 -06 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Repair has started”,
“2020-08-03 17:51:05 -06 - [Information-Duplicati.Library.Main.Operation.RepairHandler-RenamingDatabase]: Renaming existing db from /config/78726686696688907566.sqlite to /config/78726686696688907566.backup”,
“2020-08-03 17:51:09 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2020-08-03 17:51:41 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (14.97 KB)”,
“2020-08-03 18:10:06 -06 - [Information-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-RebuildStarted]: Rebuild database started, downloading 17 filelists”,
“2020-08-03 18:10:06 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20190819T013025Z.dlist.zip (227.64 KB)”,
“2020-08-03 18:10:08 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20190819T013025Z.dlist.zip (227.64 KB)”,
“2020-08-03 18:10:08 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20190819T013813Z.dlist.zip (246.54 KB)”,
“2020-08-03 18:10:08 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20190819T013813Z.dlist.zip (246.54 KB)”,
“2020-08-03 18:10:08 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20190819T040522Z.dlist.zip (3.08 MB)”,
“2020-08-03 18:10:15 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20190819T040522Z.dlist.zip (3.08 MB)”,
“2020-08-03 18:10:15 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20190820T003403Z.dlist.zip (3.08 MB)”,
“2020-08-03 18:10:21 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20190820T003403Z.dlist.zip (3.08 MB)”,
“2020-08-03 18:10:23 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20190820T004221Z.dlist.zip (16.16 MB)”,
“2020-08-03 18:10:53 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20190820T004221Z.dlist.zip (16.16 MB)”,
“2020-08-03 18:10:53 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20190821T070000Z.dlist.zip (16.16 MB)”,
“2020-08-03 18:11:23 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20190821T070000Z.dlist.zip (16.16 MB)”,
“2020-08-03 18:11:35 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20191026T231529Z.dlist.zip (16.26 MB)”,
“2020-08-03 18:12:16 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20191026T231529Z.dlist.zip (16.26 MB)”,
“2020-08-03 18:12:16 -06 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20191031T070000Z.dlist.zip (16.26 MB)”
],
“Warnings”: ,
“Errors”: [
“2020-08-03 18:55:11 -06 - [Error-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-IndexFileProcessingFailed]: Failed to process index file: duplicati-i9ad1b3a175dc45a7856cbf7503008753.dindex.zip”
],
“BackendStatistics”: {
“RemoteCalls”: 7673,
“BytesUploaded”: 0,
“BytesDownloaded”: 808567952,
“FilesUploaded”: 0,
“FilesDownloaded”: 7672,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 0,
“KnownFileSize”: 0,
“LastBackupDate”: “0001-01-01T00:00:00”,
“BackupListCount”: 0,
“TotalQuotaSpace”: 0,
“FreeQuotaSpace”: 0,
“AssignedQuotaSpace”: 0,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Repair”,
“ParsedResult”: “Success”,
“Version”: “2.0.5.1 (2.0.5.1_beta_2020-01-18)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2020-08-03T23:51:05.722137Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
}

2

Welcome to the forum @jrowe88

For background, can you comment on any earlier issues, before this got into repair and recreate?

What sort of OS is this, and what type of backup destination? The bad dindex file may need a look.
An extremely simple test can be done manually. It’s a .zip file, so get it, then see if you can unzip it.

Dindex are ordinarily quick to fix from database information, but I don’t know if you have a DB copy.
Your log shows a 78726686696688907566.backup, but I don’t know if it’s still around or if it’s good.
Databases are usually stored in the home directory of the Duplicati user at ~/.config/Duplicati

The good news is that dindex files are not that valuable, as they can be rebuilt from their dblock file.
The bad news is it may take some time to find that dblock, so ideally downloading is free and easy.

At some point, a better log is needed, e.g. with options –log-file=<path> and log-file-log-level=retry.
You can then repeat the failing operation, and go look in the log for any info details near bad dindex.

3

Ok; thanks for the info. It is running in Docker within a Linux container. Duplicati version is: v2.0.5.1-2.0.5.1_beta_2020-01-18-ls49 The backup file are on BackBlaze.

Prior to your response, I tried deleting that .zip file and re-ran the backup. I got the same error with a different file name.

I don’t recall the error I had prior to this the precipitated the first rebuild. I’ve turned on logging an am trying again…

4

You can try that other .zip file instead, e.g. with unzip -t.

I was hoping it was just one bad file. From times on your original log, the 2020-08-03 18:55:11 -06 error on the dindex file would have been about 44 minutes before the “EndTime”: “2020-08-04T01:39:18.605312Z”.

One possible difference is that original log says it’s a Repair or Recreate, but the later test was a Backup.

Looking forward to getting the further clues.