ts678
November 30, 2023, 12:34pm
37
But now I’m testing the deletion of dindex files to see if they are recreated properly. I deleted 1550 dindex files then ran another backup. Duplicati detected the missing files and prompted me to Repair. I ran the Repair and 1548 of the 1550 files were recreated without issue. Two of the files caused this type of error:
2019-10-21 14:37:32 -07 - [Error-Duplicati.Library.Main.Operation.RepairHandler-CleanupMissingFileError]: Failed to perform cleanup for missing file: duplicati-i40c3ea119a344bfa8d5e8e7faed60c24.dindex.zip.aes, message: Internal consistency check failed, generated index block has wrong hash, JK08SX0qCZzPHTVQ2tSqICHbTx0ddPiRp4YcXwHjkB4= vs yuJVEmzJrjO2iD9aWhWzi7XKPJ+SKReFmnrEIFYOLOs=
2019-10-21 14:37:32 -07 - [Error-Duplicati.Library.Main.Operation.RepairHandler-CleanupMissingFileError]: Failed to perform cleanup for missing file: duplicati-i94d4b285035b4fc59d77625e182ae5ce.dindex.zip.aes, message: Internal consistency check failed, generated index block has wrong hash, i+LMfmCATFXwu7A3YGHVGkU0iqD4NH1rqzZfW1Q3xO0= vs tpI5x47zReN2kh4Cf1Uu8gPLqsXhgYLBXf3Vs0k/Y2o=
Anyone know what the root cause of this is, and if there is any way to recover?
Seemed a very good fit for the dindex loss test inadvertently done by the HDD issues in current topic,
except it wasn’t reproducible for some reason. It also links to a GitHub issue that may be related and gathered a number of me-too posts, however it’s sometimes unclear if root causes are the same one.
opened 08:09AM - 01 May 18 UTC
- [ ] I have searched open and closed issues for duplicates.
- [x] Only "quick … browser", not thorough scan.
----------------------------------------
## Environment info
- **Duplicati version**: v2.0.3.6-2.0.3.6_canary_2018-04-23
- **Operating system**: Ubuntu 16.04.4 Linux & Windows 10
- **Backend**: SFTP & FTPS & FILE
## Description
Backup sets basically get broken by just running backup. Three totally independent systems, with different backends and clients. As well as one "local / file" backup, where backup data is stored on second local disk. Something is seriously wrong if this happens?
"Internal consistency check failed, generated index block has wrong hash"
## Steps to reproduce
1. Just running normal backup.
## Debug log
`
Checking remote backup ...
Listing remote folder ...
Fatal error => System.Exception: Internal consistency check failed, generated index block has wrong hash, 6yil2I1aMnlEYfq7luTpJh8RytKe5Gm7eeUuk0UAELU= vs I5/lRw4QR1CWI8t2ojmy/pgUFgAUcQqr8z+zpybt3rk=
at Duplicati.Library.Main.Operation.Common.IndexVolumeCreator+<CreateIndexVolume>d__0.MoveNext () <0x409eb6e0 + 0x00b5b> in <filename unknown>:0
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7f58718016d0 + 0x00029> in <filename unknown>:0
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7f58717ff6b0 + 0x000a7> in <filename unknown>:0
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7f58717ff630 + 0x0006b> in <filename unknown>:0
at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7f58717ff5e0 + 0x0003a> in <filename unknown>:0
at System.Runtime.CompilerServices.TaskAwaiter 1[TResult].GetResult () <0x7f58717ff8d0 + 0x00017> in <filename unknown>:0
at Duplicati.Library.Main.Operation.Backup.RecreateMissingIndexFiles+<>c__DisplayClass1_0+<<Run>b__0>d.MoveNext () <0x409e7740 + 0x006be> in <filename unknown>:0
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7f58718016d0 + 0x00029> in <filename unknown>:0
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7f58717ff6b0 + 0x000a7> in <filename unknown>:0
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7f58717ff630 + 0x0006b> in <filename unknown>:0
at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7f58717ff5e0 + 0x0003a> in <filename unknown>:0
at System.Runtime.CompilerServices.TaskAwaiter.GetResult () <0x7f58717ff5c0 + 0x00012> in <filename unknown>:0
at CoCoL.AutomationExtensions+<RunTask>d__10 1[T].MoveNext () <0x40899140 + 0x00231> in <filename unknown>:0
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x7f58718016d0 + 0x00029> in <filename unknown>:0
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x7f58717ff6b0 + 0x000a7> in <filename unknown>:0
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x7f58717ff630 + 0x0006b> in <filename unknown>:0
at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x7f58717ff5e0 + 0x0003a> in <filename unknown>:0
at System.Runtime.CompilerServices.TaskAwaiter.GetResult () <0x7f58717ff5c0 + 0x00012> in <filename unknown>:0
at Duplicati.Library.Main.Operation.BackupHandler+<RunAsync>d__18.MoveNext () <0x40932000 + 0x01d8e> in <filename unknown>:0
`
Original post stack trace is running RecreateMissingIndexFiles which then runs CreateIndexVolume which does have the consistency check on a GetBlocklistsAsync which runs the faulty GetBlocklists .