# Repair doesnt work

**URL:** <https://forum.duplicati.com/t/repair-doesnt-work/4251>\
**Category:** Support\
**Created:** [August 1, 2018, 10:52am UTC](https://forum.duplicati.com/t/repair-doesnt-work/4251 "2018-08-01T10:52:37Z")\
**Posts on this page:** 16\
**Page:** 1

<div class="post-metadata">

**Author:** ![Jorg\_Nestler](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/d6d6ee/32.png) [@Jorg\_Nestler](https://forum.duplicati.com/u/Jorg_Nestler)\
**Post date:** [August 1, 2018, 10:52am UTC](https://forum.duplicati.com/t/repair-doesnt-work/4251/1 "2018-08-01T10:52:37Z")

</div>

Hi, I got an error which told me I have to repair my database. First I tried the repair but it doesnt solve the problem. After I run delete database and create again and I got this Error:

```json
MainOperation: Repair
RecreateDatabaseResults:
    MainOperation: Repair
    ParsedResult: Success
    EndTime: 01.08.2018 12:42:57 (1533120177)
    BeginTime: 01.08.2018 12:37:11 (1533119831)
    Duration: 00:05:46.3698976
    BackendStatistics:
        RemoteCalls: 227
        BytesUploaded: 0
        BytesDownloaded: 1678274
        FilesUploaded: 0
        FilesDownloaded: 226
        FilesDeleted: 0
        FoldersCreated: 0
        RetryAttempts: 0
        UnknownFileSize: 0
        UnknownFileCount: 0
        KnownFileCount: 0
        KnownFileSize: 0
        LastBackupDate: 01.01.0001 01:00:00 (-62135596800)
        BackupListCount: 0
        TotalQuotaSpace: 0
        FreeQuotaSpace: 0
        AssignedQuotaSpace: 0
        ReportedQuotaError: False
        ReportedQuotaWarning: False
        ParsedResult: Success
ParsedResult: Error
EndTime: 01.08.2018 12:42:57 (1533120177)
BeginTime: 01.08.2018 12:37:11 (1533119831)
Duration: 00:05:46.5271983
Messages: [
    Rebuild database started, downloading 3 filelists,
    Filelists restored, downloading 223 index files,
    Recreate completed, verifying the database consistency,
    Recreate completed, and consistency checks completed, marking database as complete
]
Warnings: []
Errors: [
    Remote file referenced as duplicati-b2a57b1bf0c1d496fb7af7a958508f026.dblock.zip, but not found in list, registering a missing remote file
]

```

When I now try to run the Backup after I always get the Error:

```
Failed: Found 1 files that are missing from the remote storage, please run repair
Details: Duplicati.Library.Interface.UserInformationException: Found 1 files that are missing from the remote storage, please run repair
   bei Duplicati.Library.Main.Operation.FilelistProcessor.VerifyRemoteList(BackendManager backend, Options options, LocalDatabase database, IBackendWriter log, String protectedfile)
   bei Duplicati.Library.Main.Operation.BackupHandler.PreBackupVerify(BackendManager backend, String protectedfile)
   bei Duplicati.Library.Main.Operation.BackupHandler.Run(String[] sources, IFilter filter)
   bei Duplicati.Library.Main.Controller.<>c __DisplayClass17_0.<Backup>b__ 0(BackupResults result)
   bei Duplicati.Library.Main.Controller.RunAction[T](T result, String[]& paths, IFilter& filter, Action`1 method)

```

Is there a way to solve the Problem?  
I am running on - 2.0.3.3\_beta\_2018-04-02

Thanks in advance

---

<div class="post-metadata">

**Author:** ![JonMikelV](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/439d5e/32.png) [@JonMikelV](https://forum.duplicati.com/u/JonMikelV)\
**Post date:** [August 3, 2018, 2:47am UTC](https://forum.duplicati.com/t/repair-doesnt-work/4251/2 "2018-08-03T02:47:55Z")

</div>

Did you try running the Repair (not recreate) again?

It’s possible one of the 223 index files mentioned in the messages was referencing the missing dblock file so when the database was recreated (using those index files) it’s assuming the file is there.

(Note that I edited your post by adding “````json” before and “```” after your log and “~~~” before and after your error message to make them easier to read.)

---

<div class="post-metadata">

**Author:** ![Jorg\_Nestler](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/d6d6ee/32.png) [@Jorg\_Nestler](https://forum.duplicati.com/u/Jorg_Nestler)\
**Post date:** [August 3, 2018, 8:25am UTC](https://forum.duplicati.com/t/repair-doesnt-work/4251/3 "2018-08-03T08:25:23Z")

</div>

Hi, yes I also runned the repair after again - it doesnt matter. Still the same problem :-/

Fatal error  
Duplicati.Library.Interface.UserInformationException: Found 1 files that are missing from the remote storage, please run repair

bei Duplicati.Library.Main.Operation.FilelistProcessor.VerifyRemoteList(BackendManager backend, Options options, LocalDatabase database, IBackendWriter log, String protectedfile)

bei Duplicati.Library.Main.Operation.BackupHandler.PreBackupVerify(BackendManager backend, String protectedfile)

bei Duplicati.Library.Main.Operation.BackupHandler.Run(String[] sources, IFilter filter)

---

<div class="post-metadata">

**Author:** ![JonMikelV](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/439d5e/32.png) [@JonMikelV](https://forum.duplicati.com/u/JonMikelV)\
**Post date:** [August 6, 2018, 12:23am UTC](https://forum.duplicati.com/t/repair-doesnt-work/4251/4 "2018-08-06T00:23:34Z")

</div>

I suspect setting `--no-backend-verification=true` will stop the error from happening, but it does this basically by ignoring the problem - so it’s not really a fix.

My GUESS is that deleting all the `dlist` files from the destination then doing a database Recreate will actually resolve the issue, but that’s a pretty aggressive / hands-on thing to do.

Unfortunately, I don’t know of any other way to fix this issue at the moment. ☹

---

<div class="post-metadata">

**Author:** ![Jorg\_Nestler](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/d6d6ee/32.png) [@Jorg\_Nestler](https://forum.duplicati.com/u/Jorg_Nestler)\
**Post date:** [August 6, 2018, 11:09am UTC](https://forum.duplicati.com/t/repair-doesnt-work/4251/5 "2018-08-06T11:09:49Z")

</div>

I tried, but when the dlist files are deleted, the database recreation doesnt work because of missing dlist files.  
Did I steps in the false order or could you tell me step by step what I shoudt try?

---

<div class="post-metadata">

**Author:** ![JonMikelV](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/439d5e/32.png) [@JonMikelV](https://forum.duplicati.com/u/JonMikelV)\
**Post date:** [August 10, 2018, 5:12pm UTC](https://forum.duplicati.com/t/repair-doesnt-work/4251/6 "2018-08-10T17:12:04Z")

</div>

> [@Jorg\_Nestler](#):
>
> the database recreation doesnt work because of missing dlist files

That doesn’t sound right - if dlist files are missing Dulicati should start downloading the larger dblock files to rebuild what would have been in the missing dlist files.

Can you post the actual error message you’re getting?

---

<div class="post-metadata">

**Author:** ![kees-z](https://forum.duplicati.com/user_avatar/forum.duplicati.com/kees-z/32/29_2.png) [@kees-z](https://forum.duplicati.com/u/kees-z)\
**Post date:** [August 11, 2018, 7:54pm UTC](https://forum.duplicati.com/t/repair-doesnt-work/4251/7 "2018-08-11T19:54:34Z")

</div>

> [@JonMikelV](#):
>
> if dlist files are missing Dulicati should start downloading the larger dblock files to rebuild what would have been in the missing dlist files.

Are you sure that .DLIST files can be safely deleted from the backend? I’m not sure if Duplicati can distil a file and folder list from raw .DBLOCK data.

Could it be that you meant .DINDEX files instead of .DLIST files? I had a [similar problem](https://forum.duplicati.com/t/backup-unusable-duplicati-tells-me-to-repair-but-repairing-doesnt-work/4209), deleting **all**.DINDEX files and recreating the database fixed it for me.

---

<div class="post-metadata">

**Author:** ![JonMikelV](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/439d5e/32.png) [@JonMikelV](https://forum.duplicati.com/u/JonMikelV)\
**Post date:** [August 14, 2018, 3:55am UTC](https://forum.duplicati.com/t/repair-doesnt-work/4251/8 "2018-08-14T03:55:07Z")

</div>

> [@kees-z](#):
>
> Are you sure that .DLIST files can be safely deleted from the backend? I’m not sure if Duplicati can distil a file and folder list from raw .DBLOCK data.

I couldn’t find my original post so I tested the database Repair process again (using 2.0.3.9 canary) on a very small (200M source) backup with the following results:

- Deleting all 17 `.dindex` files and running REPAIR resulted in 17 fresh (dated today) `.dindex` files being created in just over 1 minute
- Deleting all 18 `.dlist` files and running REPAIR resulted in 18 fresh (dated today) `.dlist` files being created in just over 1 minute (though ONE file was flagged with a warning of being uploaded with size X but should be size Y)
- Deleting all 17 `.dindex` AND all 18 `.dlist` files and running REPAIR resulted in 35 fresh (dated today) files being created in 1.5 minutes

So I’d say yes - at least with 2.0.3.9 it is safe to delete all `.dindex` and/or `.dlist` files as they can be recreated from the local database ASSUMING the local database is in good condition.

My GUESS is that even if a user has no local database it would still be safe to do the tests I just did, they would simply take longer as all the `.dblock` files would have to be downloaded and parsed to recreate the missing `.dlist` and/or `.dindex` files.

Let me know if you’d like me to test that as well.

---

<div class="post-metadata">

**Author:** ![Jorg\_Nestler](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/d6d6ee/32.png) [@Jorg\_Nestler](https://forum.duplicati.com/u/Jorg_Nestler)\
**Post date:** [August 14, 2018, 7:50am UTC](https://forum.duplicati.com/t/repair-doesnt-work/4251/9 "2018-08-14T07:50:05Z")

</div>

I deleted all dlist files and tried to run the repair again. Since more than 24 hours no changes - the progressbar is on 10% and says Starting…  
I dont know how to speed up the process - maybe something went wrong and I should cancel and retry :-/

---

<div class="post-metadata">

**Author:** ![JonMikelV](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/439d5e/32.png) [@JonMikelV](https://forum.duplicati.com/u/JonMikelV)\
**Post date:** [August 16, 2018, 2:57pm UTC](https://forum.duplicati.com/t/repair-doesnt-work/4251/10 "2018-08-16T14:57:49Z")

</div>

Hmmm, 24 hours is a long time for Repair (though not for a Recreate).

If you can look at the destination, are you seeing a set of dlist files being created with the same create date?

---

<div class="post-metadata">

**Author:** ![Jorg\_Nestler](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/d6d6ee/32.png) [@Jorg\_Nestler](https://forum.duplicati.com/u/Jorg_Nestler)\
**Post date:** [August 16, 2018, 3:26pm UTC](https://forum.duplicati.com/t/repair-doesnt-work/4251/11 "2018-08-16T15:26:54Z")

</div>

Hi again, I canceled the repair (no progress after hours…). Now I deleted again all `.dlist` and `.dindex` files and started the process again this morning. For the moment no update at the progressbar, but I see in the destination - it is still creating `.dindex` files.  
I think the problem comes maybe from several reasons

- my backup is about 250GB
- 8 Versions
- for the `.dblock` files I defined only a size of 5MB (bigger sizes didnt work with the poor internet connection I have)
- Internetspeed 50kb upload and 500k download

It will take a while :-/

---

<div class="post-metadata">

**Author:** ![Jorg\_Nestler](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/d6d6ee/32.png) [@Jorg\_Nestler](https://forum.duplicati.com/u/Jorg_Nestler)\
**Post date:** [August 20, 2018, 2:19pm UTC](https://forum.duplicati.com/t/repair-doesnt-work/4251/12 "2018-08-20T14:19:30Z")

</div>

just to give you an update… The repair process created `.dindex` files again and this seems finished since yesterday morning (no new `.dindex` files are arriving at the destination). The progressbar is still on 0% and I dont know is the Job doing something in background in order to create the `.dlist` files or is it crashed. For the moment I keep waiting…

---

<div class="post-metadata">

**Author:** ![Jorg\_Nestler](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/d6d6ee/32.png) [@Jorg\_Nestler](https://forum.duplicati.com/u/Jorg_Nestler)\
**Post date:** [August 22, 2018, 4:26pm UTC](https://forum.duplicati.com/t/repair-doesnt-work/4251/13 "2018-08-22T16:26:01Z")

</div>

no progress since my last posting (no new files at the destination and no update of the progressbar or any new Logentries) - thats why I stopped it now. It seems the exisitng backup is lost. :-/ I create now new backup-jobs and split it into several parts - in that case I will not loose the entire backup in case of future problems. I am not happy with the situation it seems the actual version isn’t reliable in my case.

---

<div class="post-metadata">

**Author:** ![JonMikelV](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/439d5e/32.png) [@JonMikelV](https://forum.duplicati.com/u/JonMikelV)\
**Post date:** [August 29, 2018, 12:22am UTC](https://forum.duplicati.com/t/repair-doesnt-work/4251/14 "2018-08-29T00:22:16Z")

</div>

Sorry to hear about all the troubles (and taking so long to get back to you).

You’re doing everything that normally works so my guess is your internet connection is triggering a (usually very transient) bug in Duplicati where and interrupted transfer causes Duplicati to wait forever for it to finish.

I’m not sure if @kenkendk has looked into this yet or not, but my guess is even if he has it’s a tough issue to track down.

Normally I’d suggest trying your backup to a local drive for a while to confirm it’s stable with the Internet out of the picture but it sounds like your collection is likely to improve so other than waiting who-knows-how-long for a fix there may not be a solution for this issue. ☹

If you decide to move on from Duplicati you might have better luck with Duplicaci.

---

<div class="post-metadata">

**Author:** ![TPSMono](https://forum.duplicati.com/user_avatar/forum.duplicati.com/tpsmono/32/2100_2.png) [@TPSMono](https://forum.duplicati.com/u/TPSMono)\
**Post date:** [August 29, 2018, 8:23pm UTC](https://forum.duplicati.com/t/repair-doesnt-work/4251/15 "2018-08-29T20:23:04Z")

</div>

The error is indicating that you are missing a dblock file so the backup no longer has the hashed data blocks that existed in that file. This file cannot be recreated, you have to remove the dblock file from the database/dindex files which will also make the files that used that dblock unrecoverable. You need to use the command **list-broken-files** to show you what files used the missing dblock and are no longer recoverable, then run **purge-broken-files** to remove the dblock reference completely. Here is a post with some information about list-broken-files and purge-broken-files:

> [@How to list / purge broken files](https://forum.duplicati.com/t/how-to-list-purge-broken-files/3884):
>
> This is a first crack at helping people understand what will happen with list-broken-files and purge-broken-files commands. It is by no means complete, but it IS a wiki, so feel free to add / update anything you feel might be useful to other users. slight_smile While Duplicati is very robust in handling errors (including missing destination files) there may come a time when you need to remove references to backup versions from your job. When this happens, the use of the list-broken-files …

---

<div class="post-metadata">

**Author:** ![Jorg\_Nestler](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/d6d6ee/32.png) [@Jorg\_Nestler](https://forum.duplicati.com/u/Jorg_Nestler)\
**Post date:** [August 30, 2018, 4:31pm UTC](https://forum.duplicati.com/t/repair-doesnt-work/4251/16 "2018-08-30T16:31:39Z")

</div>

Thanks for all the answers - I try to continue with Duplicacy - maybe its more stable for my case - we will sse 🙂
