Missing File repair failed

Support
1

Hi,
i get some Errors while BackUp with Duplicati 2:

Missing file: duplicati-b7859f53e51c94110a1703cee8e56b642.dblock.zip

Found 1 files that are missing from the remote storage, please run repair

Fatal error
Duplicati.Library.Interface.UserInformationException: Found 1 files that are missing from the remote storage, please run repair
bei Duplicati.Library.Main.Operation.FilelistProcessor.VerifyRemoteList(BackendManager backend, Options options, LocalDatabase database, IBackendWriter log, String protectedfile)
bei Duplicati.Library.Main.Operation.BackupHandler.PreBackupVerify(BackendManager backend, String protectedfile)
bei Duplicati.Library.Main.Operation.BackupHandler.Run(String sources, IFilter filter)

I had run the repair, the small “repair” and the big “delete and repair”. The Error still stands on.

i had also tryed the command-line-tool with “LIST-BROKEN-FILES”-command, but there is also an Error:
c:\Program Files\Duplicati 2>Duplicati.CommandLine.exe list-broken-files \omv.fritz.box\Backup\Automatic\HTPC\Duplicati

Verschlüsselungspassphrase eingeben:
System.InvalidOperationException: Schlüssel können nicht gelesen werden, wenn keine der Anwendungen eine Konsole besitzt, oder wenn die Konsoleneingabe aus einer Datei umgeleitet wurde. Verwenden Sie Console.Read.
   bei System.Console.ReadKey(Boolean intercept)
   bei Duplicati.Library.Modules.Builtin.ConsolePasswordInput.ReadPassphraseFromConsole(Boolean confirm)
   bei Duplicati.Library.Modules.Builtin.ConsolePasswordInput.Configure(IDictionary`2 commandlineOptions)
   bei Duplicati.Library.Main.Controller.SetupCommonOptions(ISetCommonOptions result, String[]& paths, IFilter& filter)
   bei Duplicati.Library.Main.Controller.RunAction[T](T result, String[]& paths, IFilter& filter, Action`1 method)
   bei Duplicati.Library.Main.Controller.ListBrokenFiles(IFilter filter, Func`6 callbackhandler)
   bei Duplicati.CommandLine.Commands.ListBrokenFiles(TextWriter outwriter, Action`1 setup, List`1 args, Dictionary`2 options, IFilter filter)
   bei Duplicati.CommandLine.Program.RunCommandLine(TextWriter outwriter, TextWriter errwriter, Action`1 setup, String[] args)

how i can get my Duplicati back to work?

2

Hi @da_user, welcome to the forum!

What version of Duplicati are you using? There was a bug (starting around version 2.0.3.5 but fixed in 2.0.3.8 that) caused password not to work correctly on the console.

3

Hi,
i’m using 2.0.3.3_beta_2018-04-02.
But, it seems to be the freshliest of the “stable-beta” channel.

4

Yes, 2.0.3.3 is the most stable version available - but it’s also from BEFORE the console password bug showed up, so you must be running into a different issue.

Did you try your list-broken-files command using the How-To guide here?

5

Hi,
i have that Problem again. Last Time was the BackUp really fresh, so was the easier way, to build it new.
Now it’s older and a HDD with some BackUpFiles Crashed. Snapraid rebuild the most, but not all Files.
I tryed to make the rubuild over the Webinterface, like in the linked #howto: How to list / purge broken files
This is the Output:

No broken filesets found in database, checking for missing remote files
  Listing remote folder ...
ignoring remote file listed as Deleted: duplicati-20181014T230000Z.dlist.zip
ignoring remote file listed as Deleted: duplicati-20181015T230000Z.dlist.zip
Marked 4 remote files for deletion
Found 3 broken filesets with 620 affected files, purging files
Purging 155 file(s) from fileset 21.10.2018 01:00:00
Starting purge operation
Replacing fileset duplicati-20181020T230000Z.dlist.zip with duplicati-20181020T230001Z.dlist.zip which has with 155 fewer file(s) (63,29 MB reduction)
  Uploading file (45,55 MB) ...
  Deleting file duplicati-20181020T230000Z.dlist.zip ...
Purging 346 file(s) from fileset 22.10.2018 01:00:00
Starting purge operation
Replacing fileset duplicati-20181021T230000Z.dlist.zip with duplicati-20181021T230001Z.dlist.zip which has with 346 fewer file(s) (85,31 MB reduction)


System.Exception: Unexpected number of remote volumes marked as deleted. Found 1 filesets, but 0 volumes

   bei Duplicati.Library.Main.Database.LocalDeleteDatabase.<DropFilesetsFromTable>d__5.MoveNext()

   bei System.Linq.Buffer`1..ctor(IEnumerable`1 source)

   bei System.Linq.Enumerable.ToArray[TSource](IEnumerable`1 source)

   bei Duplicati.Library.Main.Operation.PurgeFilesHandler.DoRun(LocalPurgeDatabase db, IFilter filter, Action`3 filtercommand, Single pgoffset, Single pgspan)

   bei Duplicati.Library.Main.Operation.PurgeBrokenFilesHandler.Run(IFilter filter)

   bei Duplicati.Library.Main.Controller.RunAction[T](T result, String[]& paths, IFilter& filter, Action`1 method)

   bei Duplicati.Library.Main.Controller.PurgeBrokenFiles(IFilter filter)

   bei Duplicati.CommandLine.Commands.PurgeBrokenFiles(TextWriter outwriter, Action`1 setup, List`1 args, Dictionary`2 options, IFilter filter)

   bei Duplicati.CommandLine.Program.RunCommandLine(TextWriter outwriter, TextWriter errwriter, Action`1 setup, String[] args)
Return code: 100

=> it doesn’t work.
The Version is the same: “2.0.3.3_beta_2018-04-02”

6

The “Unexpected number of remote volumes marked as deleted” error seems to be related to a mismatch in dlist and dblock files (I think).

I don’t know what causes it, but @kenkendk might have some thoughts after seeing your experience.

I don’t know if a database Repair would fix it in your scenario, but I’d suggest NOT trying a database Recreate yet. At least not until others can chime in. :slight_smile:

7

Not sure exactly what goes wrong here, but it looks it it is attempting to re-create the same file twice.

I suggest moving duplicati-20181020T230000Z.dlist.zip out of the backup folder, and then trying the purge operation again. If the file duplicati-20181020T230001Z.dlist.zip exists, you should move that out as well.

8

Hi,
there is no duplicati-20181020T230000Z.dlist.zip, but a duplicati-20181020T230001Z.dlist.zip. So I moved this one out.
The Error is the same:

No broken filesets found in database, checking for missing remote files
  Listing remote folder ...
ignoring remote file listed as Deleted: duplicati-20181014T230000Z.dlist.zip
ignoring remote file listed as Deleted: duplicati-20181015T230000Z.dlist.zip
Marked 5 remote files for deletion
Found 3 broken filesets with 620 affected files, purging files
Purging 155 file(s) from fileset 21.10.2018 01:00:00
Starting purge operation
Replacing fileset duplicati-20181020T230000Z.dlist.zip with duplicati-20181020T230001Z.dlist.zip which has with 155 fewer file(s) (63,29 MB reduction)


System.Exception: Unexpected number of remote volumes marked as deleted. Found 1 filesets, but 0 volumes

   bei Duplicati.Library.Main.Database.LocalDeleteDatabase.<DropFilesetsFromTable>d__5.MoveNext()

   bei System.Linq.Buffer`1..ctor(IEnumerable`1 source)

   bei System.Linq.Enumerable.ToArray[TSource](IEnumerable`1 source)

   bei Duplicati.Library.Main.Operation.PurgeFilesHandler.DoRun(LocalPurgeDatabase db, IFilter filter, Action`3 filtercommand, Single pgoffset, Single pgspan)

   bei Duplicati.Library.Main.Operation.PurgeBrokenFilesHandler.Run(IFilter filter)

   bei Duplicati.Library.Main.Controller.RunAction[T](T result, String[]& paths, IFilter& filter, Action`1 method)

   bei Duplicati.Library.Main.Controller.PurgeBrokenFiles(IFilter filter)

   bei Duplicati.CommandLine.Commands.PurgeBrokenFiles(TextWriter outwriter, Action`1 setup, List`1 args, Dictionary`2 options, IFilter filter)

   bei Duplicati.CommandLine.Program.RunCommandLine(TextWriter outwriter, TextWriter errwriter, Action`1 setup, String[] args)
Return code: 100

(“bei” means “at”)
The Error at running BackUp:

Found 1 remote files that are not recorded in local storage, please run repair