Found 1 remote files that are not recorded in local storage, please run repair

Hi there,

I have Duplicati running on multiple machines running Ubuntu 18.04. 3 of which have (at different times) given an error of Found 1 remote files that are not recorded in local storage, please run repair.

These backups all run daily at 4 AM to a FTP (Alternative) endpoint. This error references an issue where the FTP has files that are not recorded in database (AFAIK). Backups all have their own folder that has nothing else touching its files.

Running repair (like it suggests) does not solve the issue either.

I’ve tried to research this issue, none of which have I seen solve it.

Trying to find the file it doesn’t like, and deleting it doesn’t fix it either as it will pick another random file.
Only deleting all backups to fresh empty ftp folder works. (Not a solution as you loose your backups).

Any ideas? thank you.

Can you give examples of what it picks? The main types of files I’d expect to see recognized will start with duplicati- then have either dblock, dindex, or dlist in their name. Manually adding any of those types produced an error on backup, then Repair fixed it by deleting extra file. Does your Repair do no deletion?

If you’re finding files, you probably know that About → Show log → Live → Warning will provide its name. Seeing deletion can be done at a more detailed level, e.g. Information, but seeing file remain also works.

Running repair would not delete the file.
Verify would not solve either. (Repair or verify caused another error that was linked to this original one)

To find the name of the file, I had to run a command line command through the GUI. I believe it was the dblock (if not was one of the ones you listed).

I have never gone to warning section for this issue as it was titled as an error. Going to error just showed more log but never showed the name of the file.

The log at warning works. I don’t know the rationale for why it’s a warning. Maybe different code sections.

2020-07-24 09:28:04 -04 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-ExtraUnknownFile]: Extra unknown file: duplicati-i0dbadb16cda94770b1230e2f2870611b.dindex.zip
2020-07-24 09:28:04 -04 - [Error-Duplicati.Library.Main.Operation.FilelistProcessor-ExtraRemoteFiles]: Found 1 remote files that are not recorded in local storage, please run repair
2020-07-24 09:45:35 -04 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-ExtraUnknownFile]: Extra unknown file: duplicati-b1bad726fd4b94922ba26241dfd78bfb3.dblock.zip
2020-07-24 09:45:35 -04 - [Error-Duplicati.Library.Main.Operation.FilelistProcessor-ExtraRemoteFiles]: Found 1 remote files that are not recorded in local storage, please run repair
2020-07-24 09:52:52 -04 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-ExtraUnknownFile]: Extra unknown file: duplicati-20200724T133014Z.dlist.zip
2020-07-24 09:52:52 -04 - [Error-Duplicati.Library.Main.Operation.FilelistProcessor-ExtraRemoteFiles]: Found 1 remote files that are not recorded in local storage, please run repair

Because my live log warnings have scrolled away, above came from –log-file at suitable log-file-log-level.

To pick on my bad dblock, what should happen requires Information level logging but shows these things:

2020-07-24 09:45:35 -04 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-ExtraUnknownFile]: Extra unknown file: duplicati-b1bad726fd4b94922ba26241dfd78bfb3.dblock.zip
2020-07-24 09:47:15 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Delete - Started: duplicati-b1bad726fd4b94922ba26241dfd78bfb3.dblock.zip (14.99 MB)
2020-07-24 09:47:25 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Delete - Completed: duplicati-b1bad726fd4b94922ba26241dfd78bfb3.dblock.zip (14.99 MB)

Can you paste a live log or log file (easier to read, especially with three backticks (```) above and below)?
If you can find the name of the extra file, it would help to know its history from logs or even from FTP site.