Failed: Found 10 remote files that are not recorded in local storage

I thought I would provide some feedback here because for some months and different versions of the Canary releases I’ve had one server, running Fedora 42, every few days reporting this same issue for one of its backups. However, this backup is using an SMB share on a local Windows 2025 server as its destination, not an offsite one as being reported above.

I waited until this morning for the backups to complete after updating to .105 and this is what it reported:

Failed: Found 10 remote files that are not recorded in local storage. This can be caused by having two backups sharing a destination folder which is not supported. It can also be caused by restoring an old database. If you are certain that only one backup uses the folder and you have the most updated version of the database, you can use repair to delete the unknown files.
Details: Duplicati.Library.Interface.RemoteListVerificationException: Found 10 remote files that are not recorded in local storage. This can be caused by having two backups sharing a destination folder which is not supported. It can also be caused by restoring an old database. If you are certain that only one backup uses the folder and you have the most updated version of the database, you can use repair to delete the unknown files.
   at Duplicati.Library.Main.Operation.FilelistProcessor.VerifyRemoteList(IBackendManager backend, Options options, LocalDatabase database, IBackendWriter log, IEnumerable`1 protectedFiles, IEnumerable`1 strictExcemptFiles, Boolean logErrors, VerifyMode verifyMode, CancellationToken cancellationToken)
   at Duplicati.Library.Main.Operation.BackupHandler.PreBackupVerify(Options options, BackupResults result, IBackendManager backendManager)
   at Duplicati.Library.Main.Operation.BackupHandler.PreBackupVerify(Options options, BackupResults result, IBackendManager backendManager)
   at Duplicati.Library.Main.Operation.BackupHandler.RunAsync(String[] sources, IBackendManager backendManager, IFilter filter)
   at Duplicati.Library.Main.Controller.<>c__DisplayClass22_0.<<Backup>b__0>d.MoveNext()
--- End of stack trace from previous location ---
   at Duplicati.Library.Utility.Utility.Await(Task task)
   at Duplicati.Library.Main.Controller.RunAction[T](T result, String[]& paths, IFilter& filter, Func`3 method)

The share is a unique folder dedicated to this server, so there is no sharing with another server. Basically the main share is \LISA\MAGGIE with two backups on this server, one uses \LISA\MAGGIE\DUPLICATI\LOCAL\ for its destination and this backup rarely fails and so far not like this, the second backup uses \LISA\MAGGIE\DUPLICATI\DP. The way I have things scheduled is that when the first backup finishes it starts the second one using an after job script. Basically, the second job just backs up the database of the first job.

If I run a repair then re-run the backup, it usually works but I’ve had times when it needs a second repair. In the case of the above, it worked after a single repair.

My prediction is that it will probably be fine

I just realised that the image shows 3 backups, only two of them use the share and the order is Local (scheduled), Wasabi (scripted), DP (scripted) so there is quite a gap between the two backups using the SMB share.

This issue reports “files that are missing from the remote storage”.

Your new report is “files that are not recorded in local storage”

That’s the opposite issue. Would you like me to move the report?

Ah yes, wasn’t paying attention so please move it, thanks.

Is this the typical error, seen on DP backup for several months, with prior backup success?

Prior backup matters because PreBackupVerify happens before backup, so checks prior.

Do you have any logs with the actual file names, so that history of missing can be checked?

In addition to job log, server log at About → Logs → Stored might have them.

Next step is

You can option a log-file, maybe at retry level so that the file uploading will be recorded.

Missing file names might be in About → Logs → Stored.

The job database usually has 30 days of history, but it’s easiest to search using DB browser.

DB bug report is sometimes also an option.

Ok, that’s a lot to go through.

It’s always the same error, just the number of files found changes.

None of the failed jobs are logged with the job, only the repairs are seen for each one:

I’ll look at setting a log option just for this job

No, no filenames are logged under Stored

I’ve generated a bug report for the job database.

Might be this serious (IMO) Canary issue:

Then maybe About → Show log → Live will show them even if you just run “Verify files”.

If you can get names, then you can look at file dates to guess what backup wrote them.

Maybe the the bug report will reveal names if you put it somewhere and post a link to it.

comes to mind, but that seems to require a delete failure, and I’m not certain you had it.

SMB has been trouble sometimes. Is this Fedora SMB or CIFS (aka SMB) Destination?

The job is running on Fedora server but the destination is a Windows 2025 Server share. I have other Linux machines using the same Windows Server for their destinations.

By destinations, I assume you mean Duplicati destinations.

What OS are the other machines running?

On Fedora, do you mount OS SMB, or use Duplicati SMB?

Still awaiting the other information. Nothing to look at so far.

All my Duplicati destinations are either a Windows Server 2025 share or a Wasabi bucket - I don’t use anything else. On my Linux machines, I have some Fedora and Debian, the jobs use the Duplicati SMB as I no longer mount them on the OS as being too unreliable and a p.i.t.a. to set up. This Fedora one is the only one repeatedly failing like this.

As soon as the job fails again I’ll have a log to provide - it worked today but I took a copy of the log so it can be compared to a failed one, in case that helps.

Thanks. Sadly, it sounds like OS SMB issues might have been traded for Duplicati SMB issues, although it’s still too early to say. Maybe some dev can speak to Duplicati SMB troubleshooting.