2.1.1.104 > Files are missing from the remote storage

Ralf · October 6, 2025, 12:58pm

Updated from Canary .102 to .104
Run Backup to B2 as ever
Found 10 Files missing from remote storage, please run repair
Run Repair
25-10-06 14:56:02 +02 - [Error-Duplicati.Library.Main.Operation.RepairHandler-RepairDblockError]: Failed to perform repair for dblock: duplicati-bf4d405b7ba784217bc870ecdb5cf122a.dblock.zip.aes, message: Repair not possible, missing 51 blocks. If you want to continue working with the database, you can use the "list-broken-files" and "purge-broken-files" commands to purge the missing data from the database and the remote storage. UserInformationException: Repair not possible, missing 51 blocks. If you want to continue working with the database, you can use the "list-broken-files" and "purge-broken-files" commands to purge the missing data from the database and the remote storage.
List-Broken Files
The operation ListBrokenFiles has failed => You have attempted to change a passphrase to an existing backup, which is not supported. Please configure a new clean backup if you want to change the passphrase. ErrorID: PassphraseChangeNotSupported You have attempted to change a passphrase to an existing backup, which is not supported. Please configure a new clean backup if you want to change the passphrase. Return code: 100

Anybody got an idea what’s goin’ on?

ts678 · October 6, 2025, 4:49pm

For the password complaint, are you an experienced CLI user?
If not, GUI Commandline is nicer, as it supplies needed options.

For the Repair, I kind of wonder if message should suggest this:

  --rebuild-missing-dblock-files (Boolean): Rebuild dblock files when missing
    If dblock files are missing from the destination, you can attempt to rebuild
    them using local source data. However, since the local data may have changed,
    it may not be possible to retrieve all the required data and the process may
    be slow. Use this option to attempt to rebuild missing dblock files.
    * default value: false

but that would be a dev call. Also, does normal Repair ever help?

For the B2 problem, somebody else (but not me) has seen those.
It’s been going on for awhile, so could it be that your luck ran out?

Did you get a job log? If not, please see About → Logs → Stored.
Job log would be nice, as Complete log shows RetryAttempts.

What I would really like is log-file option, maybe at Retry level.
Problem is that few people set that in advance, maybe for a repro?

Ralf · October 7, 2025, 10:23am

Thx for your input but what I find strange is’ that it only comes up after the update. Last job on .102 successfully ran without probs Oct. 4th.

Nah, no CLI, only use GUI Commandline

rebuild-missing-blocks is set under “General Setttings” as standard.

Normal DB Repair gives the same message as under Top 3

The ongoing probs with B2 I noticed but couldn’t find any match similar to mine.

Logfile when running job 20251007 duplicati-b2.zip (3.0 KB)

Took a look at the About > Logs > Stored and found these from the Repair. Is this what mean?


7. Okt. 2025 09:14: Failed while executing Backup "MyPC > Backblaze B2" (id: 25)
Duplicati.Library.Interface.RemoteListVerificationException: Found 10 files that are missing from the remote storage, please run repair

   at Duplicati.Library.Main.Operation.FilelistProcessor.VerifyRemoteList(IBackendManager backend, Options options, LocalDatabase database, IBackendWriter log, IEnumerable`1 protectedFiles, IEnumerable`1 strictExcemptFiles, Boolean logErrors, VerifyMode verifyMode, CancellationToken cancellationToken)

   at Duplicati.Library.Main.Operation.BackupHandler.PreBackupVerify(Options options, BackupResults result, IBackendManager backendManager)

   at Duplicati.Library.Main.Operation.BackupHandler.RunAsync(String[] sources, IBackendManager backendManager, IFilter filter)

   at Duplicati.Library.Main.Controller.<>c__DisplayClass22_0.<<Backup>b__0>d.MoveNext()

--- End of stack trace from previous location ---

   at Duplicati.Library.Utility.Utility.Await(Task task)

   at Duplicati.Library.Main.Controller.RunAction[T](T result, String[]& paths, IFilter& filter, Func`3 method)

   at Duplicati.Library.Main.Controller.Backup(String[] inputsources, IFilter filter)

   at Duplicati.Server.Runner.RunInternal(Connection databaseConnection, EventPollNotify eventPollNotify, INotificationUpdateService notificationUpdateService, IProgressStateProviderService progressStateProviderService, IApplicationSettings applicationSettings, IRunnerData data, Boolean fromQueue)
7. Okt. 2025 09:14: Error in worker
Duplicati.Library.Interface.RemoteListVerificationException: Found 10 files that are missing from the remote storage, please run repair

   at Duplicati.Library.Main.Operation.FilelistProcessor.VerifyRemoteList(IBackendManager backend, Options options, LocalDatabase database, IBackendWriter log, IEnumerable`1 protectedFiles, IEnumerable`1 strictExcemptFiles, Boolean logErrors, VerifyMode verifyMode, CancellationToken cancellationToken)

   at Duplicati.Library.Main.Operation.BackupHandler.PreBackupVerify(Options options, BackupResults result, IBackendManager backendManager)

   at Duplicati.Library.Main.Operation.BackupHandler.RunAsync(String[] sources, IBackendManager backendManager, IFilter filter)

   at Duplicati.Library.Main.Controller.<>c__DisplayClass22_0.<<Backup>b__0>d.MoveNext()

--- End of stack trace from previous location ---

   at Duplicati.Library.Utility.Utility.Await(Task task)

   at Duplicati.Library.Main.Controller.RunAction[T](T result, String[]& paths, IFilter& filter, Func`3 method)

   at Duplicati.Library.Main.Controller.Backup(String[] inputsources, IFilter filter)

   at Duplicati.Server.Runner.RunInternal(Connection databaseConnection, EventPollNotify eventPollNotify, INotificationUpdateService notificationUpdateService, IProgressStateProviderService progressStateProviderService, IApplicationSettings applicationSettings, IRunnerData data, Boolean fromQueue)

   at Duplicati.Server.Runner.Run(Connection databaseConnection, EventPollNotify eventPollNotify, INotificationUpdateService notificationUpdateService, IProgressStateProviderService progressStateProviderService, IApplicationSettings applicationSettings, IQueuedTask data, Boolean fromQueue)

   at Duplicati.WebserverCore.Services.QueueRunnerService.RunTask(IQueuedTask task)

ts678 · October 7, 2025, 12:18pm

That’s a good spot. One can also add it as-needed in GUI Commandline.
I don’t know the whole plan, but it might have helped situation somewhat.
Remaining blocks might have been unavailable, e.g. from source change.

That was after the enhanced Repair, so can’t still test the plain version first.
If it happens again, might be able to do that. Maybe dev will have comment.

Missing files on remote sounds like your “Files are missing from the remote storage”.
Details vary.

Since this was added after error, it helps less. The dev could interpet results better.

One surprise to me was 973 missing blocks. Is this at 50 MB remote volume size?
Even at the Duplicati 2.0 default 100 KB blocksize, that’s lots of blocks to jam in.

The reason I think this backup might have begun on a 2.0 is the Oct 2024 versions.
That also makes me wonder if there was a Compact. Job log would have said, BUT

github.com/duplicati/duplicati

Canary job log not produced upon error since 2.1.0.121

opened 01:56PM - 04 Oct 25 UTC

ts678

- [x] I have searched open and closed issues for duplicates. - [x] I have se…arched the [forum](https://forum.duplicati.com) for related topics. --- ## Environment info - **Duplicati version**: Canary series 2.1.0.121-2.1.1.104 so far. Fortunately Beta seems OK. - **Operating system**: Windows 10 - **Backend**: various ## Description The job log seems to be suppressed if any error occurs. In ngax, one gets the red popup, but no job log to see. Generally the server log gets the error, but is not what the GUI button shows by default, and is not well known. This will cause user frustration and extra support work. When error occurs, log info should exist, with easy path. ``` version popup job server 2.1.0.120 Y Y Y 2.1.0.121 N N Y 2.1.0.122 Y N Y 2.1.1.103 Y N Y 10/03/2025 releases: 2.1.1.104 Y N Y 2.1.2.1 Beta Y Y Y No such host is known. (api.backblazeb2.com:443) No such host is known. (duplicati-oauth-handler.appspot.com:443) ``` Earlier Canary releases generally had a B2 backup sitting in them, so I turned off Wi-Fi for "Verify files". 2.1.1.104 is so new that I made a backup of a file (to set DB), then switched to B2 with a dummy login. I was wishing I had set `number-of-retries=0` like on my usual, because it took awhile to actually fail... 2.1.2.1 Beta was a past-due OneDrive scheduled backup that ran, so I didn't work much to provoke it. I also tested 2.1.1.104 using an invalid source path, changing to a bad drive letter. Usual log loss held. Warning was also tested there (a little bit) using `no-local-blocks`, which is deprecated. Got a job log. Initial forum report [here](https://forum.duplicati.com/t/release-2-1-1-103-canary-2025-09-25/21349/15?u=ts678) had more comment, less detail, and some discussion. The general report was: > Compared to 2.1.2.0_beta_2025-08-20, job logs tend to go missing instead of giving error ## Steps to reproduce 1. Do something that gets an error - **Actual result**: No job log - **Expected result**: Job log ## Screenshots ## Debug log

Right place, but I was more interested in anything hinting at problems with the backup.
Afterwards, cleanup problems are interesting but secondary.

My backup was running successfully until a network glitch on Oct 2nd, when it broke:

github.com/duplicati/duplicati

remote delete failure sets bad DB state, gets "not recorded in local storage" hours later

opened 05:35PM - 04 Oct 25 UTC

ts678

- [x] I have searched open and closed issues for duplicates. - [x] I have se…arched the [forum](https://forum.duplicati.com) for related topics. --- ## Environment info - **Duplicati version**: recent Beta and Canary - **Operating system**: Windows 10 - **Backend**: various ## Description "remote files that are not recorded in local storage." error occurs unexpectedly two or more hours after destination `delete` fails. [Release: 2.1.1.103 (Canary) 2025-09-25](https://forum.duplicati.com/t/release-2-1-1-103-canary-2025-09-25/21349/19?u=ts678) is analysis (after hitting this on a bad network day), steps to reproduce it, and version test. Unfortunately, both 2.0.2.0 Beta and 2.0.2.1 Beta have the problem. 2.1.0.5 Stable looks like it doesn't, so this seems a regression.

I think I know how to fix it, but I’m leaving it down a bit longer in case dev wants a look.
If we can get yours back up, then we can add logging, and look for any failure patterns.

This gets back to list-broken-files password change accusation. I can’t repro that, however I forget whether I was in old or new UI. Do you recall which one you ran then?

Ralf · October 9, 2025, 7:49am

I’m only running the old UI, ‘cause the new one doesn’t have all the functionality last time I looked.

One surprise to me was 973 missing blocks. Is this at 50 MB remote volume size?
Even at the Duplicati 2.0 default 100 KB blocksize, that’s lots of blocks to jam in.

Yep, runs on standard settings 50MB/100KB. You think the prob maybe associated with this?

Could also be I did some repair/purging/compacting with this job over time, which may or may not have run into problems itself. So I’m thinking the DB itself may have been corrupted someway or the other, therefore I deleted and rebuild it from scratch. DB is now a lot smaller, but when running list-broken-files I still get the “password changed” message.

ts678 · October 9, 2025, 11:46am

If you find important missing functionality in Canary (new UI is also in two Betas), please note.

Too little known yet to say. It just seemed high, but could be from lots of small files in the backup.

Since I guess this is GUI Commandline on the old UI, I’m surprised that such a problem exists.

I hope character sensitivities have been fixed, but I’ll ask if passphrase has special characters.

Sometimes these have gotten conversions which hurt them, but it’s hard to see that in the GUI.

For a good view, maybe you try Export As Command-line and edit that to list-broken-files.

Ralf · October 10, 2025, 9:22am

Yes, there are some punctuation-marks, but these are also in the other backupjobs.
—

Another backup has run today automatically, and now I got this in the log:

2025-10-10 09:16:47 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: Die Operation Backup wurde gestartet
2025-10-10 09:16:53 +02 - [Error-Duplicati.Library.Main.Controller-FailedOperation]: The operation Backup has failed
Duplicati.Library.Interface.DatabaseInconsistencyException: Detected 34 file(s) in FilesetEntry without corresponding FileLookup entry in the following filesets:
System.Linq.AsyncEnumerable+WhereSelectEnumerableAsyncIterator`2[<>f__AnonymousType2`3[System.Int64,System.Int32,System.DateTime],System.String]
   at Duplicati.Library.Main.Database.LocalDatabase.VerifyConsistencyInner(Int64 blocksize, Int64 hashsize, Boolean verifyfilelists, Boolean laxVerifyForRepair, CancellationToken token)
   at Duplicati.Library.Main.Database.LocalDatabase.VerifyConsistencyInner(Int64 blocksize, Int64 hashsize, Boolean verifyfilelists, Boolean laxVerifyForRepair, CancellationToken token)
   at Duplicati.Library.Main.Database.LocalDatabase.VerifyConsistencyInner(Int64 blocksize, Int64 hashsize, Boolean verifyfilelists, Boolean laxVerifyForRepair, CancellationToken token)
   at Duplicati.Library.Main.Database.LocalDatabase.VerifyConsistency(Int64 blocksize, Int64 hashsize, Boolean verifyfilelists, CancellationToken token)
   at Duplicati.Library.Main.Operation.BackupHandler.PreBackupVerify(Options options, BackupResults result, IBackendManager backendManager)
   at Duplicati.Library.Main.Operation.BackupHandler.RunAsync(String[] sources, IBackendManager backendManager, IFilter filter)
   at Duplicati.Library.Main.Controller.<>c__DisplayClass22_0.<<Backup>b__0>d.MoveNext()
--- End of stack trace from previous location ---
   at Duplicati.Library.Utility.Utility.Await(Task task)
   at Duplicati.Library.Main.Controller.RunAction[T](T result, String[]& paths, IFilter& filter, Func`3 method)

Actually I’m thinking about calling it a day and move on. This job runs only for redundency purposes as in 3-2-1-strategy, and I guess I may just delete the old versions now to clean up the DB.

Ralf · October 13, 2025, 2:18pm

Finally switched to the latest beta in hope the problem would be solved not only for new backups to B2, but when running backup I get:

Duplicati.Library.Interface.DatabaseInconsistencyException: Detected 34 file(s) in FilesetEntry without corresponding FileLookup entry in the following filesets:

Now tried to delete this versions via GUI-commandline but get error “DB cannot be found”, which may have got sth to do with former repairing and/or deleting/rebuilding attempts.

Anybody got an idea how to get rid of the outdated DBs and the filesets?

complete log-entry:

2025-10-10 23:11:47 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: Die Operation Backup wurde gestartet
2025-10-10 23:11:52 +02 - [Error-Duplicati.Library.Main.Controller-FailedOperation]: The operation Backup has failed
Duplicati.Library.Interface.DatabaseInconsistencyException: Detected 34 file(s) in FilesetEntry without corresponding FileLookup entry in the following filesets:
Fileset 1: 04.10.2025 10:13:57 (id = 18)
Fileset 2: 03.10.2025 09:56:45 (id = 17)
Fileset 3: 02.10.2025 09:02:09 (id = 16)
Fileset 4: 30.09.2025 09:58:50 (id = 15)
Fileset 5: 29.09.2025 09:55:30 (id = 14)
Fileset 6: 25.09.2025 19:59:13 (id = 13)
Fileset 8: 30.07.2025 14:08:18 (id = 11)
Fileset 9: 29.07.2025 09:33:08 (id = 10)
at Duplicati.Library.Main.Database.LocalDatabase.VerifyConsistencyInner(Int64 blocksize, Int64 hashsize, Boolean verifyfilelists, Boolean laxVerifyForRepair, IDbTransaction transaction)
at Duplicati.Library.Main.Database.LocalDatabase.VerifyConsistency(Int64 blocksize, Int64 hashsize, Boolean verifyfilelists, IDbTransaction transaction)
at Duplicati.Library.Main.Operation.BackupHandler.PreBackupVerify(Options options, BackupResults result, IBackendManager backendManager)
at Duplicati.Library.Main.Operation.BackupHandler.RunAsync(String sources, IBackendManager backendManager, IFilter filter)
at Duplicati.Library.Main.Controller.<>c__DisplayClass22_0.<b__0>d.MoveNext()
— End of stack trace from previous location —
at Duplicati.Library.Utility.Utility.Await(Task task)
at Duplicati.Library.Main.Controller.RunAction[T](T result, String& paths, IFilter& filter, Func`3 method)
2025-10-10 23:13:06 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: Die Operation Backup wurde gestartet

When

ts678 · October 13, 2025, 10:23pm

Release: 2.1.0.112 (Canary) 2025-03-26 had filesets error. A repair helped. Have you tried it?

Did you do the CLI test I asked for to try to figure out the earlier Commandline password issue?

This sounds like a similar case of the old GUI somehow not passing the options along properly.

I can get a complaint if I delete dbpath, and it tells me a path. Did you get anything with yours?

Ralf · October 14, 2025, 8:44am

You mean this?

C:\Program Files\Duplicati 2>Duplicati.CommandLine.exe list-broken-files b2://myb2authinfos --dbpath=c:\ProgramData\Duplicati\FDAQWYRRO.sqlite

Verschlüsselungspassphrase eingeben: *******************
The operation ListBrokenFiles has failed => Database file does not exist: C:\Users\raffman\AppData\Local\Duplicati\IPQGPVASDA.sqlite

ErrorID: DatabaseDoesNotExist
Database file does not exist: C:\Users\raffman\AppData\Local\Duplicati\IPQGPVASDA.sqlite
←]9001;CmdNotFound;auth-password←\Der Befehl "auth-password" ist entweder falsch geschrieben oder
konnte nicht gefunden werden.

ts678 · October 14, 2025, 11:45am

was what the CLI test was trying to study. Did you ever resolve the GUI “password changed”?

Is it different in GUI and CLI, with CLI as:

Does that file exist?

After the “password changed” mystery, the next GUI oddity report was:

Possibly your guess was right, but if DB is genuinely missing, very few things will be working.
Since you’re not reporting that, I thought new GUI issue was similar to password change one.